Find work in Canada.

A simpler way to find your next job.

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 11 mins ago
Planning & Purchasing Manager
WakeWater Beverage Company
Toronto, ON
Full-time
…our manufacturing owner, who holds the cost, capability and lead-time picture for each…
Added 11 mins ago
Leak Detection Advisor
SGS
Calgary, AB
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 11 mins ago
Leak Detection Advisor
SGS
Calgary, AB
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 40 mins ago
Planning & Purchasing Manager
WakeWater Beverage Company
Toronto, ON
Full-time
…our manufacturing owner, who holds the cost, capability and lead-time picture for each…
Added 40 mins ago
Business Analyst
LanceSoft, Inc.
Halifax, NS
Contract
Analyze existing business processes and recommend optimization and automation opportunities.
Added 40 mins ago
Test Architect/UI-Path Engineer
Hays
Toronto, ON · Greater Toronto Area, Canada
Full-time
Looking for Test Architect/UI-Path Engineer having minimum 10 years of experience
Added 1 hour ago
Director, Wealth Digital AI Platforms & Technology Delivery
BMO
Toronto, ON · BMOPLACE
Full-time
…solutions. We are seeking an experienced AI Delivery Director to lead the planning, execution, and delivery of strategic AI initiatives that support the evolution of our Wealth Management…
Added 1 hour ago
Dedicated Support Engineer - Toronto
OpenAI
Canada
Full-time
…reliability work, and clear ownership during critical moments. We use automation, agents, and our own technology to help build the future of technical…
Added 1 hour ago
AVEVA Enterprise SCADA Specialist
SGS
Regina, SK
$85,000 to $165,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 1 hour ago
AVEVA Enterprise SCADA Specialist
SGS
AB · Edmonton, AB
$85,000 to $165,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 1 hour ago
Senior Manager - HRIS & Payroll
kdc/one
Longueuil, QC
Assess current processes and lead simplification, standardization, automation, and self-service initiatives.
Added 1 hour ago
Quality Engineering Lead
Definity Insurance Company
Mississauga, ON
Full-time
Knowledge of test automation frameworks, CI/CD, and modern Quality Engineering
Added 2 hours ago
AVEVA Enterprise SCADA Specialist
SGS
Calgary, AB
$85,000 to $165,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 2 hours ago
Senior IT Project Technician
Behaviour Interactive
Montreal, QC
Full-time
Reporting to the IT Project Team lead, you’ll be part of the Innovation team. In this role, you'll work hand in hand with production and the IT team to find the right software for the…
Added 2 hours ago
Senior Data Solutions Engineer
HOOPP (Healthcare of Ontario Pension Plan)
Toronto, ON
$103,000 to $153,000 CAD / year
Full-time
…judgment, product thinking, systems thinking, and a willingness to test new ideas. You will look beyond immediate symptoms, identify underlying needs, and develop solutions that are secure,…
Added 2 hours ago
Technical Project Manager
OSI Engineering
Concord, ON
Full-time
We're looking for a driven Project Manager to lead the successful execution of automation projects from start to finish. In this role, you'll be the bridge between our customers and…
Added 2 hours ago
Electrical Supervisor
Interfor
Belledune, NB
Join Interfor as an Electrical Supervisor and lead a talented
Added 3 hours ago
Principal Process Automation Engineer
Worley
Pickering, ON
Full-time
…expansion of new business opportunities within the industrial automation sector by leveraging cutting-edge digital, technology, and autonomous solutions. The consultant will play a pivotal…
Added 3 hours ago
Assembly Technician
Husky Technologies
Bolton, ON
Full-time
Inspect and test mold components to determine feasibility
Added 3 hours ago
Designer, Development (Electrical)
Husky Technologies
Bolton, ON
Full-time
…passion of our people around the world and their desire to lead change. At the same time, we are not afraid to expect a lot and strive for leadership in all of our key markets. We are a…
Added 3 hours ago
AVEVA Enterprise SCADA Specialist
SGS
Calgary, AB
$85,000 to $165,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 3 hours ago
Ignition SCADA Specialist
SGS
Edmonton, AB · Calgary, Alberta
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 3 hours ago
Ignition SCADA Specialist
SGS
Vancouver, BC · Calgary, Alberta
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 3 hours ago
Ignition SCADA Specialist
SGS
Regina, SK
$90,000 to $125,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…
Added 3 hours ago
Ignition SCADA Specialist
SGS
AB · Edmonton, AB
$90,000 to $1,250,000 CAD / year
Full-time
…operational technology solutions provider specializing in industrial automation, SCADA, data historians, and analytics for the energy sector. We work with major oil and gas producers across…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job