Find work in Canada.

334,431 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 4 mins ago
Senior Project Manager (Nuclear)
Calian in Space & Technology
Toronto, ON
Full-time
…company across defence, space, health, nuclear energy, public safety, and…
Added 34 mins ago
Geotechnical Specialist
B2Gold - Nunavut
NU · Nunavut, Canada
Full-time
…analysis, and providing technical recommendations to optimize mine safety and…
Added 34 mins ago
Asset Protection Specialist Full-Time - Fort McMurray
The Home Depot Canada
Calgary, AB · Greater Calgary Metropolitan Area
Full-time
The Asset Protection Specialist (APS) is primarily responsible for preventing financial loss caused by theft and fraud, organized retail crime and supporting safety and environmental…
Added 49 mins ago
Chemistry Laboratory Manager
Auxilium Health
Oshawa, ON
$65,000 to $75,000 CAD / year
Full-time
…compliance with applicable regulatory, quality, accreditation, and safety requirements. This role oversees laboratory personnel, project planning, workflow management, resource allocation,…
Added 1 hour ago
Equipment & Retail Specialist, CMH Revelstoke
CMH Heli-Skiing & Summer Adventures
BC · British Columbia, Canada
Full-time
Position Title: Equipment & Retail Specialist, Revelstoke
Added 1 hour ago
Inventory Control / Quality Assurance Specialist
Rexel Canada
Delta, BC
$60,000 to $75,000 CAD / year
Full-time
We are currently looking for an Inventory Control / Quality Assurance Specialist at our Delta, BC branch. The Inventory Control / QA Specialist reporting to the Regional DC Administration…
Added 1 hour ago
Hazmat Technician – Emergency Response
GFL - Sewer Technologies Division
AB · Edmonton, AB
Full-time
…an efficient manner while upholding GFL’s high standards of safety and quality of service. The position requires exceptional skills in safety, planning, communication, organization, and…
Added 1 hour ago
M.L.T. Charge - Quality
Ross Memorial Hospital
Kawartha Lakes, ON · Lindsay, ON
Full-time
Familiar with the full range of laboratory tests and procedures. Performs duties of registered technologist in accordance with safety guidelines and established procedures.
Added 2 hours ago
Specialist, Quality Control - Temporary - 1 Year
Walmart Canada
Cornwall, ON
Full-time
Added 2 hours ago
Senior Electronics Hardware Designer
Schneider Electric
Richmond, BC
$114,750 to $162,000 CAD / year
Full-time
Schneider Electric's Solar & Storage team is seeking a highly motivated Power Electronics and Controls Specialist with strong expertise in the development of solar, battery energy storage,…
Added 2 hours ago
Specialist / Senior Specialist / Lead Specialist - Plant Maintenance Support (Refinery)
Parkland Corporation
Burnaby, BC
Full-time
…Pipeline, and Refinery teams. The Plant Maintenance Support Specialist performs SAP EAM/Plant Maintenance administration, equipment master data management, inspection and preventive…
Added 2 hours ago
Coordinator, Billing
Trimac Transportation
Edmonton, AB
Full-time
…escalation of billing and driver pay-related issues. The Billing Specialist is expected to take initiative in problem resolution and process…
Added 2 hours ago
Indigenous Rights Engagement Specialist
Dillon Consulting Limited
Vancouver, BC
Full-time
We are currently seeking an Indigenous Rights and Consultation Specialist to join our team. We specialize in meaningfully integrating Indigenous rights, relationships, values, and…
Added 2 hours ago
Indigenous Rights Engagement Specialist
Dillon Consulting Limited
Guelph, ON · London, ON
Full-time
We are currently seeking an Indigenous Rights and Consultation Specialist to join our team. We specialize in meaningfully integrating Indigenous rights, relationships, values, and…
Added 2 hours ago
Specialist, RES, Financial Aid
Langara College
Vancouver, BC
Full-time
The Specialist is functional expert in a specific registrarial field as assigned. The Specialist provides instructions and guidance to prospective and current students, internal staff, or…
Added 2 hours ago
IMG Clinical Assistant
Changepain Medical & Allied Health Clinic
Burnaby, BC
Full-time
Adhere to x-ray safety protocols at all times.
Added 3 hours ago
Industrial Software Validation|
Husky Technologies
Bolton, ON
Full-time
…state-of-the-art manufacturing facilities with outstanding safety records. We offer a great work environment and competitive total compensation package, including above market retirement…
Added 3 hours ago
Advanced Applications Blow Molding Specialist
Husky Technologies
Bolton, ON
Full-time
Title: Advanced Applications Blow Molding Specialist
Added 3 hours ago
Proposal Specialist
Norland
Burnaby, BC
Full-time
Passionate about your career and ready for new challenges? Join Norland as a Proposal Specialist and grow with us!
Added 3 hours ago
Automation Specialist (Engineer, E.I.T. or Technologist) - Machinery Performance
Spartan Controls Ltd.
Calgary, AB
…leveraging applied automation we assist customers improving their Safety, Reliability, Operations and…
Added 3 hours ago
Indigenous Rights Engagement Specialist
Dillon Consulting Limited
AB · Edmonton, AB
Full-time
We are currently seeking an Indigenous Rights and Consultation Specialist to join our team. We specialize in meaningfully integrating Indigenous rights, relationships, values, and…
Added 3 hours ago
Health & Safety Specialist administrator
FlatironDragados
AB · Edmonton, AB
Full-time
Are you passionate about promoting a culture of safety in the workplace and making a real difference in preventing accidents and injuries? As a Health and Safety Specialist, you will…
Added 3 hours ago
Architectural Contract Administrator
TalentSphere Staffing Solutions
Ottawa, ON
Contract
Other titles: Contract Administrator, Contract Administrator, Senior Contract Administrator, Technical Specialist, Contracts Specialist, Architectural Technologist
Added 3 hours ago
Specialist, Retention - Hybrid
Cogeco Connexion
Burlington, ON
Full-time
The Retention Specialist position is an employee hybrid role, where you will work from your home office and 2 x a month in our Burlington, ON office, that provides excellent customer…
Added 3 hours ago
Fraser Health Region - Indigenous Cultural Liaison Support Worker (Casual)
RainCity Housing and Support Society
Maple Ridge, BC · Surrey, BC
…integration; while advocating for access, rights, and Cultural Safety as…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job