Find work in Canada.

324,389 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 46 mins ago
Customer Success Solutions Specialist
Teltoo (Acquired by Haivision)
Success, SK
Full-time
Collaborate with Technical Support, Product Management, and Engineering teams to resolve and escalate
Added 1 hour ago
Consultant, IT Systems Administrator (Airflow/Snowflake)
Project X Ltd.
Toronto, ON
Full-time
The Consultant, IT Systems Administrator is part of our Technical Enablement team. This team oversees the monitoring, maintenance, enhancement, research, deployment, and documentation of…
Added 5 hours ago
ERP Business Analyst
Husky Technologies
Bolton, ON
Full-time
4+ years’ experience as a technical business analyst or application specialist preferred.
Added 11 hours ago
ERP Business Analyst
Husky Technologies
Bolton, ON
Full-time
4+ years’ experience as a technical business analyst or application specialist preferred.
Added 12 hours ago
Customer Service Specialist
Transx Ltd
Guelph, ON
$50,000 to $60,000 CAD / year
Full-time
Technical Skills: Computer literate and proficient; experience with TMW or operational software is an asset. Knowledge of the trucking industry and associated rules/regulations (e.g., Hours…
Added 12 hours ago
Accounting Specialist - Level 2
Transx Ltd
Rosser, MB
Full-time
The TransX Group of Companies has an exciting opportunity for an Accounting Specialist – Level 2 to join our Yield & Financial Planning department in Winnipeg. Reporting to the Financial…
Added 12 hours ago
Project Technician – Tier 3 Network & Infrastructure Specialist
MSP OPERATIONAL CORP
Guelph, ON · London, ON
$90,000 to $100,000 CAD / year
…to grow, we are seeking a Project Technician – L3 Networking Specialist to join us in creating innovative technology solutions that will shape the future of modern work for our…
Added 12 hours ago
Employment Development Specialist (GCOS Project)
MANITOBA POSSIBLE SERVICES INC.
Thompson, MB
$55,562 to $66,461 CAD / year
Full-time
An Employment Development Specialist. You are providing employment services and 12 weeks of work experience to assist persons with disabilities prepare for and obtain gainful employment to…
Added 16 hours ago
Senior / Principal Geotechnical Engineer
AtkinsRéalis
Ottawa, ON · Vaughan, ON
Full-time
We are currently seeking aa dynamic, and growth focused Senior Geotechnical Specialist to join the Geotechnical Practice, providing technical and operational leadership, having superior…
Added 17 hours ago
ERP Business Analyst
Husky Technologies
Bolton, ON
Full-time
4+ years’ experience as a technical business analyst or application specialist preferred.
Added 17 hours ago
Photo Lab Specialist
London Drugs Limited
Vancouver, BC
$18.25 to $21.58 CAD / hour
Other
You will also have the opportunity to work in the other technical departments such as Photo Electronics and mobile phones. Product knowledge of these two areas would be considered an asset.
Added 17 hours ago
Product Expert
Cabico&co
Coaticook, QC
Full-time
As a Product Specialist, you will play a key role in the development, improvement and commercialization of our product portfolio while working closely with Product Development, Purchasing,…
Added 17 hours ago
Product Expert
Cabico&co
Magog, QC
Full-time
As a Product Specialist, you will play a key role in the development, improvement and commercialization of our product portfolio while working closely with Product Development, Purchasing,…
Added 17 hours ago
Product Expert
Cabico&co
Sherbrooke, QC
Full-time
As a Product Specialist, you will play a key role in the development, improvement and commercialization of our product portfolio while working closely with Product Development, Purchasing,…
Added 21 hours ago
Marketing Operations Specialist
Vistage Worldwide, Inc.
Calgary, AB
Full-time
Configure and maintain sales and marketing automation tools, including email sequences, task automation, lead routing, and pipeline management.
Added 1 day ago
Analyst Intern (Nuclear)
Calian in Space & Technology
Ottawa, ON
Internship
…Preparedness, Environmental Protection, Decommissioning, Waste management, and cutting-edge Systems Engineering and…
Added 1 day ago
Junior Supply Chain Specialist - Corporate
Bird Construction
Calgary, AB
Full-time
Junior Supply Chain Specialist - CorporateThe Junior Supply Chain Specialist - Corporate provides administrative, analytical and operational support to the National Supply Chain Manager,…
Added 1 day ago
Senior Tax Associates
Stern Cohen LLP
Toronto, ON
Full-time
We are looking for an experienced Senior Tax Associate to join our tax specialist team.
Added 1 day ago
Custom Order Product Specialist/ Engineer - Electrical
Eaton Corporation
Milton, ON
Full-time
Eaton’s Electrical sector is currently seeking a Custom Order Product Specialist / Engineer- Electrical to join our team. This onsite position is based at our Milton, ON facility and offers…
Added 1 day ago
Project Electrical Engineer - Advanced Power Generation
Black & Veatch
Calgary, AB
Full-time
Functions as a technical specialist or in a lead role. With minimal supervision, applies advanced engineering techniques and analyses. Continues building on knowledge to begin developing…
Added 1 day ago
Project Specialist - Security Systems (Capital Projects)
Convergint Technologies Ltd
Mississauga, ON
$70,000 to $90,000 CAD / year
Convergint is looking for a full-time, team-oriented, results-driven Security Project Specialist for our Capital Projects team, to join our amazing culture in our Toronto, ON location. In…
Added 1 day ago
Lead Custom Order Product Specialist / Engineer - Electrical
Eaton Corporation
Milton, ON
Full-time
The Lead Custom Order Product Specialist/ engineer would serve as a technical lead for the plant electrical engineering teams in our Milton manufacturing plants.They will provide timely and…
Added 1 day ago
Configuration Management Specialist
PROVINCIAL AEROSPACE LTD
St. John's, NL · Halifax, NS · Ottawa, ON · Vaughan, ON
Full-time
The Configuration Management Specialist will work closely with the Programs, Engineering, Systems Engineering & Integration, Technical Services, IT, Supply Chain Management, and other…
Added 1 day ago
Resource Specialist in Vancouver (French Services) (On Site)
CBC/Radio-Canada
Vancouver, BC
Full-time
We are seeking a Resource Specialist to join our team at the new Radio-Canada newsroom in Vancouver.
Added 1 day ago
Billing Administrator
PwC
Toronto, ON
Full-time
…practice staff and partner assistants to provide key financial management tasks critical to the firm’s financial performance. BAs are responsible for managing their partners’ financial…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job