Find work in Canada.

332,825 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 7 mins ago
Customer Service Rep
Future Electronics
Canada
Full-time
…reject. Identify any opportunities for business improvement and automation and propose solutions. Provide support for sales on how to properly use the electronic NCNR. Act as a resource…
Added 7 mins ago
Customer Service Advocate
Future Electronics
Canada
Full-time
…reject. Identify any opportunities for business improvement and automation and propose solutions. Provide support for sales on how to properly use the electronic NCNR. Act as a resource…
Added 7 mins ago
AVEVA Enterprise SCADA Specialist
SGS
Vancouver, BC
$85,000 to $165,000 CAD / year
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…
Added 7 mins ago
Senior Credit Specialist
InSync Systems
Calgary, AB
Contract
We are looking for a Senior Credit Specialist for a 12-month contract position, in Calgary, Alberta, with possible extensions. Must be legally entitled to work in Canada.
Added 7 mins ago
DevSecOps Specialist
Systematix
Ottawa, ON
Contract
A minimum of 7 years of Quality Assurance (QA) experience developing scripts or automation solutions for application releases, environment management, and deployments.
Added 22 mins ago
OT Specialist - Intermediate/Senior
SGS
Calgary, AB
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…
Added 37 mins ago
Spécialiste aux encaissements / Cash Application Specialist
Fuze HR Solutions
Montreal, QC
$58,000 to $60,000 CAD / year
Full-time
A leading supply chain organization is currently looking for an Cash Application Specialist to join its finance team located in downtown Montreal.
Added 1 hour ago
OT Specialist - Intermediate/Senior
SGS
Calgary, AB
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…
Added 1 hour ago
Cyber Security Specialist
Apptoza Inc.
Calgary, AB
Contract
Proficiency in automation, scripting workflow optimization within Security Operations environments.
Added 1 hour ago
Controls Specialist
Carrier
Mississauga, ON
$56,500 to $106,500 CAD / year
Full-time
At Automated Logic, we've been developing and supporting intelligent building solutions that have helped customers, including small businesses to Fortune 500 corporations, operate their…
Added 1 hour ago
Business Advisor
City of Saint John
Saint John, NB
Full-time
The position serves as backup to the Customer Service Manager and provides leadership to the Customer Experience Specialist.
Added 1 hour ago
Data Analyst-Python
LTM
Mississauga, ON
$103,554 to $115,200 CAD / year
Full-time
LTM is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by…
Added 1 hour ago
B2B Growth Marketing Specialist
XTRACT ONE
Toronto, ON
Full-time
Xtract One is a technology company dedicated to making the world safer through intelligent, frictionless security solutions. We design and deliver advanced threat detection screening…
Added 1 hour ago
IT Infrastructure and Security Specialist
Six Nations Polytechnic
Brantford, ON
Full-time
Under the direction and supervision of the Director, Information Services, the IT Infrastructure & Security Specialist is responsible for the implementation, administration, maintenance,…
Added 2 hours ago
B2B Growth Marketing Specialist
Xtract One Technologies
Toronto, ON
Full-time
Xtract One is a technology company dedicated to making the world safer through intelligent, frictionless security solutions. We design and deliver advanced threat detection screening…
Added 2 hours ago
Master Data & Operations Specialist
Fresenius Kabi Canada
Toronto, ON
Full-time
We are currently seeking a full-time Master Data & Operations Specialist to join our team!
Added 2 hours ago
Senior Mainframe Performance and Capacity Specialist
BMO
Toronto, ON · SCC
Full-time
…skilled Senior Mainframe Performance & Capacity Management Specialist to play a critical role in ensuring the performance, reliability, and scalability of our enterprise mainframe…
Added 2 hours ago
Finance Manager
STAN AI
Toronto, ON
$105,000 to $130,000 USD / year
Full-time
<p>STAN is the largest provider of AI solutions for HOA and Condo Property Managers. We're using cutting-edge, patented AI technology to build solutions that enhance life for residents…
Added 2 hours ago
Spécialiste en automatisation manufacturière / Manufacturing Automation Specialist
RTX
Longueuil, QC
Full-time
…programmation, de la mise en œuvre et de la validation des solutions d'automatisation intelligente. Si vous êtes un professionnel passionné avec une connaissance approfondie de la…
Added 2 hours ago
Production Specialist, Communication
''
Toronto, ON
Full-time
Position Title: Production Specialist, Communication
Added 2 hours ago
AVEVA Enterprise SCADA Specialist
SGS
Regina, SK
$85,000 to $165,000 CAD / year
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…
Added 2 hours ago
AVEVA Enterprise SCADA Specialist
SGS
AB · Edmonton, AB
$85,000 to $165,000 CAD / year
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…
Added 2 hours ago
Finance Manager
STAN AI
Toronto, ON · North York, ON
$105,000 to $130,000 USD / year
Full-time
STAN is the largest provider of AI solutions for HOA and Condo Property Managers. We're using cutting-edge, patented AI technology to build solutions that enhance life for residents of more…
Added 3 hours ago
Senior Financial Analyst
STAN AI
Toronto, ON
$90,000 to $105,000 USD / year
Full-time
<p>STAN is the largest provider of AI solutions for HOA and Condo Property Managers. We're using cutting-edge, patented AI technology to build solutions that enhance life for residents…
Added 3 hours ago
AVEVA Enterprise SCADA Specialist
SGS
Calgary, AB
$85,000 to $165,000 CAD / year
Full-time
Streamline Control Solutions, part of SGS - the world’s leading testing, inspection, and certification company operating across 115 countries - is a leading operational technology solutions…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job