Find work in Canada.

332,935 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 3 mins ago
Team Lead, AI Engineering
The Citco Group Limited
Halifax, NS
Full-time
You will lead a cross-functional AI engineering team responsible for designing, building and supporting secure, cloud-native and AI-enabled applications for financial services.
Added 3 mins ago
Senior AI Engineer
The Citco Group Limited
Halifax, NS
Full-time
…for the financial services industry. Using modern software engineering practices, AI-assisted development, and cross-functional collaboration, you will lead the design and delivery of…
Added 18 mins ago
Senior Software Developer
Mappedin
Waterloo, ON
Full-time
As a Senior Software Developer, you will lead the development and ongoing maintenance of products, driving both incremental enhancements and larger feature initiatives. You will work…
Added 18 mins ago
Performance Engineer - Open Source
Jobgether
Canada
Full-time
…applications, databases, and web technologies. As a performance engineering specialist, you will help teams measure complex systems, identify bottlenecks, strengthen testing capabilities,…
Added 18 mins ago
Director, Financial Planning & Analysis - SLC Management
Sun Life
Toronto, ON · Sun Life Toronto One York
Full-time
…continuous learning is expected, and there may be opportunities to lead and develop finance…
Added 18 mins ago
Director, Financial Planning & Analysis - SLC Management
SLC Management
Toronto, ON · Sun Life Toronto One York
Full-time
…continuous learning is expected, and there may be opportunities to lead and develop finance…
Added 48 mins ago
Director, Financial Planning & Analysis - SLC Management
SLC Management
Toronto, ON
Full-time
…continuous learning is expected, and there may be opportunities to lead and develop finance…
Added 1 hour ago
Senior Product Security Engineer
Jobgether
Canada
Full-time
Demonstrated ability to lead cross-functional security initiatives and collaborate with engineering, product, and compliance teams.
Added 1 hour ago
Project Management Centre of Excellence Lead
SE Health
Markham, ON
Full-time
The Project Management Centre of Excellence Lead is accountable for establishing and evolving SE Health’s enterprise project management practice and for leading the integrated Project…
Added 1 hour ago
Founding AI Engineering (Forward Deployed)
CGI
Toronto, ON
Full-time
We are looking for a Founding AI Engineering professional to help build this capability. This is a senior, hands-on role where you will build real AI products and help shape how they are…
Added 1 hour ago
Lead AI Engineering Specialist
CGI
Toronto, ON
Full-time
…after 50 years, we're still growing. We are building a new AI engineering capability within our Toronto Financial Services (TFS) business unit, serving organizations across Banking,…
Added 1 hour ago
Director AI Engineering
CGI
Toronto, ON
Full-time
We are looking for a Director, Consulting Services to build and lead this new capability. This is a people leadership role with accountability for the team, delivery, and client…
Added 1 hour ago
Physical Design Engineer
Advanced Micro Devices, Inc
Markham, ON
Full-time
Lead engineer driving PPA improvements for critical graphics blocks, and serves as main point of contact from Physical Design to RTL teams.
Added 1 hour ago
Full Stack Developer (PHP/JavaScript)
TMX Group
Vancouver, BC · Greater Vancouver Metropolitan Area
Full-time
This role reports to: Managing Director, Delivery Lead, Newsfile
Added 1 hour ago
Development Manager-Java Microservices
Raise
Toronto, ON
Full-time
As a Manager Technology, you will lead and manage Java Microservices-based engineering teams, ensuring the successful delivery of scalable, high-performance solutions. You will work closely…
Added 2 hours ago
Project Controls Lead
Fluor
Vancouver, BC
Full-time
Fluor is one of Canada's top employers and is recognized globally as a leader in the Engineering, Procurement, Construction, Fabrication, and Maintenance industry. Our focus on innovation…
Added 2 hours ago
Project Controls - Cost
Fluor
Vancouver, BC
Full-time
Fluor is one of Canada's top employers and is recognized globally as a leader in the Engineering, Procurement, Construction, Fabrication, and Maintenance industry. Our focus on innovation…
Added 2 hours ago
Lead Embedded Banking Program Information Technology (IT) Manager
HSBC
Toronto, ON
Full-time
This role sits at the intersection of strategy, engineering delivery, and operational readiness where outcomes are visible and measurable. You will help bring embedded banking capabilities…
Added 2 hours ago
Staff Verification Engineer, Compute Subsystems
Qualcomm
Markham, ON
Full-time
Engineering Group, Engineering Group > ASICS Engineering
Added 2 hours ago
Senior Consultant - GCP Cloud Infrastructure Architect
Deloitte
Toronto, ON
Full-time
Lead migrations from on-prem and other clouds - lift-and-shift on Compute Engine and GCVE, replatform to GKE and Cloud Run, refactor to managed services - with clear cost, risk, and cutover…
Added 2 hours ago
Senior Consultant - GCP Data & AI Architect
Deloitte
Toronto, ON
Full-time
Architect and lead delivery of modern data platforms on Google Cloud - data lakes, lakehouses, and warehouses built on BigQuery, Dataproc, Dataflow, Cloud Storage, and Pub/Sub.
Added 2 hours ago
Senior Consultant - GCP Agent Platform Architect
Deloitte
Toronto, ON
Full-time
Lead the end-to-end architecture: agent orchestration patterns (planner/executor, multi-agent hand-off, human-in-the-loop), tool and function calling, grounding on enterprise sources,…
Added 2 hours ago
Data Architect
Insight
Toronto, ON
Full-time
…leaders, designing architectural roadmaps, and partnering with engineering teams to deliver practical…
Added 2 hours ago
Senior Embedded Software Designer
Kepler Communications Inc.
Canada
Full-time
…we’re committed to creating an environment where you can grow, lead, and make a global…
Added 2 hours ago
Quality Engineer III
BlueRock Therapeutics
Toronto, ON
Full-time
Founded in 2016, BlueRock is at the forefront of the convergence of cell biology and genetic engineering. Our mission is to harness pluripotent stem cell technology and gene editing to…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job