Find work in Canada.

331,066 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 10 mins ago
AVEVA Enterprise SCADA Specialist
SGS
Calgary, AB
$85,000 to $165,000 CAD / year
Full-time
…client engagements from day one, supported by a structured technical pathway that develops you toward Intermediate and Senior Specialist responsibilities. This role sits alongside our…
Added 10 mins ago
Health & Safety Specialist administrator
Flatiron Construction Corp
Edmonton, AB
Other
…in preventing accidents and injuries? As a Health and Safety Specialist, you will inspect, evaluate, train and provide technical support for work crews to ensure compliance with Health and…
Added 10 mins ago
Canada Leader, Specialist Solution Architects | Chef du Canada, Architectes de solutions spécialisés
Amazon
Vancouver, BC · Toronto, ON · Montreal, QC
AWS is looking for an accomplished technical leader with experience across product, architecture, and technology who has worked with large Enterprises and high-growth organizations. In this…
Added 25 mins ago
Engineering Field Specialist
Aviva Canada
Markham, ON
Full-time
We have an excellent career opportunity for an Engineering Field Specialist supporting the GTA region. Reporting to the Engineering Supervisor, you will conduct equipment and jurisdictional…
Added 25 mins ago
CAD Specialist
Green Infrastructure Partners
St. John's, NL
Full-time
As a CAD Specialist, you will provide drafting, design, and quantity-takeoff support for heavy civil projects. Working closely with engineers, project managers, estimators, and field teams,…
Added 25 mins ago
Inventory Analyst
BGIS
Calgary, AB
Full-time
…data issues, and communicates clear findings to business and technical stakeholders. The analyst also identifies trends, control gaps, and opportunities to improve processes, reporting, and…
Added 25 mins ago
Technical Project Manager – Building Automation Systems (BAS) - Calgary, AB
Siemens
Calgary, AB
Full-time
Are you a Building Automation specialist with deep expertise in BAS programming, commissioning, and controls who is ready to lead larger projects? We are looking for a Technical Project…
Added 25 mins ago
Communication Specialist – Indirect Tax
Kingston Ross Pasnak LLP
AB · Edmonton, AB
Full-time
…various tax authorities during audits and examinations, writing technical memoranda for complex taxation issues, reviewing plans for mergers, acquisitions and reorganizations for tax…
Added 25 mins ago
Electrical Project Designer / Project Engineer
Smith + Andersen
Toronto, ON
$85,000 to $125,000 CAD / year
Full-time
…position offers ownership of discipline design and day-to-day technical delivery, close collaboration within integrated project teams, and exposure to projects from design through…
Added 26 mins ago
Tailings Research & Reporting Specialist
Canadian Natural
Calgary, AB
Make your mark while you grow your career! We are looking for a Geochemist or Biochemist that will provide technical expertise to support tailings and closure planning activities and…
Added 26 mins ago
Associate Service Operations Specialist | Spécialiste associé(e) des Opérations de services.
SITA Switzerland Sarl
Montreal, QC
Full-time
…and customer satisfaction by delivering reliable, first-class technical support. You will maintain high service availability through properly configured and maintained systems, while…
Added 26 mins ago
Senior National Technical Support & Industrial Print Specialist/Spécialiste principal national du support technique et de l'impression industrielle (Montreal/GTA))
Konica Minolta Business Solutions (Canada) Ltd.
Montreal, QC
Full-time
Provide advanced national-level technical leadership for industrial print systems, serving as a senior technical authority and escalation owner across customers, dealers, and branch service…
Added 26 mins ago
Bilingual Automotive Sales Specialist - Training and Implementation
PBS Systems
Calgary, AB
Added 26 mins ago
Digital Delivery Coordinator
PACT
ON · Mississauga, Ontario
…works under the guidance of the Digital Delivery Manager and Specialist to ensure model updates, drawing extractions, and clash management support day-to-day construction activities. This…
Added 26 mins ago
Commercial Underwriting Specialist - Auto & Property
TD
Markham, ON
Full-time
Contribute to the design, implementation, and delivery of technical underwriting training and development initiatives.
Added 26 mins ago
Communication Specialist, Indirect Tax
KINGSTON ROSS PASNAK LLP
Edmonton, AB
Full-time
…various tax authorities during audits and examinations, writing technical memoranda for complex taxation issues, reviewing plans for mergers, acquisitions and reorganizations for tax…
Added 26 mins ago
Indirect Tax Associate, Intermediate
KINGSTON ROSS PASNAK LLP
Edmonton, AB
Full-time
…various tax authorities during audits and examinations, writing technical memoranda for complex taxation issues, reviewing plans for mergers, acquisitions and reorganizations for tax…
Added 41 mins ago
Procurement Project Specialist
Voyageur Aviation
North Bay, ON
Full-time
The Procurement Project Specialist will report to the Procurement Manager and will support company-obligated projects by coordinating the sourcing, reporting, purchasing, repairing and…
Added 55 mins ago
2627-188 - Student Accessibility Specialist (PS4) - Burridge Campus
Jobbe
Yarmouth Indian Reserve No. 33, NS · Yarmouth, NS
Temporary
You have specific technical occupational knowledge and skill in assistive technology and developing accommodation plans.
Added 55 mins ago
Apprentice Journeyperson Automotive Service Technician
Jobbe
NS · Nova Scotia, Canada
$19.95 CAD / hour
Temporary
Receive hands-on training and mentorship from experienced technicians to develop your technical skills.
Added 55 mins ago
Delivery Director
Two Circles
Vancouver, BC
Full-time
…scaled, we want dedicated, senior ownership of delivery so that specialist talent across the region is deployed where it adds the most value, and so delivery has a clear, accountable leader…
Added 56 mins ago
Counsel, Intellectual Property
WSP
Montreal, QC
…secrets and know-how, and help coordinate external counsel where specialist input is…
Added 56 mins ago
Clinical Informatics Nurse Specialist
HealthCareersInSask.ca
North Battleford, SK
Part-time
Job Description: Under the direction of the Manager, Digital Health, The Clinical Informatics Nurse Specialist leads the integration of information technologies & clinical change…
Added 56 mins ago
Senior Engineering Specialist
Ford Motor Company
Windsor, ON
Full-time
Highly effective written and oral communication skills are essential to collaborate successfully and present technical findings across multidisciplinary teams.
Added 56 mins ago
Corporate Health, Safety & Environmental Leader
IKO North America
Calgary, AB
Full-time
…North America. The Corporate Health, Safety & Environmental Specialist is primarily responsible for the consistent implementation, management and monitoring of all corporate health, safety,…

Iris Software Inc.

GenAI Tester

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 25, 2026
Posting language: English
Posted: Sep 25, 2026

Apply About employer

Applications open in a new tab.

Original job description

Iris's client, one of the Top 5 Bank in Canada is looking to hire an GenAI Tester for a long-term contract opportunity.

Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization. The bank serves over 17 million clients and has more than 89,000 employees worldwide. Bank is serving individual consumers, small and middle market businesses and large corporations with a full range of banking, investing, asset management and other financial and risk-management products and services.

Position: GenAI Tester

Location: Toronto, ON (Hybrid - 4 Day onsite/week)

Duration: Long-Term Open-Ended Contract

Must have:

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll Do

Define the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety).
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin.
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework.
Create and maintain golden datasets and adversarial prompt sets.
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness.
Validate AI agents and tool-calling flows across multi-step scenarios.
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage.
Track model and prompt regressions across releases and share findings with ML and product teams.
Upskill the wider QA team on GenAI testing practices.

What You Bring

3+ years in software testing or QA automation, with working Python skills.
Hands-on experience testing LLM or GenAI applications.
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG.
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens.
Comfort with API testing and working inside an existing CI/CD setup.

Nice to Have

LangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.

Apply About employer

More about this job

Responsibilities

Define GenAI testing strategy and quality metrics, build LLM evaluation suites, and integrate them into existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling scenarios; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

Requires at least three years of software testing or QA automation experience, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand core LLM concepts and have experience with evaluation tools, API testing, and existing CI/CD setups; LangChain, vector databases, AI security knowledge, and relevant certification are advantageous.

Skills

GenAI Testing
Software Testing
QA Automation
Python
LLM Evaluation
Prompt Engineering
RAG Testing
API Testing
CI/CD
Red Teaming
Agentic AI
Test Strategy
Golden Dataset Creation
Adversarial Testing
LangChain
Vector Databases

Visa sponsorship

Not detected in the job text

Keywords

GenAI
LLM
Python
QA Automation
Software Testing
LLM Evaluation
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
RAG
Embeddings
Prompt Engineering
API Testing
CI/CD
Agentic AI
Agent Orchestration
Claude
Devin
Golden Datasets
Adversarial Prompts
Red Teaming
Prompt Injection
Jailbreaks
OWASP Top 10 for LLM Applications
LangChain
LlamaIndex
Vector Databases
ISTQB CT-AI

Report this job