Find work in Canada.

347,347 jobs across our Canadian network. How we count

Jobs near Toronto, ON

25+ jobs

Within 25 km, plus remote jobs

Email me new jobs Save this search

Added 4 mins ago
AC
Cement finisher
ASHLAND CONSTRUCTION GROUP LTD
Concord, ON
- From $47.77 CAD / hour
- Full-time
- On-site
Added 6 mins ago
CB
Warehouse operations manager
Craft360 Beverages
Toronto, ON
- From $47.25 CAD / hour
- Full-time
- On-site
Added 6 mins ago
SR
Social media coordinator
Stage Right Home Furnishings Inc.
East York, ON
- From $37.5 CAD / hour
- Full-time
- On-site
Added 7 mins ago
A
New Graduate, Civil Engineering (2027)
AtkinsRéalis
Toronto, ON
- Full-time
Added 7 mins ago
R
Senior Principal DSX Data Scientist
Roche
Mississauga, ON
- Full-time
Added 7 mins ago
SC
shift supervisor - Store# 04817, LAKESHORE & LESLIE DRIVE-THRU
Starbucks Coffee Company
Toronto, ON
- Full-time
Added 7 mins ago
SC
Sales Associate
Staples Canada
Vaughan, ON
- Part-time
Added 8 mins ago
LL
Child caregiver - private home
Lauren Laskin Gluck and David Gluck
Toronto, ON
- From $20.85 CAD / hour
- Full-time
- On-site
Added 9 mins ago
PR
Built-up flat roofer
Proteck Roofing & Sheet Metal Inc.
Etobicoke, ON
- From $37 CAD / hour
- Full-time
Added 9 mins ago
G
Live-in caregiver
Griscti
Markham, ON
- From $21 CAD / hour
- Full-time
- On-site
Added 10 mins ago
P
Chef de partie
PARAMOUNT
Woodbridge, ON
- $36 to $38 CAD / hour
- Full-time
- On-site
Added 11 mins ago
P
Catering service manager
PARAMOUNT
Woodbridge, ON
- From $36 CAD / hour
- Full-time
- On-site
Added 15 mins ago
SH
Personal support worker – nursing care
Spectrum Health Care
Toronto, ON
- $22.26 to $23.56 CAD / hour
- Full-time
- On-site
Added 18 mins ago
CA
Sous-chef
Cantina Amici Inc.
Concord, ON
- From $37 CAD / hour
- Full-time
- On-site
Added 18 mins ago
HF
Supervisor, packaging - food and beverage processing
Halenda's Fine Foods Ltd
Etobicoke, ON
- From $37 CAD / hour
- Full-time
- On-site
Added 19 mins ago
KG
Office supervisor
KOLONAKI GROUP INC
Etobicoke, ON
- $36.25 to $40 CAD / hour
- Full-time
- On-site
Added 23 mins ago
VC
Financial analyst
Vision Capital Corporation
Toronto, ON
- From $87,500 CAD / year
- Full-time
- On-site
Added 27 mins ago
TP
Infrastructure architect - information technology (IT)
Titan power Ltd.
Markham, ON
- $65 to $68 CAD / hour
- Full-time
- On-site
Added 31 mins ago
RC
Occupational health and safety (OHS) consultant
RMG Consulting Group Inc.
Concord, ON
- From $80,000 CAD / year
- Full-time
- Hybrid
Added 33 mins ago
IT
Supervisor, food services
Indias Taste fine indian cusine and sweets
Markham, ON
- $37 to $38.5 CAD / hour
- Full-time
- On-site
Added 33 mins ago
AG
Conservator - museum
Art Gallery of Ontario
Toronto, ON
- $77,932 to $97,388 CAD / year
- Full-time
- On-site
Added 34 mins ago
TC
Cook
Trinity Common
Toronto, ON
- From $36.92 CAD / hour
- Full-time
- On-site
Added 37 mins ago
S
Manager, Global AP&P - Finance
Scotiabank
Toronto, ON
- Full-time
Added 37 mins ago
LT
CNC Optical Technician (Afternoon Shift) 1
L3Harris Technologies
Toronto, ON
- Full-time
Added 37 mins ago
FR
Condominium Manager
FirstService Residential Canada
Toronto, ON
- Full-time

Closed listing

Iris Software Inc.

AI Tester

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Contract

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Job type: Contract
Closing date: Nov 6, 2026
Experience: 2 - 3 years of Experience in AI Tester.
Posting language: English
Posted: Oct 7, 2026

Similar jobs hiring now

Search current openings

Original job description

Archived listing. The details below describe a past opening.

We have Immediate requirement with our Direct Client as AI Tester @ Toronto ON (Hybrid - 4 Days/Week). if you are interested, Please share your updated resume to nakka.prasad@irissoftware.com

Title: AI Tester

Location: Toronto ON (Hybrid - 3 Days/Week)

Description:

2 - 3 years of Experience in AI Tester.

GenAI test specialist to bring deep expertise in testing LLM-powered features. You'll own how we evaluate AI quality, working within the existing test frameworks and CI/CD pipelines rather than building them from scratch.

What You'll DoDefine the GenAI testing strategy and quality metrics (accuracy, groundedness, hallucination, safety)
Agentic AI Framework, swarm testing, Agent orchestration – Claude/Devin
Build LLM evaluation suites, including LLM-as-a-judge, and plug them into our existing automation framework
Create and maintain golden datasets and adversarial prompt sets
Test RAG pipelines for retrieval quality, context relevance, and answer faithfulness
Validate AI agents and tool-calling flows across multi-step scenarios
Lead red-teaming: prompt injection, jailbreaks, bias, toxicity, PII leakage
Track model and prompt regressions across releases and share findings with ML and product teams
Upskill the wider QA team on GenAI testing practices
What You Bring3+ years in software testing or QA automation, with working Python skills
Hands-on experience testing LLM or GenAI applications
Strong grasp of LLM concepts: prompts, embeddings, context windows, temperature, RAG
Experience with eval tools such as DeepEval, Ragas, Promptfoo, LangSmith, or TruLens
Comfort with API testing and working inside an existing CI/CD setup
Nice to HaveLangChain / LlamaIndex and vector database experience
Knowledge of OWASP Top 10 for LLM Applications or AI red-teaming
ISTQB CT-AI or similar certification

Satya Prasad Nakka

Iris Software

200 Metroplex Drive, Suite #300

Edison, NJ 08817

Mobile: 732-426-9380

www.irissoftware.com

About employer

More about this job

Responsibilities

Define GenAI testing strategies and quality metrics, build LLM evaluation suites, and maintain golden datasets and adversarial prompts within existing automation and CI/CD frameworks. Test RAG pipelines, AI agents, and tool-calling flows; lead red-teaming and regression tracking; and help upskill the QA team.

Requirements

The role requires 3 or more years in software testing or QA automation, working Python skills, and hands-on experience testing LLM or GenAI applications. Candidates should understand LLM concepts such as prompts, embeddings, context windows, temperature, and RAG, and have experience with evaluation tools, API testing, and existing CI/CD setups.

Skills

GenAI Testing
LLM Evaluation
Python
QA Automation
RAG Testing
API Testing
Prompt Engineering
Agentic AI
CI/CD
Red-Teaming
Test Strategy
Golden Datasets
Adversarial Testing
AI Safety
Regression Testing

Visa sponsorship

Not detected in the job text

Hiring contact

Satya Prasad Nakka

Hiring contact email

nakka.prasad@irissoftware.com

Keywords

GenAI
LLM
Python
DeepEval
Ragas
Promptfoo
LangSmith
TruLens
LangChain
LlamaIndex
Vector Databases
RAG
LLM-as-a-Judge
Agentic AI
Agent Orchestration
Claude
Devin
CI/CD
API Testing
Golden Datasets
Adversarial Prompts
Prompt Injection
Jailbreaking
AI Red-Teaming
OWASP Top 10 for LLM Applications
ISTQB CT-AI
Embeddings
Context Windows
Hallucination
Groundedness

Report this job