Find work in Canada.

496,255 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 2 mins ago
E
Ingénieur (e) produit qualité aprés vente / Product Compliance Engineer
Expleo
Valcourt, QC
- Contract
EXPLEO GROUP CANADA is looking for a Product Compliance Engineer to join our team in Valcourt, QC.
Added 2 mins ago
D
Principal Software Engineer, Docker Hardened Images
Docker
Remote, Canada
- Full-time
- Remote
…security-conscious environments. We're looking for a Principal Software Engineer to set the long-term technical direction for this catalogue and shape how the broader container security…
Added 16 mins ago
PL
Senior Mine Engineer/Planner - PL#27347
Peter Lucas
Vancouver, BC
- Full-time
…delivery. We are currently looking for an experienced Senior Mine Engineer / Planner to join our…
Added 16 mins ago
WI
Senior Electrical Engineer - Buildings
WSP in Canada
Markham, ON
- Full-time
Lead the design and development of electrical systems for complex building projects.
Added 16 mins ago
WI
Senior Electrical Engineer
WSP in Canada
Markham, ON
- Full-time
Join our Buildings M&E team as a Senior Electrical Engineer and help shape electrical solutions for diverse projects across Canada. Based in Thornhill/Markham (GTA), you’ll bring…
Added 16 mins ago
WI
Senior Mechanical Engineer, Buildings
WSP in Canada
Markham, ON
- Full-time
Design mechanical building systems, preparing drawings and specifications for HVAC, plumbing, drainage, and fire protection using Revit and AutoCAD.
Added 16 mins ago
TT
Intermediate Mechanical Engineer
Tetra Tech
Thunder Bay, ON
- Full-time
Tetra Tech is adding a Intermediate Mechanical Engineer to our Mechanical team based in Thunder Bay, ON . This is a new vacant position for which we are actively recruiting.
Added 16 mins ago
S
Staff Software Engineer, Payments Intelligence
Stripe
Toronto, ON
- Full-time
As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner. Experience with large,…
Added 16 mins ago
D
Power & Recovery Supervisor
Domtar
Port Mellon, BC
- Full-time
Must hold a valid Second Class Power Engineer Certificate of Competency or higher.
Added 16 mins ago
TT
Junior Electrical Engineer (EIT)
Tetra Tech
Vancouver, BC
- Full-time
Tetra Tech is adding an Electrical Engineer-in-Training (EIT) to our Electrical team based in Vancouver, BC .
Added 16 mins ago
ST
Project Engineer/Integration Focal
SEGULA Technologies
Montreal, QC
- Full-time
Special Mission Knowledge: Technical knowledge of aircraft, aircraft systems, and special mission equipment is preferred.
Added 16 mins ago
GG
Electrical Engineer
Giampaolo Group Inc.
Brampton, ON
- Full-time
Reporting to the Senior Director, Engineering and Maintenance, the Electrical Engineer will provide support across a variety of functional groups by providing innovative solutions that…
Added 16 mins ago
ST
Structures and Systems Installation Integrator
SEGULA Technologies
Montreal, QC
- Full-time
We are seeking an experienced Senior Lead Engineer – Integrated Structural & Systems Installation Design to lead complex, multi-zone aircraft design and physical integration activities. In…
Added 16 mins ago
MC
EMS Engineer
MatchBox Consulting Group
Calgary, AB
- Full-time
MatchBox Consulting Group is currently seeking an EMS Engineer for a permanent role with a client of ours located in Calgary.
Added 16 mins ago
WI
Intermediate Electrical Engineer - Buildings
WSP in Canada
Markham, ON
- Full-time
Design and develop electrical systems for a variety of building projects.
Added 16 mins ago
Engineering - Automotive HVAC Product Engineer
Crestline
Saskatoon, SK
We’re looking for an Automotive HVAC Product Engineer to join our Engineering team in Saskatoon. This role will serve as Crestline’s subject-matter specialist for automotive HVAC systems…
Added 16 mins ago
BE
Transformer Engineer
Boundary Electric
Grand Forks, BC
- Full-time
Job Summary: The Transformer Engineer serves as a key technical resource supporting the sales, design, development, testing, and maintenance of transformers. This includes distribution…
Added 31 mins ago
PL
Senior Mine Engineer/Planner - PL#27347
Peter Lucas
Kelowna, BC
- Full-time
…delivery. We are currently looking for an experienced Senior Mine Engineer / Planner to join our…
Added 31 mins ago
GI
Algorithm Software Engineer
Garmin International, Inc.
Cochrane, AB
- Full-time
…have a hunger for solving real-world problems with embedded systems. Exciting things happen at the boundaries between disciplines. Where data science and engineering meet, you will be…
Added 46 mins ago
WI
Senior Electrical Engineer
WSP in Canada
Vaughan, ON
- Full-time
Join our Buildings M&E team as a Senior Electrical Engineer and help shape electrical solutions for diverse projects across Canada. Based in Thornhill/Markham (GTA), you’ll bring…
Added 46 mins ago
WI
Senior Electrical Engineer - Buildings
WSP in Canada
Vaughan, ON
- Full-time
Lead the design and development of electrical systems for complex building projects.
Added 46 mins ago
NC
Specialist Tailings
Newmont Corporation
Dease Lake 9, BC
- $113,600 to $151,500 CAD / year
- Full-time
Reporting to the Superintendent, Tailings (the Red Chris Responsible Tailings Facility Engineer, or RTFE), you will serve as Deputy RTFE and work closely with the RTFE, site teams, and…
Added 46 mins ago
WI
Senior Mechanical Engineer, Buildings
WSP in Canada
Vaughan, ON
- Full-time
Design mechanical building systems, preparing drawings and specifications for HVAC, plumbing, drainage, and fire protection using Revit and AutoCAD.
Added 46 mins ago
RT
Senior Engineer – Electrical Systems Integration
Rang Technologies Inc
Toronto, ON
- $50 to $55 CAD / hour
- Contract
Title: Senior Engineer – Electrical Systems Integration
Added 46 mins ago
AI
Forward Deployed Engineer (Python/Pyspark Developer)
Apptoza Inc.
Toronto, ON
- Full-time
Role: Forward Deployed Engineer (Python/Pyspark Developer)

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job