Find work in Canada.

495,277 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 7 mins ago
TI
Software Engineer
Trimble Inc.
Kamloops, BC · Canada - Kamloops, BC
- Full-time
Proven track record designing distributed systems, cloud architectures, secure authentication models, and automated test pipelines.
Added 52 mins ago
RL
Sensor Engineer / Senior Sensor Engineer
RBR Ltd.
Ottawa, ON
- $75,000 to $115,000 CAD / year
- Full-time
As a Sensor Engineer at RBR, you will specify, develop, and bring to life the sensor technology that measures the ocean environment. Working hands-on alongside specialists in firmware,…
Added 53 mins ago
S
Mechanical Design Engineer
SMARTFOX
ON · Ontario, Canada
- $80,000 to $120,000 CAD / year
- Full-time
Design mechanical components, assemblies, and systems from concept through detailed design, prototyping, testing, and release to production
Added 1 hour ago
AI Engineer, Data, AI and Analytics
WestJet Group
Calgary, AB
…technologies to speed the development and support of a wide variety of systems and technology stacks. They are comfortable delivering solutions ranging from lightweight business tools and…
Added 1 hour ago
CI
Quality Engineer – Integration & Automation -- KUMDC6055252
Compunnel Inc.
Toronto, ON
- $65 to $70 CAD / hour
- Contract
API / integration test automation (e.g., Postman, REST Assured, or equivalent)
Added 1 hour ago
S
Environmental Engineer
SMARTFOX
ON · Ontario, Canada
- $60,000 to $100,000 CAD / year
- Full-time
Design and evaluate water and wastewater treatment systems, stormwater management, and erosion and sediment control
Added 1 hour ago
AI
AI Evaluator/ Quality Engineer
Avanciers Inc.
Toronto, ON
- $100,000 to $110,000 CAD / year
- Full-time
Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.
Added 1 hour ago
A
Senior SDET
Air-tek
Toronto, ON
- Full-time
We’re looking for a Senior Software Development Engineer in Test (SDET) to build and improve the infrastructure that makes reliable, scalable testing possible.
Added 1 hour ago
M
Business Systems Analyst
Manulife
Toronto, ON · Waterloo, ON
- Full-time
We are looking for a Business Systems Analyst who enjoys connecting business needs with technology solutions. You will work across product, engineering, architecture, quality engineering,…
Added 1 hour ago
A
Senior Document Controller
Arcadis
Vancouver, BC
- Full-time
…which RFIs, technical queries, shop drawings, Inspection and Test Plans, method statements, material submissions, site instructions and other contractor deliverables require accurate…
Added 1 hour ago
VT
EMC Engineer
Veridian Tech Solutions, Inc.
Quebec, QC
- Contract
…approaches. Review associated engineering documentation such as test procedures, test reports and analysis reports. Verify compliance with certification regulations and recommend for…
Added 2 hours ago
B
Windows System Engineer - Endpoint /SCCM
BeachHead
Toronto, ON
- $61.59 to $73.91 CAD / hour
- Contract
Working with one of our top financial clients, this role calls for a Windows System Engineer - Endpoint /SCCM. In this position, you will be responsible for managing device compliance,…
Added 2 hours ago
GC
HIL Commissioning Engineer
Global Connect Technologies
Windsor, ON
- Full-time
We are seeking an experienced HIL Commissioning Engineer to support automotive engineering projects for Stellantis through Cognizant. The ideal candidate will have hands-on experience with…
Added 2 hours ago
WC
Ingénieur en test et conception mécanique / Test & Mechanical Engineer
Wabtec Corporation
Montreal, QC
- Full-time
L’équipe Actuateurs de portes, périphériques et test se spécialise dans la conception, l’adaptation, le prototypage, les tests et la validation de produits électromécaniques complexes; pour…
Added 2 hours ago
M
Staff Software Engineer, AI
Maple
Toronto, ON
- Full-time
We’re looking for a Staff Software Engineer, AI to own and ship the next generation of AI-powered healthcare experiences at Maple.
Added 2 hours ago
GC
HIL Validation Engineer
Global Connect Technologies
Windsor, ON
- Full-time
Set up and maintain HIL test environments for automotive control systems.
Added 2 hours ago
SA
Manufacturing and Production Engineer
Skymark Aerospace
Mississauga, ON
- Full-time
We are seeking a Manufacturing and Production Engineer to develop the processes, tooling, and documentation needed to build UAV hardware consistently. You will work with design engineers,…
Added 2 hours ago
H
Senior Prototype Engineer
Humanoid
Burnaby, BC
- Full-time
We are looking for a Senior Prototype Engineer to drive the development, assembly, integration, and validation of advanced humanoid robotic systems, with a particular focus on robotic…
Added 3 hours ago
HS
Senior Java Software Engineer
Henry Schein One Canada
Surrey, BC
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 3 hours ago
FT
Power Electronics Engineer
Foreseeson Technology
Richmond, BC
- Contract
Collaborate with the Senior Electrical Engineer and Embedded Systems Engineer to define converter interfaces, control signals, telemetry, and fault-handling requirements.
Added 3 hours ago
A
Electrical Systems Integration
Aumnitech
Montreal, QC · Greater Montreal, QC
- Full-time
We are seeking an experienced Professional Engineer – Electrical Systems Integration to support prime aerospace platform development in the Greater Montreal area. In this role, you will be…
Added 3 hours ago
FT
Embedded Systems Engineer
Foreseeson Technology
Richmond, BC
- Contract
The Embedded Systems Engineer will develop the firmware and embedded software that enables communication, control, monitoring, and coordination across the ESS. This role will work closely…
Added 3 hours ago
Aircraft Maintenance Engineer - YVR
WestJet Group
Vancouver, BC
Looking for the ideal aviation career? Join our highly skilled team as an Aircraft Maintenance Engineer and contribute to the safe and efficient daily maintenance on our fleet of aircraft-…
Added 3 hours ago
C
Sr. Database Automation Engineer
CIBC
Toronto, ON
- Full-time
You’re experienced in infrastructure operations. You have demonstrated experience supporting Linux and Windows systems, automation services, and database platforms such as Oracle and SQL,…
Added 3 hours ago
CI
Principal Architect
Camis Inc
Guelph, ON
- Full-time
We are committed to building software that stands the test of time, and we're looking for a Principal Architect to define the technical direction of our Parks & Recreation platform.

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job