Find work in Canada.

495,277 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 6 mins ago
TR
Privacy Operations Engineer
Thomson Reuters
Toronto, ON · Canada, Toronto, Ontario
- Full-time
Design and maintain automated routing of DSAR tasks with data-owner mapping across multiple systems, SLA tracking tied to statutory deadlines, and tiered escalation as deadlines approach.
Added 6 mins ago
ME
Staff Engineer
Midstate Electric Coop Inc
Engineer, BC
- Full-time
The Staff Engineer provides professional engineering support for the planning, design, construction, operation, and maintenance of electric transmission, distribution, and substation…
Added 6 mins ago
HE
Electrical Engineer
Heartland Engineering
Sherwood Park, AB
- Full-time
Role Description This is a full-time Electrical Engineer role based in Sherwood Park, AB. The Electrical Engineer will design and review electrical systems and components, including power…
Added 6 mins ago
HP
Senior Instrumentation & Controls Engineer
HOCS Projects
Calgary, AB
- Full-time
Control Systems: Lead the development and definition of control system architecture and specify and review applicable hardware and software configurations.
Added 6 mins ago
OB
Marketing Technology Lead Developer
O2E Brands
Toronto, ON · Greater Toronto Area, Canada
- Full-time
…technology ecosystem. Operating at the intersection of full-stack software engineering, digital marketing, and MarTech infrastructure, this individual will serve as the primary technical…
Added 51 mins ago
Q
Staff SoC Design Engineer
quadric
Remote, Canada
- Full-time
- Remote
Quadric is building a revolutionary new processor-based SoC architecture. As a Staff SoC Design Engineer, you will get in on the ground floor as a key member of our chip design team,…
Added 1 hour ago
AI Engineer, Data, AI and Analytics
WestJet Group
Calgary, AB
…technologies to speed the development and support of a wide variety of systems and technology stacks. They are comfortable delivering solutions ranging from lightweight business tools and…
Added 1 hour ago
CI
Quality Engineer – Integration & Automation -- KUMDC6055252
Compunnel Inc.
Toronto, ON
- $65 to $70 CAD / hour
- Contract
API / integration test automation (e.g., Postman, REST Assured, or equivalent)
Added 1 hour ago
PG
Full Stack Engineer
Pacer Group
Toronto, ON
- $55 to $58 CAD / hour
- Contract
8+ years professional software development experience building web applications and backend services.
Added 1 hour ago
AI
AI Evaluator/ Quality Engineer
Avanciers Inc.
Toronto, ON
- $100,000 to $110,000 CAD / year
- Full-time
Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.
Added 1 hour ago
J(
EMS Engineer/Software Developer
JSG (Johnson Service Group, Inc.)
Calgary, AB
- Full-time
Johnson Service Group (JSG) is currently looking for an EMS Engineer/Software Developer with experience in Energy Management Systems, software development, custom code management, system…
Added 1 hour ago
A
Senior SDET
Air-tek
Toronto, ON
- Full-time
We’re looking for a Senior Software Development Engineer in Test (SDET) to build and improve the infrastructure that makes reliable, scalable testing possible.
Added 1 hour ago
M
Business Systems Analyst
Manulife
Toronto, ON · Waterloo, ON
- Full-time
5+ years proven track record as a Business System, or Technical Analyst, or as a Quality or Software Engineer.
Added 1 hour ago
M
Associate Applied AI Engineer – GenAI Systems
Manulife
Toronto, ON
- Full-time
Strong Python and SQL, with solid software engineering fundamentals such as Git-based workflows, code reviews, unit and integration testing, logging, readable code structure, debugging, and…
Added 1 hour ago
AI
Forward Deployed Engineer (Python/Pyspark Developer)
Apptoza Inc.
Toronto, ON
- Contract
We are looking for a senior Forward Deployed Engineer who combines production-grade software engineering, data engineering, AI application development, and client-facing consulting. You…
Added 1 hour ago
Manufacturing Applications Engineer
ArcelorMittal
Hamilton, ON
We are seeking an experienced, outcomes-driven Manufacturing Applications Engineer to own and improve plant-critical manufacturing applications and Operational Technology (OT)-enabled…
Added 1 hour ago
1
Marketing Technology Lead Developer
1-800-GOT-JUNK?
Vancouver, BC · Toronto, ON
- Full-time
…technology ecosystem. Operating at the intersection of full-stack software engineering, digital marketing, and MarTech infrastructure, this individual will serve as the primary technical…
Added 2 hours ago
GC
HIL Commissioning Engineer
Global Connect Technologies
Windsor, ON
- Full-time
We are seeking an experienced HIL Commissioning Engineer to support automotive engineering projects for Stellantis through Cognizant. The ideal candidate will have hands-on experience with…
Added 2 hours ago
Junior Full stack Developer (Front End Focus)
Scotiabank
Toronto, ON
Technical understanding – as a standard Software Engineer there will be expectations that you are able to lead technical discussions, challenge design and strategy
Added 2 hours ago
Senior Crypto Engineer
Scotiabank
Toronto, ON
As a Senior Crypto Engineer, you will be a core member of the Engineering pillar, responsible for responsible for the design, building, and patterning of security solutions into…
Added 2 hours ago
GC
HIL Validation Engineer
Global Connect Technologies
Windsor, ON
- Full-time
Collaborate with cross-functional engineering teams to resolve hardware and software integration issues.
Added 2 hours ago
V
Senior Full Stack Engineer
Viamo
Remote, Canada
- $100,000 to $140,000 CAD / year
- Full-time
- Remote
Own what you ship - Take turns as the go-to engineer for production, digging into real-world issues across voice, SMS and AI, and help make our systems more observable, resilient and safe…
Added 2 hours ago
H
Senior Prototype Engineer
Humanoid
Burnaby, BC
- Full-time
We are looking for a Senior Prototype Engineer to drive the development, assembly, integration, and validation of advanced humanoid robotic systems, with a particular focus on robotic…
Added 3 hours ago
HS
Senior Java Software Engineer
Henry Schein One Canada
Surrey, BC
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 3 hours ago
CD
Mechatronics Engineer
Convergence Design Services
Arnprior, ON
- Full-time
As a Mechatronics Engineer, you will be responsible for designing, developing, and testing devices that combine electronics and mechanical systems. You will work on projects involving the…

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job