Find work in Canada.

498,159 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 28 mins ago
T
Engineer II
TD
Toronto, ON
- Full-time
Execute on Engineering strategy as it relates to the introduction of tools and the automation of build, test, release and configure activities across Application, Platform and Infrastructure
Added 42 mins ago
Q
Verification Engineer, Senior
Qualcomm
Toronto, ON
- Full-time
…create a smarter, connected future for all. As a Qualcomm ASIC Engineer, you will define, model, design (digital and/or analog), optimize, verify, validate, implement, and document IP…
Added 1 hour ago
GC
Rust Backend Architect - AI Training Projects
Gramian Consulting Group
Remote, Canada
- Contract
- Remote
Prepare Rust crate workspaces, configuration files, test fixtures, dependency services, databases, and containerized development environments.
Added 2 hours ago
T
Engineer I
TD
Toronto, ON
- Full-time
Execute on Engineering strategy as it relates to the introduction of tools and the automation of build, test, release and configure activities across Application, Platform and Infrastructure
Added 2 hours ago
Three (3) Engineers
Toronto Hydro
Toronto, ON
Role Title: Engineer (Standards - Underground) & Engineer (Standards - Overhead)
Added 3 hours ago
A
Software Development Engineer In Test
Actalent
Ottawa, ON
- $45 to $65 CAD / hour
- Contract
Job Title: Software Development Engineer in Test (Python)
Added 3 hours ago
EC
Senior Automation Professional
EnGlobe Corp.
Saskatoon, SK
- Full-time
We are currently recruiting for the position of Senior Automation Professional for our Saskatoon Office.
Added 4 hours ago
Forward Deployed AI Engineer Sr - Analytics
Dayforce
Canada
We are looking for a Senior Forward Deployed AI Engineer, Analytics to partner directly with analytics teams and business stakeholders to turn high-value analytical problems into practical,…
Added 4 hours ago
TI
Software Engineer
Trimble Inc.
Kamloops, BC · Canada - Kamloops, BC
- Full-time
Accelerate the Future of AI-Driven Engineering as our next AI Agentic Software Engineer (P3)
Added 4 hours ago
ZS
Chatbot Developer
Zodiac Solutions, Inc
Toronto, ON
- Full-time
Job TitleQuality Engineer (QE) / SDET – AI Chatbot ValidationKey Roles & Responsibilities• Validate chatbot responses for accuracy, relevance, completeness, and consistency.• Create and…
Added 5 hours ago
AI Engineer, Data, AI and Analytics
WestJet Group
Calgary, AB
Added 5 hours ago
CI
Quality Engineer – Integration & Automation -- KUMDC6055252
Compunnel Inc.
Toronto, ON
- $65 to $70 CAD / hour
- Contract
API / integration test automation (e.g., Postman, REST Assured, or equivalent)
Added 5 hours ago
AI
AI Evaluator/ Quality Engineer
Avanciers Inc.
Toronto, ON
- $100,000 to $110,000 CAD / year
- Full-time
test automation, API and integration testing, prompt and response test-set design,
Added 5 hours ago
A
Senior SDET
Air-tek
Toronto, ON
- Full-time
Significant hands-on experience as an SDET, quality engineer, or software engineer working on test infrastructure and automation, with demonstrated senior-level ownership.
Added 5 hours ago
H
Software Engineer in Test with Xcode, XCTest, and XCUITest/XCUI
HCLTech
Vancouver, BC
- $80,000 to $90,000 CAD / year
- Full-time
SDET/Automation – Mobility (iOS Application Testing)
Added 6 hours ago
B
Windows System Engineer - Endpoint /SCCM
BeachHead
Toronto, ON
- $61.59 to $73.91 CAD / hour
- Contract
Working with one of our top financial clients, this role calls for a Windows System Engineer - Endpoint /SCCM. In this position, you will be responsible for managing device compliance,…
Added 6 hours ago
GC
HIL Commissioning Engineer
Global Connect Technologies
Windsor, ON
- Full-time
Support test automation, regression testing, and validation reporting.
Added 6 hours ago
GC
HIL Validation Engineer
Global Connect Technologies
Windsor, ON
- Full-time
Support test automation, regression testing, and validation reporting.
Added 6 hours ago
H
Senior Prototype Engineer
Humanoid
Burnaby, BC
- Full-time
We are looking for a Senior Prototype Engineer to drive the development, assembly, integration, and validation of advanced humanoid robotic systems, with a particular focus on robotic…
Added 7 hours ago
C
Sr. Database Automation Engineer
CIBC
Toronto, ON
- Full-time
You’ll be joining a technology team focused on automation engineering and infrastructure operations, helping to deliver reliable, scalable, and secure platforms that support critical…
Added 7 hours ago
G
Senior Quality Assurance Automation Engineer
GryphTech
Mississauga, ON
- Full-time
Web Applications & AI-Assisted Test Automation
Added 7 hours ago
M
RQ11740 - DevOPS/Cloud Engineer - Senior
Maarut
Toronto, ON
- Contract
Leads the automation, configuration, deployment, monitoring,
Added 8 hours ago
Q
Senior Test Automation Engineer (French)
Quantiphi
Canada
- Full-time
We are looking for a Test Automation/QA Engineer to support a Contact Center as a Service (CCaaS) deployment, validating that DTMF IVR menus, call routing, and queue/skillset configurations…
Added 9 hours ago
B
Windows System Engineer - Endpoint /SCCM
BeachHead
Toronto, ON
- $61.59 to $73.91 CAD / hour
- Contract
Working with one of our top financial clients, this role calls for a Windows System Engineer - Endpoint /SCCM. In this position, you will be responsible for managing device compliance,…
Added 9 hours ago
FN
Software Test Engineer II
First National Financial LP
Toronto, ON · East York, ON
- Contract
The IT Software Test Engineer II role will report directly to the Manager and Team Lead, IT Quality Assurance. The IT Software Test Engineer II role is responsible for building robust,…

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job