Find work in Canada.

500,312 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 10 mins ago
Security Developer, Anti-Abuse
Google
Waterloo, ON
Added 40 mins ago
JI
IT Business Analyst, Halifax
J.D. Irving, Limited
Dartmouth, NS
- Full-time
Understanding capability of analytics tools and enabling business to act from analytical insight
Added 54 mins ago
RI
Senior Full-Stack Java Developer (Front-Office / Capital Markets)
Rose International
Mississauga, ON
- Full-time
Python-based data science or quantitative tooling, including Jupyter and scikit-learn, for analytics, pricing, or risk use cases.
Added 54 mins ago
IF
Senior Process Journey Owner
iA Financial Group
Toronto, ON · Montreal, QC
- Full-time
…research, journey mapping, customer-listening initiatives, journey analytics, market intelligence, and performance…
Added 1 hour ago
U
Quality Assurance Support Officer
Unitywater
Sunshine Coast, BC
- Contract
Added 1 hour ago
HT
VP, Accounting & Controllership (Husky)
Husky Technologies
Bolton, ON
- Full-time
Leveraging technology, ERP capabilities, analytics, and automation to improve productivity and decision support across Finance.
Added 1 hour ago
AC
Regulatory Reporting Analyst
Aston Carter
Montreal, QC
- $30 to $33 CAD / hour
- Contract
Added 1 hour ago
OT
Sr Cloud Applications Administrator
Open Text Corporation
Mississauga, ON · Richmond Hill, ON · Waterloo, ON
- Other
Added 1 hour ago
C
Site Reliability Engineer - Application Security
ContactMonkey
Toronto, ON
- $130,000 to $150,000 CAD / year
- Full-time
Added 1 hour ago
BT
IT & Innovation Consultant, SR&ED
Baker Tilly Canada
Windsor, ON
- Full-time
Degree or diploma in computer science, software engineering, information systems, computer engineering, data analytics, or a related technology discipline.
Added 2 hours ago
T
Test Engineer – MDM & Data Quality
Teqfocus
Toronto, ON
- Full-time
Added 2 hours ago
HN
Intermediate Accountant
Hörmann North America
Canada
- Full-time
Added 3 hours ago
Senior Software Developer, Eye Tracking Algorithms
Google
Waterloo, ON
Added 3 hours ago
HB
Data Engineer - Up to $200k CAD + Bonus
Hunter Bond
Montreal, QC
- Full-time
…builds scalable, data-driven platforms that support advanced analytics and AI-powered applications across industries including fintech, healthcare, and digital…
Added 3 hours ago
B
Tech Lead - Application Development N 4C
BrightClaim
Montreal, QC
- Full-time
Added 4 hours ago
A
Channel Specialist
ABB
Milton, ON
- Full-time
· Proficiency with business analytics tools, Microsoft Excel, and CRM platforms such as Salesforce; fluency in English is required, and additional languages are an asset.
Added 4 hours ago
'
Sr. Financial Analyst, Global Finance Operations
''
Toronto, ON
- Full-time
Added 4 hours ago
QA
Finance Specialist
QuickHyre AI
Remote, Canada
- $70,000 to $80,000 USD / year
- Contract
- Remote
Added 5 hours ago
C
GTM Engineer
Chatbase
Toronto, ON
- $110,000 to $160,000 CAD / year
- Full-time
Added 6 hours ago
SM
Manager, Finance, Performance & Analytics
Stevenson Memorial Hospital
Alliston, ON
- Full-time
Reporting to the Vice President, Corporate Services & Chief Financial Officer, the Manager, Finance, Performance and Analytics supports the hospital's strategic objectives, performance…
Added 6 hours ago
CO
Manager, Digital Solutions
City of Saint John
Saint John, NB
- Full-time
…integration solution development, project execution, reporting and analytics, and information management practices. The role serves as a key liaison between Information Technology and…
Added 6 hours ago
GC
Algorithm Software Engineer
Garmin Canada
Cochrane, AB
- Full-time
Added 6 hours ago
HT
VP, Accounting & Controllership (Husky)
Husky Technologies
Bolton, ON
- Full-time
Leveraging technology, ERP capabilities, analytics, and automation to improve productivity and decision support across Finance.
Added 7 hours ago
J
Senior Analyst, Supply and Demand Planning
Jobgether
Canada
- $79,958 to $104,944.35 CAD / year
- Full-time
Added 7 hours ago
R|
Programmer
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
- Full-time

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job