Find work in Canada.

503,031 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 41 mins ago
T
Director Enterprise Applications, Data
TEEMA
Vancouver, BC
- $160,000 to $215,000 CAD / year
- Full-time
…professional services firm to hire a Director, Application, Data & Integration. It’s a rare chance for an engineering-minded technology leader to build modern application, data and…
Added 56 mins ago
AI
Full Stack Developer
Alberta iGaming Corporation (AiGC)
AB · Edmonton, AB
- Full-time
AiGC is seeking a Full Stack Developer to support the design, development, implementation, and ongoing evolution of the applications and technology systems that underpin Alberta's regulated…
Added 56 mins ago
F
Senior Quality Assurance Engineer
FireFlink
Toronto, ON
- Full-time
The QA Engineer III will be responsible for leading and executing functional quality assurance activities for complex banking and financial applications. The role requires strong hands-on…
Added 1 hour ago
B
Lead Cloud Software Developer - (AWS / AI / Real Time Payment Systems)
BMO
Toronto, ON · BMOPLACE
- Full-time
…transform requirements into features, managing development teams and processes, and conducting software testing and maintenance. Specific project areas of focus includes translating user…
Added 1 hour ago
B
Salesforce Developer
Brunel
Quebec, QC
- $100,000 to $125,000 CAD / year
- Full-time
Brunel is seeking a Forward Deployed Engineer specializing in Salesforce Agentic AI to support the design, development, and deployment of production-ready AI solutions on the Salesforce…
Added 1 hour ago
HS
Senior Integration Engineer (Boomi/Workato)
HeartCentrix Solutions
ON · Ontario, Canada
- Contract
We are seeking a Senior Integration Engineer with deep expertise in Boomi and Workato, specializing in payroll and HR system integrations. This role will focus on designing, developing, and…
Added 2 hours ago
S
Associate Applications Engineer
Semtech
Burlington, ON · CAN - Burlington, ON
- Full-time
The Applications Engineer supports our data communications business in delivering high quality, customer-focused solutions. The successful candidate will work alongside senior team members…
Added 2 hours ago
B
Sr. Angular Front End Engineer - Azure DevOps/Banking
BeachHead
Toronto, ON
- Contract
Working with one of our top financial clients, this role calls for a Sr. Angular Front End Engineer- Azure DevOps/Banking to lead DevOps engineering across Azure DevOps and GitHub…
Added 2 hours ago
M
Full-Stack Software Engineer - React
Manulife
Toronto, ON · Waterloo, ON
- Full-time
We’re looking for an experienced Full Stack Software Engineer who enjoys working across the technology stack and turning ideas into modern, scalable digital solutions.
Added 3 hours ago
AT
Sr. Software Engineer-MANO
Aarorn Technologies Inc
Toronto, ON
- $50 CAD / hour
- Contract
…proven track record in software development, particularly in data integration and ETL processes. You will be responsible for designing, developing, and maintaining data pipelines and…
Added 3 hours ago
IG
AWS Data Engineer
Insight Global
Toronto, ON
- $55 to $65 CAD / hour
- Contract
We are seeking a Data Engineer to support a large enterprise transformation focused on building data pipelines, integrating data, and migrating data workloads from on-premises environments…
Added 3 hours ago
Sr Staff. Software Engineer
Kaseya Careers
Toronto, ON
We’re hiring a Senior / Staff Backend Engineer to lead the design and delivery of SaaS products powered by data, machine learning, and AI. This is a hands-on role focused on building…
Added 3 hours ago
S
Software Engineer Manager
symplistic.ai
Woodbridge, ON
- $150,000 CAD / year
- Full-time
Validate functionality, performance, reliability, and security; strengthen automated, regression, integration, and end-to-end testing.
Added 4 hours ago
TT
Bilingual Senior Integration Platform Engineer
Tech Talent International
Montreal, QC
- $130,000 to $140,000 CAD / year
- Full-time
Develop, evolve and operate critical integration services enabling real-time data exchanges between business systems, digital platforms and partners.
Added 5 hours ago
RI
Senior Full-Stack Java Developer (Front-Office / Capital Markets)
Rose International
Mississauga, ON
- Full-time
Strong database expertise across Oracle Database, Microsoft SQL Server, and MongoDB, including schema design, data modeling, query optimization, and performance tuning.
Added 6 hours ago
Solutions Engineering Lead, International Upmarket Customers
Toast
Toronto, ON
Integration fluency: REST APIs, webhooks, authentication and data flows. You can read API docs and sketch an architecture on a whiteboard. Coding isn't required, but you can test your own…
Added 6 hours ago
Senior Solutions Engineer
Toast
Toronto, ON
Integration fluency: REST APIs, webhooks, authentication and data flows. You can read API docs and sketch an architecture on a whiteboard. Coding isn't required, but you can test your own…
Added 6 hours ago
T
Test Engineer – MDM & Data Quality
Teqfocus
Toronto, ON
- Full-time
Teqfocus is seeking a Test Engineer with strong functional testing, SQL, data validation, and test automation experience to support master data management (MDM) and data integration…
Added 9 hours ago
AI
Founding Member of Technical Staff - Forward Deployed Engineer
Aran Industries
Remote, Canada
- $150,000 to $250,000 USD / year
- Full-time
- Remote
As a forward-deployed engineer, you'll work side by side with our customers (developers, hyperscalers, EPCs and their engineering teams) and turn their projects into working Aran…
Added 9 hours ago
C
GTM Engineer
Chatbase
Toronto, ON
- $110,000 to $160,000 CAD / year
- Full-time
More than 10,000 businesses are running AI agents on Chatbase. We started with self-serve, and now we're moving upmarket and building our sales team. We have a lot of inbound and almost no…
Added 11 hours ago
A
Software Development Manager, Integration ML Models
Autodesk
Toronto, ON
- Full-time
Background as an architect, engineer, BIM or computational design specialist, or direct experience with Revit, Forma, IFC, or similar AEC tools and data
Added 11 hours ago
A
Software Development Manager, Integration ML Models
Autodesk
Toronto, ON
- Full-time
Background as an architect, engineer, BIM or computational design specialist, or direct experience with Revit, Forma, IFC, or similar AEC tools and data
Added 12 hours ago
W
Data & AI Engineer
Wiraa
Canada
- Full-time
We are seeking a skilled Data & AI Engineer to join our team in Mississauga, CA, working in a hybrid model (3 days in office, 2 days remote). In this role, you will be responsible for…
Added 12 hours ago
A
Airworthiness Certification Engineer
Actalent
Ottawa, ON · Nepean, ON
- $65 to $80 CAD / hour
- Contract
As an Airworthiness Certification Engineer, you will support Canadian and international military aerospace programs by ensuring aircraft modifications meet all applicable airworthiness…
Added 12 hours ago
RD
Kotlin Developer
Randstad Digital
Vancouver, BC
- $140,000 to $180,000 CAD / year
- Contract
We are seeking a Software Engineer to help build and maintain our finance integration platform. You will work in an established Kotlin codebase connecting retail, order-management, and…

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job