Find work in Canada.

498,673 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 37 mins ago
MANAGER DEVELOPMENT ENGINEERING
City of Toronto
Toronto, ON
…Official Plan Amendments, Zoning By-law Amendments, Site Plan Controls, Plans of Subdivision and Consents. The review focuses on the municipal engineering aspects of the applications - site…
Added 51 mins ago
C
Event Streaming Engineer - Kafka / Azure Event Hubs
Coforge
Canada
- Full-time
We are looking for a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka.
Added 2 hours ago
A
Cloud Security Analyst
ATB
Calgary, AB · Edmonton, AB
- Full-time
…cloud environments by identifying security risks, strengthening controls, and working with engineering teams to resolve vulnerabilities and misconfigurations. You'll work primarily across…
Added 2 hours ago
LI
Senior DevOPS/Engineer
Lotus IT Solutions
Toronto, ON
- Contract
…Delivery and Procurement) is seeking a Senior DevOps/Cloud Engineer to lead the automation, configuration, deployment, monitoring, and operational enablement of enterprise platform…
Added 2 hours ago
SM
RQ11740 – DevOps/Cloud Engineer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior DevOps/Cloud Engineer with extensive experience in Microsoft Azure, CI/CD pipelines, deployment automation, infrastructure as code, cloud operations, and enterprise…
Added 2 hours ago
SM
RQ11740 – DevOps/Cloud Engineer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior DevOps/Cloud Engineer with extensive experience in Microsoft Azure, CI/CD pipelines, deployment automation, infrastructure as code, cloud operations, and enterprise…
Added 2 hours ago
SM
RQ11740 – DevOps/Cloud Engineer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior DevOps/Cloud Engineer with extensive experience in Microsoft Azure, CI/CD pipelines, deployment automation, infrastructure as code, cloud operations, and enterprise…
Added 2 hours ago
BS
Senior Enterprise security Engineer
BULLTECH SOLUTIONS LTD
Toronto, ON
- Full-time
…architecture review boards. Develop security policies, standards, controls, and procedures aligned with industry…
Added 4 hours ago
F
Senior AI Engineer (NVIDIA + LLM Inference) - Onsite - Toronto, Canada
FullStack
Toronto, ON
- Full-time
Join our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
Added 5 hours ago
HT
PD Software for Service
Husky Technologies
Bolton, ON
- Full-time
The Service team is currently seeking a Software engineer/designer to specialize in resolving service issues with a focus on Injection Molding Machine controls, including servo drive and…
Added 5 hours ago
GG
Electrical Engineer
Giampaolo Group Inc.
Brampton, ON
- Full-time
Reporting to the Senior Director, Engineering and Maintenance, the Electrical Engineer will provide support across a variety of functional groups by providing innovative solutions that…
Added 6 hours ago
SS
Integration Lead – API
Syncredible Solutions
Canada
- Contract
Collaborate with Cloud Engineering and Information Security to implement approved security controls.
Added 6 hours ago
AI
Forward Deployed Engineer (Python/Pyspark Developer)
Apptoza Inc.
Toronto, ON
- Full-time
Role: Forward Deployed Engineer (Python/Pyspark Developer)
Added 6 hours ago
A
Sr. Mechanical Designer
Actalent
Cambridge, ON
- $45 to $65 CAD / hour
- Contract
Collaborate closely with controls, electrical, process, manufacturing, and project teams to ensure complete system integration.
Added 6 hours ago
Forward Deployed AI Engineer Sr - Analytics
Dayforce
Canada
We are looking for a Senior Forward Deployed AI Engineer, Analytics to partner directly with analytics teams and business stakeholders to turn high-value analytical problems into practical,…
Added 6 hours ago
TR
Privacy Operations Engineer
Thomson Reuters
Toronto, ON · Canada, Toronto, Ontario
- Full-time
Added 6 hours ago
HP
Senior Instrumentation & Controls Engineer
HOCS Projects
Calgary, AB
- Full-time
Lead/ Senior Instrumentation & Controls Engineer
Added 7 hours ago
SL
Student, Software Engineer - Security (Winter 2027)
Sun Life
Toronto, ON · Sun Life Toronto One York
- Full-time
…environments. In this role, you will contribute as a software engineer while helping embed security practices into the design, development, testing and operation of project…
Added 7 hours ago
Bilingual Senior Specialist, Software Engineering (Environment Management - DEVOPS)
CMHC - SCHL
Ottawa, ON · Montreal, QC
Embed security controls, RBAC and policy-as-code into provisioning workflows to ensure compliance and consistency.
Added 7 hours ago
E
Ingénieur(e) en calibration moteur et contrôle du groupe motopropulseur/Engine Calibration & Powertrain Controls Engineer
Expleo
QC · Estrie, QC
- Contract
EXPLEO GROUP CANADA is looking for a Engine Calibration & Powertrain Controls Engineer to join our team in Estrie, QC.
Added 7 hours ago
S
Mechanical Design Engineer
SMARTFOX
ON · Ontario, Canada
- $80,000 to $120,000 CAD / year
- Full-time
Collaborate with electrical, controls, software, quality, and manufacturing teams to deliver products people rely on
Added 7 hours ago
SI
Cloud Engineer
Spait Infotech
Canada
- Full-time
Implement cloud security best practices, identity and access management (IAM), and access controls.
Added 7 hours ago
S
Information Technology Support Engineer
SMARTFOX
ON · Ontario, Canada
- $65,000 to $110,000 CAD / year
- Full-time
Patch, image, and maintain endpoints, and help enforce security controls such as MFA, disk encryption, EDR (CrowdStrike, Defender, SentinelOne), and phishing awareness
Added 7 hours ago
AI
AI Evaluator/ Quality Engineer
Avanciers Inc.
Toronto, ON
- $100,000 to $110,000 CAD / year
- Full-time
Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.
Added 8 hours ago
GT
Program Manager
GeoSpectrum Technologies, Inc
Port Coquitlam, BC
- Full-time
Establish, manage, and report on Program status, scope, budgets, timelines, milestones and other project controls.

Avanciers Inc.

AI Evaluator/ Quality Engineer

Toronto, ON, Canada

$100,000 to $110,000 CAD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $100,000 to $110,000 CAD / year
Job type: Full-time
Apply by: Nov 25, 2026
Posting language: English
Posted: Oct 26, 2026

Original job description

Avanciers is a premier IT Staffing/Consulting organization and we are currently recruiting for a contract role for one of our premier client in Canada for AI Evaluator/ Quality Engineer.

Role: AI Evaluator/ Quality Engineer

Location: Toronto, ON

Duration: Full Time

Compensation Range: $100,000 - $110,000 per year

This is an active job and application deadline is October 30, 2026

(This posting may close earlier if a suitable candidate is found)

Job Description:

Define and execute the evaluation approach for generative-AI solutions, proving that models,
agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under controls.
Requires 10+ years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python,
test automation, API and integration testing, prompt and response test-set design,
groundedness/relevance and hallucination assessment, regression, bias/safety, performance,
penetration and non-functional testing; candidates should be comfortable with GitHub/GitHub
Actions, GitHub Copilot, Claude Code, Copilot Studio, Foundry or LLM Gateway patterns, LangSmith,
AppInsights, Log Analytics and Dynatrace, and must produce auditable evidence,
defect analytics and go/no-go recommendations for architecture, privacy, cyber and risk reviewers.

Artificial Intelligence (AI) Disclosure

We use AI-enabled tools to assist in screening applications based on job-related criteria.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

Only candidates selected for an interview will be contacted
Proof of qualifications may be requested
Background checks may be conducted as part of the hiring process
Avanciers Incorporated does not use Canadian Social Insurance Numbers (SIN) during the application process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn

Apply About employer

More about this job

Responsibilities

Define and execute evaluation strategies for generative AI models, agents, and AI-assisted workflows to verify accuracy, safety, reliability, performance, and production readiness. Produce auditable evidence and defect analytics, and provide go/no-go recommendations to architecture, privacy, cybersecurity, and risk reviewers.

Requirements

Requires 10+ years of quality engineering experience and at least 2 years evaluating AI/ML systems, with strong Python, test automation, API, and integration testing skills. Candidates should be familiar with the listed AI development, evaluation, and observability tools and with prompt testing, groundedness, hallucination, regression, bias, safety, performance, penetration, and non-functional testing.

Skills

Quality Engineering
AI/ML Evaluation
Python
Test Automation
API Testing
Integration Testing
Groundedness and Relevance Assessment
Hallucination Assessment
Regression Testing
Bias and Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
Defect Analytics
Auditable Evidence and Go/No-Go Recommendations

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
AI/ML Systems
Quality Engineering
Python
Test Automation
API Testing
Integration Testing
Prompt and Response Test Sets
Groundedness
Relevance Assessment
Hallucination Assessment
Regression Testing
Bias Testing
Safety Testing
Performance Testing
Penetration Testing
Non-Functional Testing
GitHub
GitHub Actions
GitHub Copilot
Claude Code
Copilot Studio
Foundry
LLM Gateway
LangSmith
Application Insights
Log Analytics
Dynatrace
Defect Analytics
Production Readiness

Report this job