Find work in Canada.

553,841 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 10 days ago
NT
Product Engineer
NETINT Technologies Inc.
Burnaby, BC
- Full-time
…computing. Its Codensity portfolio enables enterprise, cloud data centers, and content providers to deploy high-performance applications that they can scale without limit while minimizing…
Added 10 days ago
R
Test Engineer - Laser Device Characterization & Automation
Ranovus
Ottawa, ON
- Full-time
Develop automated test systems and data acquisition software using Python and related engineering tools.
Added 10 days ago
Senior ASIC Design Engineer - DSP/Analog/SerDes
Celero Communications, Inc.
Ottawa, ON
…developing innovative technologies that power next-generation AI and data center infrastructure. Our products enable high-performance optical connectivity and next-generation optical…
Added 10 days ago
T
Market Risk Manager, Trading Market Risk Stress Testing & Scenario Design (5111)
TD
Toronto, ON
- Full-time
Maintain a strong understanding of key risk and risk-related issues through review of risk reports, stress testing data, market developments, and dialogue with relevant stakeholders. Ensure…
Added 10 days ago
Senior Data Scientist - Commercial Banking Data & Analytics, Toronto
Scotiabank
Toronto, ON
Advanced Python and SQL skills, with experience performing large-scale data analysis, feature engineering, and production support
Added 11 days ago
AI
Senior Forward Deployed AI Engineer (Python, Data & GenAI)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
We are looking for a senior Forward Deployed Engineer who combines production-grade software engineering, data engineering, AI application development, and client-facing consulting. You…
Added 11 days ago
S
Senior DevOps and Cloud Engineer
StafinGo
Toronto, ON
- $80 to $105 CAD / hour
- Contract
Provision and support Amazon Data Firehose delivery streams and AWS DMS replication instances, endpoints, subnet groups, tasks, table mappings, logging, monitoring, and connectivity.
Added 11 days ago
PT
Senior Data Engineer – Capital Markets
Precision Technologies
Mississauga, ON
- Contract
Python / PySpark - ETL/ELT pipelines, large-scale data processing, data validation, and automation
Added 11 days ago
SM
Business Systems Analyst
Smartrend Manufacturing Group
Winnipeg, MB
- $70,000 to $90,000 CAD / year
- Full-time
…software development, you'll connect systems, support reliable data processing and delivery, and make everyday work more…
Added 11 days ago
HP
Senior Technical Support Operations Lead
Hewlett Packard Enterprise
Toronto, ON · Mississauga, ON
- $172,000 to $222,000 CAD / year
- Full-time
You’ll use tools and techniques such as tcpdump, Wireshark, shell scripting, Python, HTTP and API testing tools, structured queries, performance benchmarks, monitoring data, system traces,…
Added 11 days ago
T
Market Risk Manager, Trading Market Risk Stress Testing & Scenario Design (5111)
TD
Toronto, ON
- Full-time
Maintain a strong understanding of key risk and risk-related issues through review of risk reports, stress testing data, market developments, and dialogue with relevant stakeholders. Ensure…
Added 11 days ago
KR
AI Architect
KTek Resourcing
Vancouver, BC
- Contract
This also includes driving segmentation initiatives and delivering value through data engineering.
Added 11 days ago
S
Opto-Mechanical Engineer
SBQuantum
Sherbrooke, QC
- Full-time
…ground up, collaborate with passionate experts across physics, data science, and engineering., and contribute directly to solving real-world challenges across critical…
Added 11 days ago
S
AI Software Engineer Co-op
symplistic.ai
Woodbridge, ON
- $23 CAD / hour
- Internship
You are currently pursuing a degree or diploma in Computer Science, Software Engineering, Computer Engineering, Artificial Intelligence, Machine Learning, Data Science, Information…
Added 11 days ago
WC
AI Software Developer (Burlington, ON)
Wolseley Canada Inc.
Burlington, ON
- Full-time
Post-secondary education in Computer Science, Software Engineering, Artificial Intelligence, Data Science, or a related field.
Added 11 days ago
R
Senior DevOps Engineer
Recharge
Canada
- Full-time
…retention and revenue growth. The Recharge platform leverages data from over 100 million shoppers to help brands more successfully set up, manage, and grow their subscription…
Added 11 days ago
H
Data Science Manager (Hybrid)
Homebase
Remote, Canada
- $170,000 to $240,000 CAD / year
- Full-time
- Remote
We’re hiring a Manager, Data Science who’s excited to lead a team transforming how data powers product, platform, and people at Homebase. This role is ideal for someone who wants to shape…
Added 11 days ago
Business Operations Analyst
AppLovin
Toronto, ON
…and translate business problems into actionable requests for Engineering and Operations. You will also write and maintain your own workflow code and analyze product features and…
Added 11 days ago
ZT
Data & AI Engineer
Zebra Technologies
Mississauga, ON · CAN - Mississauga, Canada
- Full-time
Develops efficient data transformation code in spark (in Python and Scala) and Dask.
Added 11 days ago
KC
Senior Consultant, Microsoft Fabric Data Engineer, Data & AI
KPMG Canada
Calgary, AB
- Full-time
Lead delivery of modern data platforms leveraging Fabric Lakehouse, Data Warehouse, Data Engineering, and Real-Time Analytics workloads.
Added 11 days ago
AL
AI Engineer (Agentic AI / AWS Bedrock)
Accion Labs
Canada
- Contract
The role requires a strong combination of AI engineering, cloud deployment, data pipeline development, and LLM performance monitoring.
Added 11 days ago
MC
Azure Databricks Cloud Migration & Platform Engineer (36101)
Myticas Consulting
Toronto, ON
- Contract
This is a hands-on Platform Engineering role, requiring someone who has personally deployed, configured, secured, and operationalized Azure Databricks environments, rather than simply…
Added 11 days ago
H
Quality Engineer
Hays
Toronto, ON
- Contract
The ideal candidate will combine deep expertise in Quality Engineering with hands-on experience evaluating Large Language Models (LLMs), AI agents, AI-assisted workflows, and enterprise AI…
Added 11 days ago
NT
Product Engineer
NETINT Technologies
Burnaby, BC
- $70,000 to $95,000 CAD / year
- Full-time
…computing. Its Codensity portfolio enables enterprise, cloud data centers, and content providers to deploy high-performance applications that they can scale without limit while minimizing…
Added 11 days ago
P
Intermediate Software Engineer
PointClickCare
Mississauga, ON
- $112,000 to $125,000 CAD / year
- Full-time
Knowledge of scripting languages such as Python, Bash or Groovy

Hays

Quality Engineer

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Nov 20, 2026
Posting language: English
Posted: Oct 21, 2026

Original job description

Job Title: Quality Engineer - AI/GenAI Validation & Testing

Location: Toronto, ON (Hybrid, 3-4 days onsite per week)

Contract Duration: 12 Months (Strong possibility of extension)

Overview

We are seeking a highly experienced Quality Engineer specializing in Artificial Intelligence (AI), Machine Learning (ML), and Generative AI (GenAI) solution validation. This role will be responsible for defining and executing comprehensive testing strategies that ensure AI-powered applications, agents, and intelligent workflows are accurate, reliable, secure, performant, and production-ready.

The ideal candidate will combine deep expertise in Quality Engineering with hands-on experience evaluating Large Language Models (LLMs), AI agents, AI-assisted workflows, and enterprise AI platforms. You will work closely with Engineering, Architecture, Security, Risk, and Product teams to provide evidence-based assessments and go/no-go recommendations for production deployment.

Key Responsibilities

Define, develop, and execute end-to-end testing strategies for AI/ML and Generative AI solutions.
Validate the accuracy, reliability, safety, and performance of AI models, AI agents, and LLM-powered applications.
Design and maintain automated test frameworks using Python and modern test automation tools.
Create and manage AI-specific test datasets, prompts, evaluation criteria, and benchmark scenarios.
Conduct testing focused on:
Groundedness and response relevance
Hallucination detection and mitigation
Bias, fairness, and safety validation
Regression testing
API and integration testing
Functional and non-functional testing
Performance and scalability testing
Security and penetration testing
Evaluate retrieval-augmented generation (RAG) implementations, agentic workflows, and enterprise LLM integrations.
Develop auditable test evidence and quality metrics to support governance, risk, compliance, and architecture review processes.
Analyze defects, trends, and quality indicators, providing actionable recommendations for remediation.
Collaborate with development, product, cybersecurity, privacy, and risk teams throughout the software delivery lifecycle.
Produce detailed quality assessments and deployment readiness recommendations.

Required Qualifications

10+ years of experience in Quality Assurance, Quality Engineering, or Software Testing.
2+ years of hands-on experience evaluating AI, Machine Learning, or Generative AI solutions.
Strong programming and scripting skills in Python.
Extensive experience with: Test automation frameworks, API testing, Integration testing, Regression testing, non-functional testing, Performance and load testing
Experience designing prompts, test suites, and evaluation datasets for AI systems.
Deep understanding of: LLM evaluation methodologies, Hallucination assessment, Response quality measurement, Groundedness and relevance testing, Bias and safety evaluation, Experience working within Agile delivery environments.
Strong analytical, troubleshooting, and communication skills.

Desired Attributes

Strong attention to detail and quality mindset.
Ability to assess complex AI systems and communicate risks effectively.
Experience producing executive-ready quality reports and recommendations.
Comfortable working with cross-functional stakeholders across engineering, architecture, security, privacy, and business teams.
Proven ability to drive testing strategy for complex enterprise technology initiatives.

Apply About employer

More about this job

Responsibilities

Develop and execute end-to-end testing strategies for AI/ML and GenAI solutions, assessing accuracy, reliability, safety, security, and performance. Build automated tests and AI evaluation datasets, document auditable quality evidence, analyze defects, and provide deployment-readiness recommendations in collaboration with cross-functional teams.

Requirements

Requires 10+ years of quality assurance, quality engineering, or software testing experience, including at least 2 years evaluating AI, ML, or GenAI solutions, and strong Python skills. Candidates should have extensive test automation and API, integration, regression, non-functional, and performance testing experience, plus expertise in LLM evaluation, prompt and dataset design, groundedness, hallucinations, bias, and safety.

Skills

Quality Engineering
AI/ML Testing
Generative AI Validation
Python
Test Automation
API Testing
Integration Testing
Regression Testing
Performance Testing
Load Testing
LLM Evaluation
Prompt Design
RAG Testing
Hallucination Assessment
Bias and Safety Evaluation
Agile

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Quality Assurance
Artificial Intelligence
Machine Learning
Generative AI
Large Language Models
Python
Test Automation
API Testing
Integration Testing
Regression Testing
Non-Functional Testing
Performance Testing
Load Testing
Security Testing
Penetration Testing
Prompt Engineering
Evaluation Datasets
LLM Evaluation
Hallucination Detection
Groundedness
Response Relevance
Bias and Fairness
Safety Validation
Retrieval-Augmented Generation
AI Agents
Agentic Workflows
Enterprise LLM Integrations
Agile
Governance, Risk, and Compliance

Report this job