Find work in Canada.

577,994 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 11 mins ago
R
Senior Full Stack Engineer (Rails & React)
REW
Vancouver, BC
- Full-time
Senior Full Stack Engineer (Rails + React)We’re seeking a highly skilled Full Stack Software Engineer with deep expertise in Ruby on Rails and React.
Added 11 mins ago
A
Senior Principal Engineer
Autodesk
Toronto, ON
- Full-time
GET Engineering is seeking an experienced Senior Principal Engineer – AI and Engineering Excellence to lead the technical strategy and evolution of our cloud platform, developer experience,…
Added 27 mins ago
AE
Distribution Engineer / Senior Engineer
ATCO Electric
Grande Prairie, AB
- Full-time
We are recruiting for opportunities at both the Engineer and Senior Engineer levels, and candidates may be considered for placement at either level based on their qualifications,…
Added 27 mins ago
GG
Junior Electrical Engineer
Giampaolo Group Inc.
Brampton, ON
- Full-time
Reporting to the Senior Director, Engineering and Maintenance, the Junior Electrical Engineer will support a variety of engineering and maintenance initiatives across Triple M Metal's…
Added 27 mins ago
SC
Rail Maintenance Facility Director – Engineering Services
SYSTRA Canada
Toronto, ON
- Full-time
…mechanical and electrical infrastructure with specialized rail systems, including signalling, traction power/OCS, maintenance equipment, wheel truing machines and automated train wash…
Added 27 mins ago
S
Senior Electrical Engineer
Sedgman
Vancouver, BC
- Full-time
Sedgman is currently looking for a Senior Electrical Engineer to join our team in the Vancouver, B.C. office. He/she will act as a technical leader, bridging complex engineering design with…
Added 42 mins ago
M
Environmental Services Manager , Senior Living (Contract)
Maquise
Windsor, ON
- Full-time
Building Environmental Systems (BES), Operating Engineer certification, or a related facilities maintenance designation is considered an asset.
Added 57 mins ago
Senior AI Engineer, IT Solutions 1 1 1
Celestica International LP
Toronto, ON
We are seeking a highly motivated and technically proficient AI Engineer to join our growing Data & Analytics team. In this role, you will be a key liaison between business stakeholders and…
Added 57 mins ago
Software Engineer, Backend
Lyft
Toronto, ON
…Learning Platform (MLP) team is seeking a backend Software Engineer to help build and operate our platform, which supports real-time, online, and offline ML model execution, development,…
Added 57 mins ago
HI
Project Manager | HRBrain
HRbrain Inc.
Mississauga, ON
- Contract
…understanding of telecom infrastructure, architectural frameworks, and systems structure. The successful candidate will lead technical deliveries for large-scale Telecom projects, utilizing…
Added 57 mins ago
CG
Environmental Services Manager , Senior Living (Contract)
Compass Group Canada
Windsor, ON
- Full-time
Building Environmental Systems (BES), Operating Engineer certification, or a related facilities maintenance designation is considered an asset.
Added 57 mins ago
BH
Senior Mechanical Engineer (Generation Stations)
BC Hydro
Burnaby, BC
- Full-time
This Engineer will work in the Heavy equipment Team, part of the Generation Stations Mechanical Engineering Division, on a range of projects pertaining primarily to BC Hydro’s water…
Added 57 mins ago
M
Senior Software Engineer-C#
Morningstar
Toronto, ON
- Full-time
Morningstar is seeking a Senior Software Engineer (Backend) to design, build, and maintain scalable enterprise applications and APIs. The role focuses on backend development using C#, .NET,…
Added 1 hour ago
A
Senior Civil Engineer & Deputy Manager - Airport
AtkinsRéalis
Toronto, ON
- Full-time
Join AtkinsRéalis’ Engineering Services group as a Senior Civil Engineer & Deputy Manager and play a key role in delivering one of the most significant airport infrastructure projects in…
Added 1 hour ago
TT
Senior Full Stack Software Engineer
True Talent Solutions Partners
Canada
- $200,000 to $275,000 USD / year
- Full-time
Join an AI team building software for designing physical systems. You will help accelerate product development, first by strengthening the frontend and then by taking on broader…
Added 1 hour ago
C
IT Quality Engineer - AVP
Citi
Mississauga, ON
- Full-time
This role focuses on post-trade processing, clearing systems, back-office product processors, accounting, and regulatory reporting platforms. The Senior QA Analyst will drive end-to-end…
Added 1 hour ago
AM
Senior Source Control Engineer
Advanced Micro Devices, Inc
Markham, ON
- Full-time
…and numerous development organizations. We are looking for a Senior Source Control Engineer to help lead the platform’s governance, security, and automation so that it can scale across the…
Added 1 hour ago
AC
Senior Mechanical Estimator
Accenture Construct
Toronto, ON
- Full-time
Prepare order-of-magnitude, conceptual, feasibility, pre-design, budget, value engineering, control, definitive, and final Engineer’s estimates as well as major change order estimates.
Added 1 hour ago
D
Python Developer
Dexian
Mississauga, ON
- Other
…platforms. The successful candidate will work closely with senior engineers, architects, and business partners to deliver scalable and secure applications while adhering to established…
Added 1 hour ago
Service Engineer (Quebec, Canada)
Mitsubishi Electric Automation, Inc.
Montreal, QC
Support in-house diagnostic systems, including simulators, programming systems, and tools.
Added 1 hour ago
Instrumentation & Controls Engineer
Kiewit
Calgary, AB
The Kiewit Power Engineering Group is seeking several Mid to Senior level Instrumentation & Controls Engineers to join our growing Calgary team!
Added 1 hour ago
Senior Automation Engineer
Scotiabank
Toronto, ON
Acts as a senior engineer and technical lead for enterprise automation engineering, with strong expertise in
Added 1 hour ago
PL
Senior Geotechnical Engineer - PL#60248
Peter Lucas Project Management Inc.
Sudbury, ON
- Full-time
…gold standard project delivery. We are currently looking for a Senior Geotechnical Engineer – Underground Operations to join our…
Added 1 hour ago
P
Technical Director
Parallelz
Remote, Canada
- Full-time
- Remote
10+ years building complex software, including time as a Staff, Principal or lead engineer with architectural ownership of a production system, and experience leading senior teams.
Added 1 hour ago
Vancouver - Senior Electrical Designer
Hatch
Vancouver, BC
…best-in-class team leverages methodologies, governance and systems that are unparalleled in the engineering space. Are you looking for an opportunity to join a diverse group of…

Apptoza Inc.

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Dec 3, 2026
Posting language: English
Posted: Nov 3, 2026

Original job description

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto Hybrid ON ,

Job Description:

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Thanks & regards,

Lakshmi Bhavani ,

Apptoza Inc.

Phone: 678-392-3978 Ext 4640

Phone: 437-291-3224 Ext 1105

Mail id : Lakshmi.bhavani@apptoza.com

Apply About employer

More about this job

Responsibilities

Design and execute functional, integration, regression, API, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Analyze defects, test coverage, AI evaluation results, and production feedback, and communicate quality risks and release recommendations to stakeholders.

Requirements

Requires 5+ years of quality engineering or related experience, programming experience, and experience building test automation frameworks. Candidates should have hands-on experience testing AI or chatbot applications, automation tools, APIs and integrations, and understand AI quality concepts and Agile testing practices.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
LLM Testing
Selenium
Playwright
Cucumber/Gherkin
API Testing
CI/CD
JUnit
TestNG
JMeter
Agile

Visa sponsorship

Not detected in the job text

Hiring contact

Lakshmi Bhavani

Hiring contact email

Lakshmi.bhavani@apptoza.com

Keywords

Quality Engineering
AI Chatbot Validation
Artificial Intelligence
Machine Learning
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Accuracy
Relevance
Toxicity
Bias
Response Consistency
Test Automation Frameworks
Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
DevOps
Jenkins
Kubernetes

Report this job