Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 6 days ago
QW
Quality Engineer (QE) / SDET – AI Chatbot Validation
Quantum World Technologies Inc.
Toronto, ON
- Contract
Design and execute functional, API, integration, regression, database, and AI-focused testing.
Added 6 days ago
JG
Data Engineer with Metadata- 9+ Years
J2B Global LLC
Mississauga, ON
- Full-time
…programming using technologies such as Oracle SQL/PLSQL, Python, or…
Added 6 days ago
Z
Java Lead - Capital Market or investment domain -10+ Years Must
Zoho
Toronto, ON
- Contract
Full stack Java + Spring Developers with some experience on React + Camunda ( Preferred)
Added 6 days ago
QW
Full Stack Engineer
Quantum World Technologies Inc.
Toronto, ON
- $50 to $60 CAD / hour
- Contract
Added 6 days ago
W
Software Engineer II
Wiraa
Canada
- Full-time
Hands-on experience with REST API development using Java
Added 6 days ago
SP
Software Engineering LMTS
Salesforce Partner Canada
Vancouver, BC
- Full-time
Deep knowledge of object-oriented programming languages: Java, C++, Go, C#, Ruby, Scala, Python, Node.js, or JavaScript
Added 6 days ago
CC
RQ11528 - Software WEB Developer - API - Senior
CCI- Computer Consultants International, Inc.
Toronto, ON
- Full-time
REQUIREMENTS-Must Have:
Added 6 days ago
Copy of Senior Software Development Engineer in Test, ML
PlayStation Global
Waterloo, ON
Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java
Added 6 days ago
VT
Java Full Stack Engineer - Artificial Intelligence
Viva Tech Solutions
Toronto, ON
- Contract
Strong hands-on experience with Java, Spring Boot, Angular, React, REST APIs, and microservices architecture.
Added 6 days ago
VT
Quality Engineer - AI Chatbot Validation
Viva Tech Solutions
Toronto, ON
- Contract
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
Added 7 days ago
L
Senior Software Engineer
lululemon
BC · British Columbia, Canada
- Full-time
…establishing technical direction for the domain area including API design standards, data modeling approaches, and integration patterns while ensuring solutions meet scalability,…
Added 7 days ago
UC
Senior AI Developer
UniSysTech Consulting
Toronto, ON · Greater Toronto and Hamilton Area, ON
- Other
Hybrid Model: Requirement to work 2 days per week in-office at our Downtown Toronto office, with up to 3 days remote flexibility.
Added 7 days ago
Q
Engineer
Qualcomm
Toronto, ON
- Full-time
1+ year of experience with Programming Language such as C, C++, Java, Python, etc.
Added 7 days ago
M
Software Engineer
Microsoft
Vancouver, BC
- Full-time
…coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent…
Added 7 days ago
S
Software Engineering LMTS
Salesforce
Vancouver, BC · Canada - Vancouver
- Full-time
Deep knowledge of object-oriented programming languages: Java, C++, Go, C#, Ruby, Scala, Python, Node.js, or JavaScript
Added 7 days ago
M
Lead Full Stack Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
Languages and runtimes: Java, TypeScript, JavaScript, Node.js, Python, C#, .NET, and SQL.
Added 7 days ago
SF
Senior Mobile Consultant, Application Development - Simplii Financial
Simplii Financial
Toronto, ON
- Full-time
You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit
Added 7 days ago
M
Lead Full Stack Engineer
Manulife
Waterloo, ON
- Full-time
Languages and runtimes: Java, TypeScript, JavaScript, Node.js, Python, C#, .NET, and SQL.
Added 7 days ago
AI
Quality Engineer (QE) / SDET – AI Chatbot Validation
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Added 7 days ago
AE
Campus Undergraduate Summer Internship Program - 2027 AI Engineer, Enterprise Technology Services- Toronto, Ontario, CN
American Express
Toronto, ON
- Full-time
Students must have a graduation date between December 2027 and June 2028
Added 7 days ago
IG
Quality Engineer – AI Chatbot Validation
IMCS Group
ON · Ontario, Canada
- Contract
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Added 7 days ago
PG
Software Engineer in Test
Pacer Group
Toronto, ON
- $40 to $45 CAD / hour
- Contract
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
Added 7 days ago
TI
Quality Engineer (QE) / SDET – AI Chatbot Validation
Tekgence Inc
Brampton, ON
- Contract
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Added 7 days ago
T
Senior IT Developer
TD
Toronto, ON
- Full-time
Have a strong technology background as full stack (Java primarily) developer with the exceptional experience building large scale enterprise
Added 7 days ago
C
Consultant, Java Back End Development
CIBC
Toronto, ON
- Full-time
You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Dec 2, 2026
Posting language: English
Posted: Nov 2, 2026

Original job description

Quality Engineer (QE) / SDET – AI Chatbot Validation

Job Description:
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:
• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:
• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:
• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on LinkedIn About employer

More about this job

Responsibilities

Design and execute functional, integration, API, regression, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Evaluate chatbot and AI behavior for accuracy, safety, reliability, latency, and consistency; track defects, analyze quality results, and communicate risks and release recommendations.

Requirements

Requires at least five years of relevant quality engineering, test automation, or software development experience, including programming and maintaining automation frameworks. Candidates should have experience testing AI or machine learning applications and APIs, familiarity with testing tools and methodologies, and strong analytical, communication, and documentation skills.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
Large Language Model Testing
API Testing
Selenium
Playwright
Cucumber/Gherkin
CI/CD
Agile
Risk-Based Testing
Performance Testing
Test Data Design

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
AI Chatbot Validation
Artificial Intelligence
Machine Learning
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Response Accuracy
Safety Testing
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
Java
Python
Groovy
CI/CD
Jenkins
Jira
AWS
Kubernetes
TDD
ATDD
BDD

Report this job

Work requirements

Jobs in Canada