Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 6 days ago
AI
Quality Engineer (QE) / SDET – AI Chatbot Validation
Apptoza Inc.
Toronto, ON
- Contract
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team…
Added 6 days ago
AC
Development Lead (Back-end Systems)
Air Canada
Toronto, ON
- Full-time
The Development Lead is a senior, hands-on technical leader who drives technical direction, sprint execution, and delivery outcomes within an Agile delivery pod. This role owns technical…
Added 6 days ago
P
Senior Java Low Latency Developer
PeoplePilot
Mississauga, ON
- $120,000 to $130,000 CAD / year
- Full-time
We are seeking an experienced Senior Java Low Latency Developer to join our team in Mississauga, Ontario, working on high-performance enterprise applications . The ideal candidate will have…
Added 6 days ago
P
Core Java, Apache Spark, Python
PeoplePilot
Montreal, QC
- $120,000 to $130,000 CAD / year
- Full-time
We are seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and support scalable…
Added 6 days ago
YC
Senior Test/QA Consultants
Yoush Consulting
Toronto, ON
- Full-time
Experience with automated testing tools (Selenium, Java)
Added 6 days ago
NB
Senior AI Developer
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior AI Developer within the Wealth Management and Capital Markets team at National Bank means directly contributing to the evolution of our digital platforms by developing…
Added 6 days ago
NB
Site Reliability Engineer
National Bank of Canada
Montreal, QC
- Full-time
A career as a Site Reliability Developer in the IT Delivery, Wealth Management team at National Bank means acting as a specialist in application reliability, observability, and operational…
Added 6 days ago
CC
RQ11528 - Software WEB Developer - API - Senior
CCI- Computer Consultants International, Inc.
Toronto, ON
- Full-time
REQUIREMENTS-Must Have:
Added 6 days ago
Copy of Senior Software Development Engineer in Test, ML
PlayStation Global
Waterloo, ON
Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java
Added 6 days ago
CC
RQ11620 - Software Developer - Senior
CCI- Computer Consultants International, Inc.
Toronto, ON
- Full-time
REQUIREMENTS-Must haves:
Added 6 days ago
I
Senior Staff Software Developer
Intuit
Toronto, ON
- Full-time
This is a hybrid role with the expectation of working from our Toronto office 3 days per week
Added 6 days ago
L
Senior Software Engineer
lululemon
BC · British Columbia, Canada
- Full-time
Senior Software Engineer - Tech Distribution & Logistics Systems
Added 7 days ago
DI
Senior Android Developer
Dawn InfoTek
Toronto, ON
- Contract
We are currently seeking a highly skilled Senior Android Developer / Android Development Lead to join our dynamic team and support one of our major banking clients.
Added 7 days ago
UC
Senior AI Developer
UniSysTech Consulting
Toronto, ON · Greater Toronto and Hamilton Area, ON
- Other
Hybrid Model: Requirement to work 2 days per week in-office at our Downtown Toronto office, with up to 3 days remote flexibility.
Added 7 days ago
C
Senior Java Engineer – Agentic AI Driven Development
Citi
Mississauga, ON
- Full-time
Lead the design, development, and implementation of complex middleware applications using Java and Spring Boot:Utilize AI-powered code generation tools (e.g., Devin, Copilot, Codex) to…
Added 7 days ago
M
Lead Full Stack Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
…decisions where no established precedent exists, and influence senior technology and business leaders. Success requires recognized technical depth, sound judgement in ambiguous situations,…
Added 7 days ago
SF
Senior Mobile Consultant, Application Development - Simplii Financial
Simplii Financial
Toronto, ON
- Full-time
You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit
Added 7 days ago
M
Lead Full Stack Engineer
Manulife
Waterloo, ON
- Full-time
…decisions where no established precedent exists, and influence senior technology and business leaders. Success requires recognized technical depth, sound judgement in ambiguous situations,…
Added 7 days ago
AI
Quality Engineer (QE) / SDET – AI Chatbot Validation
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team…
Added 7 days ago
IG
Quality Engineer – AI Chatbot Validation
IMCS Group
ON · Ontario, Canada
- Contract
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team…
Added 7 days ago
R
Senior Staff Software Engineer, Platform
Rippling
Toronto, ON
- Full-time
We're hiring a Senior Staff Engineer to help define the future of Rippling's core platform and AI infrastructure. This is a rare opportunity to work on foundational systems that sit at the…
Added 7 days ago
BC
Database Administrator (Senior Systems Analyst)
British Columbia Institute of Technology
Burnaby, BC
- $84,685 to $112,200 CAD / year
- Temporary
BCIT’s Information Technology Services department is seeking a temporary, full-time (1.0 FTE) Database Administrator (Senior Systems Analyst). As a member of our Solution Delivery team, the…
Added 7 days ago
TI
Quality Engineer (QE) / SDET – AI Chatbot Validation
Tekgence Inc
Brampton, ON
- Contract
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team…
Added 7 days ago
T
Senior IT Developer
TD
Toronto, ON
- Full-time
Have a strong technology background as full stack (Java primarily) developer with the exceptional experience building large scale enterprise
Added 7 days ago
C
Consultant, Java Back End Development
CIBC
Toronto, ON
- Full-time
You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit

Tekgence Inc

Quality Engineer (QE) / SDET – AI Chatbot Validation

Brampton, ON, Canada

Contract

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Dec 2, 2026
Posting language: English
Posted: Nov 2, 2026

Original job description

Job Title

Quality Engineer (QE) / SDET – AI Chatbot Validation

BRAMPTON, ON--1 day onsite per week

Job Description:

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on LinkedIn About employer

More about this job

Responsibilities

Design and execute functional, integration, API, regression, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Evaluate chatbot behavior and AI quality, track defects and quality trends, and communicate risks and release recommendations to cross-functional stakeholders.

Requirements

Requires 5+ years of quality engineering, programming, and test automation framework experience, along with hands-on experience testing AI-powered applications, APIs, and integrations. Candidates should know automation and testing tools and practices, understand AI quality concepts, and have strong analytical, communication, and documentation skills.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
LLM Testing
Prompt Evaluation
Selenium
Playwright
Cucumber/Gherkin
RestAssured
API Testing
CI/CD
JMeter
Agile

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Artificial Intelligence
Machine Learning
Chatbots
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Retrieval-Augmented Generation
Java
Python
Groovy
Selenium
Cucumber
Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Jenkins
Kubernetes
AWS
Microservices
Behavior-Driven Development
Risk-Based Testing

Report this job

Work requirements

Jobs in Canada