Find work in Canada.

A simpler way to find your next job.

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 9 mins ago
N
Sr Supervisor, Mill Engineering
Nutrien
Vanscoy, SK
- Full-time
Must have a Degree in Engineering and a valid Professional Engineer license (P. Eng) through the Association of Professional Engineers and Geoscientists of Saskatchewan (APEGS).
Added 9 mins ago
R
Senior Full Stack Engineer (Rails & React)
REW
Vancouver, BC
- Full-time
Senior Full Stack Engineer (Rails + React)We’re seeking a highly skilled Full Stack Software Engineer with deep expertise in Ruby on Rails and React.
Added 9 mins ago
A
Senior Principal Engineer
Autodesk
Toronto, ON
- Full-time
GET Engineering is seeking an experienced Senior Principal Engineer – AI and Engineering Excellence to lead the technical strategy and evolution of our cloud platform, developer experience,…
Added 9 mins ago
A
Senior Software Developer, Frontend
Autodesk
Toronto, ON
- Full-time
We’re looking for an experienced Senior Frontend Engineer with strong expertise across all aspects of frontend development to join the Autodesk Assistant engineering platform team. Autodesk…
Added 9 mins ago
MT
Mechanical Design Engineer
Miller Technology Incorporated
North Bay, ON
- Full-time
…vehicles from the ground up to withstand demanding duty cycles and applications. Its KT Series and flagship KM Series vehicles are available in diesel and electric drive configurations,…
Added 10 mins ago
JH
Building Code & Fire Protection Engineer
J.S. Held LLC
Calgary, AB
- Full-time
We are seeking an experienced and motivated Professional Engineer (P.Eng.) to help grow our presence in Alberta. The successful candidate will play a key role in delivering building code…
Added 24 mins ago
MG
Superviseur(e), Maintenance / Supervisor, Maintenance
Medicom Group
Saint-Eustache, QC
- Full-time
Added 24 mins ago
A
Frontend Software Engineer – React/TypeScript
Applicantz
Toronto, ON
- $50 to $55 CAD / hour
- Contract
…(PDMS) division. We are looking for an experienced Software Engineer to join one of our teams to help us fulfill the mission of the organization, supporting cross-platform device…
Added 24 mins ago
V|
Ingénieur(e) d'exécution de projets/Execution Project Engineer
Veolia | North America
Montreal, QC
- Full-time
Reporting to the Project Execution Team Lead, you will be at the heart of the action. As a Project Execution Engineer, you will do more than prepare documentation - you will lead our water…
Added 24 mins ago
WI
Highways/Roads Engineer
WSP in Canada
BC · British Columbia, Canada
- Full-time
WSP welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.
Added 24 mins ago
BF
First Engineer 2nd Class S.P.
BC Ferries
Nanaimo, BC
- Full-time
As a First Engineer at our Nanaimo terminals, you will have the opportunity to be trained on some of our most technically advanced vessels. In this role, you bring extensive technical,…
Added 24 mins ago
A
Advanced Substrate Design & Process Integration
AMD
Markham, ON
- $180,000 to $270,000 USD / year
- Full-time
…electrical performance optimization. This role is for a seasoned engineer to define substrate technology requirements and design methodologies that bridge product needs with manufacturing…
Added 25 mins ago
IC
Python Developer
IT Connex
Toronto, ON · Greater Toronto Area, Canada
- Contract
Design, develop, test, and support Python-based applications and services.
Added 25 mins ago
GG
Junior Electrical Engineer
Giampaolo Group Inc.
Brampton, ON
- Full-time
Reporting to the Senior Director, Engineering and Maintenance, the Junior Electrical Engineer will support a variety of engineering and maintenance initiatives across Triple M Metal's…
Added 25 mins ago
IG
Identity Specialist II
Insight Global
Vancouver, BC
- $100,000 to $117,554 CAD / year
- Full-time
Experience integrating IAM solutions with enterprise/cloud applications, APIs, or connectors
Added 25 mins ago
SC
Rail Maintenance Facility Director – Engineering Services
SYSTRA Canada
Toronto, ON
- Full-time
Licensed Professional Engineer (P.Eng.) in good standing with Professional Engineers Ontario (PEO) preferred, with comprehensive knowledge of the Ontario Professional Engineers Act.
Added 25 mins ago
WI
Electrical Designer / Estimator
WSP in Canada
Vancouver, BC
- Full-time
Prepare electrical equipment and installation specifications under the supervision of a Professional Engineer.
Added 25 mins ago
FU
Facilities Manager
First United Church Community Ministry Society
Vancouver, BC
- Full-time
BOMA designation and an HVAC 4th class Power Engineer credential preferred.
Added 25 mins ago
CG
Embedded Software Test Engineer / HSIT – ISO 26262
CS GROUP
Ottawa, ON
- Full-time
We are looking for a detail-oriented Embedded Software Test / Verification & Validation Engineer to support testing activities within an HSIT team in an automotive environment.
Added 25 mins ago
S
Senior Electrical Engineer
Sedgman
Vancouver, BC
- Full-time
Sedgman is currently looking for a Senior Electrical Engineer to join our team in the Vancouver, B.C. office. He/she will act as a technical leader, bridging complex engineering design with…
Added 40 mins ago
FM
Quality Engineer
FluidAI Medical
Kitchener, ON
- $70,000 to $85,000 CAD / year
Support regulatory submissions, licence applications and amendments, and responses to regulator questions.
Added 40 mins ago
CT
System Designer Co-Op
Comtech Telecommunications Corp.
Gatineau, QC
- Full-time
- Temporary
- Internship
Design, prototyping, selection and integration of various components used to implement complex telecommunications systems, business applications, or networking products.
Added 55 mins ago
ES
Mainframe Application Support Engineer
Epsilon Solutions Ltd.
Toronto, ON
- Contract
We are seeking an experienced Mainframe Application Support Engineer to provide production support, incident management, and application maintenance for critical mainframe-based business…
Added 55 mins ago
WI
Highways/Roads Engineer
WSP in Canada
BC · British Columbia, Canada
- Full-time
WSP welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.
Added 55 mins ago
A
Ingénieur ÉLectrique/Hardware
Actalent
Montreal, QC
- $35 to $45 CAD / hour
- Contract

Apptoza Inc.

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Dec 3, 2026
Posting language: English
Posted: Nov 3, 2026

Original job description

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto Hybrid ON ,

Job Description:

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Thanks & regards,

Lakshmi Bhavani ,

Apptoza Inc.

Phone: 678-392-3978 Ext 4640

Phone: 437-291-3224 Ext 1105

Mail id : Lakshmi.bhavani@apptoza.com

Apply About employer

More about this job

Responsibilities

Design and execute functional, integration, regression, API, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Analyze defects, test coverage, AI evaluation results, and production feedback, and communicate quality risks and release recommendations to stakeholders.

Requirements

Requires 5+ years of quality engineering or related experience, programming experience, and experience building test automation frameworks. Candidates should have hands-on experience testing AI or chatbot applications, automation tools, APIs and integrations, and understand AI quality concepts and Agile testing practices.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
LLM Testing
Selenium
Playwright
Cucumber/Gherkin
API Testing
CI/CD
JUnit
TestNG
JMeter
Agile

Visa sponsorship

Not detected in the job text

Hiring contact

Lakshmi Bhavani

Hiring contact email

Lakshmi.bhavani@apptoza.com

Keywords

Quality Engineering
AI Chatbot Validation
Artificial Intelligence
Machine Learning
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Accuracy
Relevance
Toxicity
Bias
Response Consistency
Test Automation Frameworks
Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
DevOps
Jenkins
Kubernetes

Report this job