Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 24 mins ago
W
Full Stack Software Engineer - Associate
Wiraa
Canada
- Full-time
We are seeking a dynamic and results-driven Associate Software Engineer - Full Stack to join our IT Product Delivery team at our Oshawa, Ontario location. Reporting to the Manager, IT…
Added 24 mins ago
Web Engineer, International Expansion
Robinhood
Toronto, ON
We are looking for a Web Engineer to join our team. As a Web Engineer, you will lead the web development process and build products from inception to deployment. We also work closely with…
Added 53 mins ago
GD
Computer Modeling & Simulation Staff Specialist/Engineer
General Dynamics Land Systems–Canada
London, ON
- Full-time
Computer Modeling & Simulation Staff Specialist/Engineer P55
Added 2 hours ago
M
BSP Software Engineer
MANNARINO
Montreal, QC
- Full-time
We are seeking an experienced BSP Software Engineer to support the development of a next-generation embedded computing platform for an in-flight entertainment system.
Added 2 hours ago
M
Senior Software Engineer
MANNARINO
Montreal, QC
- $140,000 to $175,000 USD / year
- Full-time
We are seeking an experienced Senior Software Engineer to contribute to the development, integration, and delivery of software for in-flight entertainment systems. You will work alongside…
Added 2 hours ago
MS
Phased Array System Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a Phased Array Antenna Systems Engineer to be responsible for the definition, development, design, integration, verification, and test of phased‑array antenna subsystems for…
Added 2 hours ago
MS
Satellite Electrical Systems Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a Satellite Electrical Systems Engineer for its current and next‑generation remote sensing and communications satellites. The Electrical Systems Engineer will ensure all…
Added 2 hours ago
MS
Guidance, Navigation & Control (GNC) Systems Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a GNC System Engineer for design, integration, verification, and operational support of GNC subsystems for our current and next‑generation remote sensing and communications…
Added 2 hours ago
MS
Software Integration System Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a Software Integration System Engineer that acts as the bridge between disparate technologies, designing and implementing solutions to merge software, hardware, databases and…
Added 2 hours ago
MS
Satellite & Payload Verification, Validation & Integration Systems Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a Satellite & Payload IVV Engineer to join its System Engineering Department. He/she will lead the end‑to‑end V&V and integration of satellite and payload hardware and…
Added 2 hours ago
MS
Synthetic Aperture Radar Systems Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a SAR Payload System Engineer to support our current and next‑generation earth observation and remote sensing satellites. The SAR System Engineer will own the definition,…
Added 2 hours ago
MS
Digital Payload System Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a Digital Payload System Engineer for design, integration, verification, and operational support for current and next‑generation earth observation and communications…
Added 2 hours ago
MS
Intermediate Electronics Validation and Test Engineer/Designer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
The intermediate Electronics Validation and Test Engineer/Designer will be responsible for design, integration and commissioning of specialized electronic test equipment for testing mixed…
Added 2 hours ago
TA
Junior Avionics Engineer-FR
Top Aces
Dorval, QC
- Full-time
The Junior Avionics Engineer supports the research, evaluation, integration, certification, and sustainment of avionics systems across for both civil type certified and military non-type…
Added 4 hours ago
MS
Guidance, Navigation & Control (GNC) Systems Engineer
MDA Space
Sainte-Anne-de-Bellevue, QC
- Full-time
MDA is seeking a GNC System Engineer for design, integration, verification, and operational support of GNC subsystems for our current and next‑generation remote sensing and communications…
Added 6 hours ago
B
Senior Engineer, Building Electrical
BPA
Toronto, ON
- Full-time
…tomorrow. With offices across Canada, our expertise in sustainable design and technical innovation drives impactful projects from coast to coast. Joining BPA means putting your talent to…
Added 7 hours ago
IE
Contract Opportunity: Fire Protection / Sprinkler Systems Engineer (P.Eng.)
IFEL Engineering
Burnaby, BC
- Full-time
InnovaFlux Enterprises Ltd. (IFEL) is seeking an experienced Fire Protection / Sprinkler Systems Engineer to support our engineering projects on a contract basis. We are looking for someone…
Added 7 hours ago
Engineer
Toronto Hydro
Toronto, ON
Reporting to the Manager, Engineering - Non-Wires Solutions, the Engineer will support the identification, evaluation and development of Non-Wires Solutions and other grid investment…
Added 10 hours ago
FA
Quality Engineer
FTAI Aviation
Montreal, QC
- Full-time
The Quality Engineer supports the Quality Assurance department within the engine maintenance, repair, and overhaul (MRO) operation. This role provides quality engineering support across new…
Added 11 hours ago
C
Facilities Building Operator - FIFO 14/14
Convergint
Mississauga, ON · CA AB Suncor
- Full-time
Coordinate shut down/start up of building utility systems for projects through Safe Work Permit System procedures.
Added 12 hours ago
A
Senior Software Engineer
AltaML
Toronto, ON
- $130,000 to $150,000 CAD / year
- Full-time
The Senior Software Engineer leads implementation of complex features and epics, owns technical design end to end, and multiplies the pod's output - both by mentoring other engineers and by…
Added 12 hours ago
C
Manager, Engineering
Cvent
Fredericton, NB
- Full-time
Cvent’s Event Cloud Registration platform is the backbone of how planners design, launch, and manage attendee experiences at scale. The Registration team owns the end-to-end attendee…
Added 12 hours ago
C
Senior Software Engineer
Cvent
Fredericton, NB
- Full-time
We are seeking a Senior Software Engineer to join our Splash team!
Added 12 hours ago
SS
Quality Manager
SkyCan Systems
Barrie, ON
- Full-time
…production facility in Barrie, Ontario, building aircraft to our design partner's approved design and progressively qualifying Canadian suppliers. Our customers expect us to operate to…
Added 12 hours ago
SC
Enterprise Adobe Experience Manager (AEM) Specialists – Expression of Interest (Open Roles: AEM Core Developer |Front-end Developer |Leads|Architects)
Spareminds Consulting Services Inc
Toronto, ON
- Full-time
📐 3. AEM Architect (System Design & Integration)

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Dec 2, 2026
Posting language: English
Posted: Nov 2, 2026

Original job description

Quality Engineer (QE) / SDET – AI Chatbot Validation

Job Description:
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:
• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:
• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:
• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Design and execute functional, integration, API, regression, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Evaluate chatbot and AI behavior for accuracy, safety, reliability, latency, and consistency; track defects, analyze quality results, and communicate risks and release recommendations.

Requirements

Requires at least five years of relevant quality engineering, test automation, or software development experience, including programming and maintaining automation frameworks. Candidates should have experience testing AI or machine learning applications and APIs, familiarity with testing tools and methodologies, and strong analytical, communication, and documentation skills.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
Large Language Model Testing
API Testing
Selenium
Playwright
Cucumber/Gherkin
CI/CD
Agile
Risk-Based Testing
Performance Testing
Test Data Design

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
AI Chatbot Validation
Artificial Intelligence
Machine Learning
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Response Accuracy
Safety Testing
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
Java
Python
Groovy
CI/CD
Jenkins
Jira
AWS
Kubernetes
TDD
ATDD
BDD

Report this job