Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 5 mins ago
HT
Senior AI System Engineer - LLM Training System
Huawei Technologies Canada Co., Ltd.
Vancouver, BC
- Full-time
Huawei Canada has an immediate permanent opening for a Senior Engineer.
Added 5 mins ago
Senior Backend Engineer, Integrations
Movable Ink
Toronto, ON
We are looking for a Senior Software Developer to be a part of the development team that works on building and maintaining integrations between our systems and third party APIs. This team…
Added 5 mins ago
Mechanical Designer - Laval
Ametek, Inc.
Laval, QC
You are familiar with CAD software : CATIA V5, SolidWorks, Solid Edge, Autodesk Inventor, PTC Creo (Pro/Engineer), etc.
Added 5 mins ago
Senior Staff Software Engineer
EarnIn
Vancouver, BC
We’re looking for an exceptional Senior Staff Software Engineer to serve as the L0 Architect for Live Pay, the product that powers the EarnIn Card. As the team’s lead architect, you’ll own…
Added 20 mins ago
A
Power BI Developer
Akkodis
Toronto, ON
- Full-time
The Power BI Developer is a business-focused analytics role responsible for partnering closely with business teams to design, deliver and sustain insightful Power BI dashboards and reports.…
Added 20 mins ago
SC
Engineering Manager
SYSTRA Canada
Toronto, ON
- Full-time
Preferable: Professional Engineer of Ontario or Chartership of Engineering Body (e.g. P.Eng or CEng)
Added 20 mins ago
R&
Staff AI Developer - Toronto
Robots & Pencils
Toronto, ON
- Full-time
…delivery of AI/ML systems. This role is ideal for an experienced engineer who thrives on architectural decisions, can confidently own systems end-to-end, and contributes to technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Toronto, ON
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
T
Principal Data Engineer
Tangerine
Toronto, ON
- Full-time
Added 20 mins ago
TR
Principal Engineer
Thomson Reuters
Toronto, ON
- Full-time
As Principal Engineer for Corporate Tax and Trade, you'll define and execute the technical vision for our generative AI products, ensuring we deliver powerful, user-friendly, and innovative…
Added 20 mins ago
CT
Generative AI Engineer
Celebal Technologies
Canada
- Full-time
We are seeking a motivated Generative AI Engineer with 1–3 years of experience in Machine Learning, Generative AI, and Large Language Models (LLMs). The ideal candidate should have strong…
Added 20 mins ago
S
Manager, Quantitative Strategies & Analytics
Scotiabank
Toronto, ON
- Full-time
Re-engineer manual workflows into repeatable, automated processes to reduce operational risk, improve controls, and increase scalability.
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Mississauga, ON
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Winnipeg, MB
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
KG
Municipal Hydraulic Design EIT
KGS Group
Winnipeg, MB · Greater Winnipeg Metropolitan Area
- Full-time
Added 20 mins ago
KG
Intermediate Municipal Hydraulic Design Engineer
KGS Group
Winnipeg, MB · Greater Winnipeg Metropolitan Area
- Full-time
Job Title: Intermediate Municipal Hydraulic Design Engineer
Added 20 mins ago
Accounts Payable Technician - Freight
PFX Group
Montreal, QC
We engineer leading fluid solutions that keep the world moving and we’re building a better future while we do it. As a vertically integrated global powerhouse, we operate 17 manufacturing…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Calgary, AB
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Montreal, QC
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Oakville, ON
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Halifax, NS
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
Ottawa, ON
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…
Added 20 mins ago
UT
Software Developer 3- #26-27660
US Tech Solutions
Markham, ON
- $60 to $70 USD / hour
- Contract
Identify opportunities to improve developer productivity, platform usability, and operational efficiency through automation.
Added 20 mins ago
RC
Data Lineage / Meta data Engineer
RAPS Consulting Inc
Mississauga, ON
- Full-time
Developer focused on data lineage to build systems that parse and analyze large, multi-language codebases and automatically generate accurate data lineage. The role pairs strong Python…
Added 20 mins ago
BC
Senior Data Engineer (Databricks Focused)
BDO Canada
AB · Edmonton, AB
- Full-time
BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical…

Viva Tech Solutions

Quality Engineer - AI Chatbot Validation

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Dec 3, 2026
Posting language: English
Posted: Nov 3, 2026

Original job description

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
5+ years of experience building and maintaining test automation frameworks.
Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
Ability to create effective test data and evaluation datasets for AI-driven functionality.

Apply About employer

More about this job

Responsibilities

Build and maintain test automation frameworks, and validate functional and non-functional requirements across APIs, integrations, databases, microservices, and regression suites. Test AI-powered conversational features by evaluating prompt quality, grounding, accuracy, relevance, toxicity, bias, hallucinations, and response consistency, using effective test data and evaluation datasets.

Requirements

Requires at least five years of relevant quality engineering, quality assurance, test automation, or software development experience, including programming and test automation framework experience. Candidates should have hands-on experience with AI or chatbot testing, automation tools and testing frameworks, and practices such as TDD, ATDD, BDD, continuous testing, and risk-based testing.

Skills

Quality Engineering
Quality Assurance
Test Automation
Java
Python
Groovy
AI and Machine Learning Testing
Chatbot Validation
LLM Validation
Selenium
Cucumber/Gherkin
Playwright
RestAssured
API Testing
JUnit
TestNG

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Quality Assurance
Test Automation
Java
Python
Groovy
AI Testing
Machine Learning
Chatbots
Large Language Models
Generative AI
Prompt Evaluation
Grounding
Accuracy
Relevance
Toxicity
Bias
Hallucination Detection
Response Consistency
Selenium
Cucumber
Gherkin
Playwright
RestAssured
JUnit
TestNG
qTest
ReadyAPI
JMeter
TDD

Report this job