Find work in Canada.

500,312 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 3 days ago
ZS
Artificial Intelligence Engineer
Zodiac Solutions, Inc
Halifax, NS
- Full-time
…every teams development workflow runs on.If youre the kind of engineer who has already wired tools like Claude Code into your own workflow with custom skills and MCP servers to make…
Added 3 days ago
PR
Sr Lead-IT Infrastructure Ops (Associate Manager)
Peel Regional Police
Brampton, ON
- $165,396 to $179,322 CAD / year
- Full-time
Added 3 days ago
KS
ETL Testing
Kumaran Systems
Toronto, ON
- Full-time
We are looking for an ETL QA Engineer with strong experience in Databricks and PySpark, combined with hands-on exposure to AI-assisted development and prompt engineering. The ideal…
Added 3 days ago
TC
Data Engineer - Big Data / PySpark
Tata Consultancy Services
Toronto, ON
- $90,000 to $100,000 CAD / year
- Full-time
An experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should possess hands-on…
Added 3 days ago
T
Software Engineer 2
ThunderSoft
Markham, ON
- $55 to $60 CAD / hour
- Contract
The main function of a Software Engineer is to design, develop, implement, test, and maintain business and computer applications software or specialized utility programs including mainframe…
Added 3 days ago
SI
Artificial Intelligence Engineer
Smart IT Frame LLC
Halifax, NS
- Contract
We are looking for an experienced AI Platform Engineer to design, build, and maintain scalable infrastructure and platforms that support AI/ML workloads, Generative AI applications, and…
Added 3 days ago
AI
Generative AI Engineer
Apptoza Inc.
Toronto, ON
- Contract
Programming & Full Stack: Python, NumPy, Pandas, Matplotlib, Boto3, React, Next.js, TypeScript/JavaScript.
Added 3 days ago
TI
Quality Engineer
Tekgence Inc
Brampton, ON
- Contract
Job Description: Title Quality Engineer (QE) SDET AI Chatbot Validation Key Roles Responsibilities Validate chatbot responses for accuracy| relevance| completeness| and consistency. Create…
Added 3 days ago
C
Senior AI Engineer
Chubb
Toronto, ON · Greater Toronto Area, Canada
- Full-time
We are looking for an AI Engineer who has shipped ML and LLM systems, built quality and observability tooling around them in production, and is ready to go deeper on that problem at scale.…
Added 3 days ago
ZS
Artificial Intelligence Engineer
Zodiac Solutions, Inc
Halifax, NS
- Full-time
…every teams development workflow runs on.If youre the kind of engineer who has already wired tools like Claude Code into your own workflow with custom skills and MCP servers to make…
Added 3 days ago
RC
Quality Engineer (QE) / SDET – AI Chatbot Validation
Realtek Consulting LLC
Toronto, ON
- Contract
Job Title: Quality Engineer (QE) / SDET – AI Chatbot Validation
Added 3 days ago
C
Engineer (Python/AWS + Azure/React) (Senior/NewGrad)
Caddie
Toronto, ON
- Full-time
The engine: containerised Python workers (FastAPI, NumPy, SciPy) that make the same decision on every machine
Added 3 days ago
Middle/Senior Forward Deployed Engineer (Python, AI)
Exadel
Canada
For the Senior Forward Deployed Engineer level, senior-level experience, including technical delivery leadership across multidisciplinary teams or pods.
Added 3 days ago
AT
AI Engineer
Altitude Technology Solutions Inc
Toronto, ON
- Contract
…orchestration, policy enforcement) following MCP protocol. Engineer robust guardrails for safety, compliance, and least-privilege…
Added 3 days ago
B
Senior Application Developer/Engineer
Bevertec
Toronto, ON
- Contract
Added 3 days ago
S
Head of Data Systems (Google Stack)
Stacktics
Toronto, ON
- Full-time
Added 3 days ago
Q
Senior Conversational Bot Engineer
Quantiphi
Toronto, ON
- Full-time
Proficiency in at least one of the following: Python, Node.js
Added 3 days ago
H
Machine Learning Engineer
Hays
Toronto, ON
- Contract
We’re looking for a hands-on Machine Learning Engineer to develop and improve ML and deep learning models that power personalization across our retail ecosystem.
Added 4 days ago
B
Software Engineer - Identity & Authorization
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 4 days ago
B
Software Engineer - Identity & Authorization
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 4 days ago
RB
Lead Agentic AI Engineer
Royal Bank of Canada
Toronto, ON
- Full-time
Strong Python backend - FastAPI, async, Pydantic, streaming responses
Added 4 days ago
TS
Analyst – Front Office Application Engineer
TD Securities
Toronto, ON
- Full-time
Global Equity Derivatives (GED) is seeking a highly motivated Front Office Application Engineer to support, enhance, and develop technology solutions used by our trading, sales, and…
Added 4 days ago
L
Security Engineer, Vulnerability Management & Security Operations
LiveKit
Canada
- Full-time
…their data and their business at risk. We are hiring a Security Engineer to build and run our vulnerability management and security operations program. Vulnerability management is a core…
Added 4 days ago
MA
Tech Lead - Snowflake & DBT
Mitra AI
Canada
- Contract
We are seeking a highly experienced, hands-on Lead / Principal Data Engineer with deep expertise in Snowflake, DBT, advanced SQL, and modern data engineering practices to support enterprise…
Added 4 days ago
TT
Data Engineer (Basketball Strategy)
Toronto Tempo
Toronto, ON
- Full-time
…our community. We are seeking a dynamic and experienced Data Engineer (Basketball Strategy) reporting to the Assistant General Manager/SVP Basketball Strategy to join our team as of January…

Realtek Consulting LLC

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Nov 22, 2026
Posting language: English
Posted: Oct 23, 2026

Original job description

Job Title: Quality Engineer (QE) / SDET – AI Chatbot Validation

Locations: ~Brampton, Ontario~Scarborough, Ontario~Etobicoke, Ontario~Guleph, Ontario~Hamilton, Ontario~Kitchener, Ontario~Milton, Ontario~North York, Ontario~Ontario Nes,~Oshawa, Ontario~

Long Term Contract

Experience: 6–8 Years

Work Model: Hybrid – 1 day onsite per week

Job Description:

We are looking for an experienced Quality Engineer / SDET with strong test automation skills and hands-on experience validating AI-powered chatbots, LLMs, Generative AI applications, or conversational platforms. The ideal candidate will ensure the accuracy, relevance, consistency, and reliability of AI-generated responses while developing and maintaining automated testing solutions.

Key Responsibilities:

Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Design, develop, and execute test scenarios, test cases, and regression test suites.
Identify AI hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Analyze chatbot conversations and recommend quality improvements.
Develop and maintain automated test frameworks for chatbot validation.
Collaborate with developers, AI engineers, and content teams to investigate and resolve defects.
Track defects, document test results, and report quality metrics.
Support UAT, release validation, and production quality monitoring.

Required Skills:

5+ years of strong QA / SDET / test automation experience.
Experience testing AI, LLMs, Generative AI applications, chatbots, virtual assistants, or conversational platforms.
Understanding of prompt engineering and AI response validation.
Strong programming and automation skills using Python, Selenium, Playwright, PyTest, or similar tools.
Experience with API testing and automation frameworks.
Familiarity with Jira, Confluence, GitHub, and Agile delivery methodologies.
Strong analytical, troubleshooting, communication, and documentation skills.

Preferred Skills:

Experience with LLM evaluation, hallucination detection, and conversational AI quality metrics.
Experience building automated validation and regression testing frameworks for AI applications.
Knowledge of Generative AI quality engineering practices.

Apply About employer

More about this job

Responsibilities

Validate AI chatbot responses for accuracy, relevance, completeness, and consistency, and design and execute test scenarios and regression suites. Build and maintain automated validation frameworks, investigate defects with cross-functional teams, document results and quality metrics, and support UAT, releases, and production monitoring.

Requirements

Requires at least five years of QA, SDET, or test automation experience, including hands-on testing of AI, LLM, Generative AI, chatbot, or conversational applications. Candidates should have prompt engineering and AI response validation knowledge, strong programming and automation skills, API testing experience, familiarity with Jira, Confluence, GitHub, and Agile, and strong analytical and communication skills.

Skills

Quality Assurance
Software Development Test Engineering
Test Automation
AI Chatbot Validation
Large Language Models
Generative AI
Prompt Engineering
Python
Selenium
Playwright
PyTest
API Testing
Regression Testing
Hallucination Detection
Jira
Agile

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Software Development Test Engineering
Quality Assurance
Test Automation
AI Chatbots
Large Language Models
Generative AI
Conversational Platforms
Prompt Engineering
AI Response Validation
Hallucination Detection
Python
Selenium
Playwright
PyTest
API Testing
Automated Test Frameworks
Regression Testing
UAT
Production Quality Monitoring
Jira
Confluence
GitHub
Agile
Defect Tracking
AI Quality Metrics

Report this job