Find work in Canada.

573,887 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 2 mins ago
MC
Senior Research Scientist
Medical Council of Canada
Ottawa, ON
- $130,000 to $156,000 CAD / year
- Full-time
You’ll be immersed in a collaborative and inclusive work environment that fosters professional development and work-life balance.
Added 2 mins ago
NB
Senior Auditor
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Auditor in the Internal Audit sector at National Bank is a unique opportunity to gain deep insight into the Bank’s operations, develop a comprehensive understanding of…
Added 2 mins ago
G
Sales Director
Gordian
Canada
- Full-time
Gordian is seeking a dynamic Sales Player-Coach to join our Canadian team, focusing on business development for Gordian Facilities Capital Planning SaaS and services solutions. This…
Added 2 mins ago
NB
Analyst SBL Risk & Control Capital Markets
National Bank of Canada
Montreal, QC
- Full-time
Support senior analysts in assisting the team
Added 2 mins ago
NB
Senior Credit Analyst
National Bank of Canada
Toronto, ON
- Full-time
The Wealth Management, Credit Risk Management team is currently looking for a Senior Analyst. Its mission is to protect the company's capital and minimize business risk related to client…
Added 2 mins ago
RB
Transportation Engineer
Recruitment By Design
Saskatoon, SK
- $110,000 to $140,000 CAD / year
- Full-time
Our client, a leading Western Canadian firm offering comprehensive engineering and environmental services, is seeking a Senior Railway Design Engineer to join their team in Regina,…
Added 2 mins ago
NB
Manager, Financing Solutions - Private Banking 1859
National Bank of Canada
Quebec, QC
- Full-time
…Banking 1859 team at National Bank means working closely with Senior private Bankers and several internal and external partners as a credit expert. This position allows you to have a…
Added 2 mins ago
T&
Director, Capital Investment & Decision Support
Turner & Townsend
Vancouver, BC
- Full-time
The role will combine senior client advisory, technical leadership, business development and team leadership. It will support clients across Infrastructure and Energy & Natural Resources to…
Added 2 mins ago
MI
Project Accountant
Matrix360 Inc.
Toronto, ON
- $75,000 to $100,000 CAD / year
- Full-time
Matrix360 has been at the forefront of building and transforming the commercial real estate and development (CRED) landscape for diverse and inclusive teams for over two decades. We…
Added 2 mins ago
NB
Manager Administrative Support
National Bank of Canada
Vancouver, BC
- Full-time
In this role, you will lead teams of Commercial Account Representatives and optimize their ability to offer value-added services to Account Managers for the benefit of Commercial clients.
Added 2 mins ago
A
Technology - Senior Architect/Architect, Cybersecurity
Aritzia
Vancouver, BC
- Full-time
…enable the business to operate and innovate securely. As the Senior Architect/Architect, Cybersecurity, you will define secure architectures, reusable security patterns, and reference…
Added 2 mins ago
EB
Product Manager, Digital Banking (18 Month Contract)
EQ Bank
Toronto, ON
- Contract
Reporting to the Director, Product and Channel Management, Digital Banking and working alongside senior management, the Product Manager is responsible for devising strategies and leading…
Added 2 mins ago
TT
Director of Finance And Accounting
Torus Talent
Vancouver, BC
- Full-time
Torus Talent is connecting with senior finance and accounting leaders across British Columbia as we continue to develop our executive and senior management talent network.
Added 2 mins ago
TC
Agentic AI Engineer
Tata Consultancy Services
Mississauga, ON
- $100,000 to $130,000 CAD / year
- Full-time
…the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and…
Added 2 mins ago
CA
Director, Admissions & Referent Relations
Canadian Addiction Treatment Centres (CATC)
Markham, ON
- Full-time
Line of Business: Shared Services, Canadian Addiction Treatment Centres
Added 2 mins ago
HM
Key Account Manager
Highlight Motor Group
Vaughan, ON
- Full-time
Direct access to senior leadership for support, coaching, and career development
Added 2 mins ago
NB
Senior Data Solutions Architect
National Bank of Canada
Montreal, QC
- Full-time
Required skills: Agile Methodologies, Amazon Web Services, Artificial Intelligence, Bilingual Communications, Business Acumen, Data Architecture, Data Governance, Data Modeling,…
Added 2 mins ago
NB
CRO Specialist
National Bank of Canada
Montreal, QC
- Full-time
…processes. You are part of a team of 8 colleagues and report to the Senior Director, Digital Acquisition. Our team stands out for its ability to make data-driven decisions, its strategic…
Added 2 mins ago
NB
Senior Transformation Advisor - Capital Market Operations
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Transformation Advisor within the Capital Markets Operations Reconciliations team at National Bank means acting as a specialist in operational transformation and…
Added 2 mins ago
NB
Senior Analyst Accounting
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Analyst in the NBF (National Bank Financial) Accounting and Regulatory Capital team at National Bank is to act as an expert in all matters related to regulatory…
Added 2 mins ago
NB
Senior Data Scientist
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Data Scientist within the Credit Risk and Climate Stress Testing team at National Bank means contributing to the development of quantitative models and conducting…
Added 2 mins ago
NB
Senior Analyst Regulatory Data and Integration
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Analyst Regulatory Data and Integration within the IT Capital Markets Delivery team at National Bank means acting as a specialist in regulatory data related to…
Added 2 mins ago
NB
Senior Analyst Accounting and Regulatory Capital
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior Analyst in the NBF (National Bank Financial) Accounting and Regulatory Capital team at National Bank is to act as an expert in all matters related to regulatory…
Added 2 mins ago
NB
Manager, Financing Solutions - Private Banking 1859
National Bank of Canada
Montreal, QC
- Full-time
…Banking 1859 team at National Bank means working closely with Senior private Bankers and several internal and external partners as a credit expert. This position allows you to have a…
Added 2 mins ago
MC
Technicien(ne) de l'entrepot magasin / Store Warehouse Associate
Mobilia Canada
QC · Montérégie, QC
- Full-time
…welcoming environment, open to new ideas. It means being close to senior management and being part of a dynamic company that has been in existence for more than 50 years, growing and open…

Apptoza Inc.

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Dec 3, 2026
Posting language: English
Posted: Nov 3, 2026

Original job description

Quality Engineer (QE) / SDET – AI Chatbot Validation

Toronto Hybrid ON ,

Job Description:

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Thanks & regards,

Lakshmi Bhavani ,

Apptoza Inc.

Phone: 678-392-3978 Ext 4640

Phone: 437-291-3224 Ext 1105

Mail id : Lakshmi.bhavani@apptoza.com

Apply About employer

More about this job

Responsibilities

Design and execute functional, integration, regression, API, and AI-focused tests, while building scalable automation frameworks and integrating quality checks into CI/CD pipelines. Analyze defects, test coverage, AI evaluation results, and production feedback, and communicate quality risks and release recommendations to stakeholders.

Requirements

Requires 5+ years of quality engineering or related experience, programming experience, and experience building test automation frameworks. Candidates should have hands-on experience testing AI or chatbot applications, automation tools, APIs and integrations, and understand AI quality concepts and Agile testing practices.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
LLM Testing
Selenium
Playwright
Cucumber/Gherkin
API Testing
CI/CD
JUnit
TestNG
JMeter
Agile

Visa sponsorship

Not detected in the job text

Hiring contact

Lakshmi Bhavani

Hiring contact email

Lakshmi.bhavani@apptoza.com

Keywords

Quality Engineering
AI Chatbot Validation
Artificial Intelligence
Machine Learning
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Accuracy
Relevance
Toxicity
Bias
Response Consistency
Test Automation Frameworks
Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
DevOps
Jenkins
Kubernetes

Report this job