Find work in Canada.

520,840 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 3 mins ago
CP
Senior Manager, Cybersecurity Operations & Vulnerability Management
CAAT Pension Plan
Toronto, ON · Head Office
- Full-time
Reporting to the Senior Director, Cybersecurity Operations and Vulnerability Management, the Senior Manager, Security Operations & Vulnerability Management leads CAAT’s enterprise security…
Added 3 mins ago
Data Engineer
CareRx
Toronto, ON
At CareRx, we are shaping the future of senior care through pharmacy services that make a real difference. As Canada’s trusted leader in specialty pharmacy services for long-term care,…
Added 4 mins ago
SC
Chef de Projet Electronique (Senior)
SII Canada
Montreal, QC
- Full-time
The role is part of a high-technology engineering environment related to satellite systems. The successful candidate will need to quickly understand the technical context of the projects,…
Added 4 mins ago
O
Sr. Software Developer
OpenText
Richmond Hill, ON
- Full-time
The Senior Software Developer is a hands-on technical contributor and emerging technical lead who designs, develops, and supports Java and Spring Boot microservices running on Google Cloud…
Added 4 mins ago
O
Manager, Software Development
OpenText
Richmond Hill, ON
- Full-time
The Manager, Software Development leads the newly formed engineering team delivering the Image & Fax Aviator Platform. This first-line manager will recruit, onboard, coach, and directly…
Added 33 mins ago
Programmer Analyst Advisory(Mainframe Developer)
Scotiabank
Toronto, ON · Scarborough, ON
The Senior Mainframe Developer is responsible for the design, development, maintenance, and support of Commercial Lending applications. The successful candidate will work closely with…
Added 33 mins ago
Manager, Analytics
Scotiabank
Toronto, ON
…and performance across Scotiabank. This role partners with senior stakeholders to solve complex business challenges, advance data-driven decision-making, and identify opportunities for…
Added 48 mins ago
Airframe Materials & Processes (M&P) Specialist
Capgemini
Montreal, QC
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies…
Added 48 mins ago
MH
Senior Growth Marketing Manager
Maya HTT
Remote, Canada
- Full-time
- Remote
Maya HTT is a leading developer of digital engineering solutions and a trusted Siemens Digital Industries Software partner. For more than 40 years, we have helped manufacturers innovate…
Added 48 mins ago
MP
Sr. Project Coordinator - ICI Construction
Michael Page
ON · Ontario, Canada
- $70,000 to $80,000 CAD / year
- Full-time
As a Senior Project Coordinator, you will play a key role in the planning, coordination, and execution of ICI and residential new build projects from pre-construction through closeout.…
Added 1 hour ago
RU
Senior Data Engineer
RSM US LLP
Calgary, AB · Toronto, ON
- Full-time
We are seeking a skilled Business Intelligence and Data Engineering professional with a strong background in design and development, data modeling, and business analytics. This individual…
Added 1 hour ago
2I
Senior DevOps/Cloud Engineer
2iSolutions Inc.
Toronto, ON
- Contract
Our Toronto-based client is hiring a DevOps/Cloud Engineer – Senior for a 4-month hybrid contract opportunity in Toronto, ON. The resource must be available to work onsite at the hiring…
Added 1 hour ago
ZS
RPA Platform Engineer
Zodiac Solutions, Inc
Toronto, ON
- Full-time
The Senior Platform Engineer develops, maintains, and manages Automation platform on premise, AWS cloud and vendor SaaS to enable automation across the bank and core operations enabling the…
Added 1 hour ago
CI
Technical Program Manager -- AWADC6077951
Compunnel Inc.
Montreal, QC
- Contract
Experience delivering complex technical programs within cloud, cybersecurity, infrastructure, risk, or software engineering environments.
Added 1 hour ago
XE
Senior Technical Support Specialist
XR Extreme Reach
Toronto, ON
- Full-time
The Senior Technical Support Specialist is a highly skilled, technically focused position who operates at the intersection of support, engineering, and automation. This role serves as a…
Added 1 hour ago
SL
Senior Microsoft 365 Engineer
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
As a Senior Microsoft 365 Engineer, you will solve complex Microsoft 365 engineering challenges and lead technical initiatives from requirements and design through implementation and…
Added 1 hour ago
SL
Senior Data Scientist
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
Reporting to the Director, Data Science, as a Senior Data Scientist you will focus on supporting Canadian business units in accelerating the growth and application of advanced analytics in…
Added 1 hour ago
SL
Senior Data Engineer
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
…Life’s Information Security organization is enhancing its data engineering, platform, analytics, and insights capabilities through new tools and, most importantly, new…
Added 1 hour ago
K
Director - Technology
KPMG
ON · Toronto, Ontario
- Full-time
Education: University degree in technology, computer science, engineering, business, or a related discipline, or equivalent relevant professional experience.
Added 1 hour ago
Director, Engineering, Real Estate Secured Lending (RESL)
Scotiabank
Toronto, ON
The Director, Insurance Engineering is responsible for the engineering execution and delivery of technology solutions that support the Bank’s platforms. This role ensures the timely…
Added 1 hour ago
Business Unit Director - Supply Chain
Celestica International LP
Newmarket, ON
The Business Office & Supply Chain Director is a senior leadership role accountable for integrating customer program management, business office operations, site manufacturing execution,…
Added 1 hour ago
VS
Java AWS Developer|| CALGARY, CN (Onsite)
Verito Solutions Inc
Calgary, AB
- Contract
The Intermediate AWS Developer supports the delivery of cloud‑native and serverless solutions within enterprise client environments. This role contributes to consulting engagements by…
Added 1 hour ago
MF
Director Investment Research
Mackenzie Financial Corporation
Toronto, ON · Greater Toronto Area, ON
- Other
Technical depth across cloud architecture (AWS or similar), data engineering, APIs, Python and SQL, enough to guide design decisions and review the team's work
Added 1 hour ago
RI
Senior Full Stack Engineer
Remarcable, Inc.
Remote, Canada
- $140,000 to $190,000 CAD / year
- Full-time
- Remote
We are expanding our Vancouver engineering team - our core product and development hub - and looking for a Senior Full Stack Engineer to take technical ownership of high-impact product…
Added 1 hour ago
Senior Fullstack Developer (Python) - AI features team
AlayaCare
Montreal, QC
We are seeking a Senior Full Stack Developer to join our AlayaLabs team within the Data & Intelligence division. Reporting to the Engineering Manager, you will contribute to both frontend…

Ardent SoftSol Inc.

Quality Engineer (QE) / SDET – AI Chatbot Validation

Brampton, ON, Canada

$38 to $40 CAD / hour · Contract

Apply About employer

Applications open in a new tab.

Job details

Pay: $38 to $40 CAD / hour
Job type: Contract
Apply by: Nov 27, 2026
Posting language: English
Posted: Oct 28, 2026

Original job description

Job Description:

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

What You Will Do:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

What You Will Need to Succeed:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Design and execute exploratory, automated, functional, integration, and AI-focused tests, including validation of chatbot responses, prompts, accuracy, safety, reliability, and performance. Build and maintain automation frameworks, integrate quality checks into CI/CD pipelines, track defects, analyze quality results, and communicate risks and release recommendations to stakeholders.

Requirements

Requires 5+ years of quality engineering, test automation, or software development experience, including 5+ years programming and building automation frameworks. Candidates should have experience testing AI or machine-learning applications and APIs, familiarity with automation and testing tools, and knowledge of AI quality evaluation, Agile practices, and continuous testing.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Chatbot Validation
LLM Testing
Selenium
Playwright
Cucumber/Gherkin
RestAssured
API Testing
CI/CD
JUnit
TestNG
Agile

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Quality Assurance
Test Automation
Artificial Intelligence
Machine Learning
AI Chatbots
Large Language Models
Prompt Evaluation
Hallucination Detection
Grounding
Retrieval-Augmented Generation
Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
DevOps
TDD
ATDD
BDD
Risk-Based Testing
Microservices
Kubernetes

Report this job