Find work in Canada.

328,209 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 18 mins ago
Senior Cloud DevOps Engineer
Robertson & Company Ltd.
Ottawa, ON
Contract
Robertson is seeking a skilled Senior Cloud DevOps Engineer to join our client in support of an existing vacancy.
Added 33 mins ago
Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP
AceStack
Toronto, ON
Full-time
Role: Sr Software Quality Engineer (AI Focused)
Added 35 mins ago
Software Engineer II
TD
Toronto, ON
Full-time
As a Software Engineer II, you'll join a collaborative team of Engineers, Analysts, Testers and Product partners focused on delivering high-quality technology solutions that create business…
Added 1 hour ago
Quality engineer (AEM)
Insight Global
Toronto, ON
$50 to $55 CAD / hour
Contract
The Digital Platform & Content Management team is searching for an experienced Quality Engineer to join our team. As a Quality Engineer, you will partner with development, architecture,…
Added 1 hour ago
Senior Software Developer Full Stack
TechDoQuest
Toronto, ON
Contract
Reverse engineer existing business logic and applications and re-platform legacy functionality into modern solutions.
Added 1 hour ago
Python Automation Engineer
Yochana
Mississauga, ON
Contract
We are looking for an experienced Python Automation Engineer to design, develop, and maintain automation solutions that improve operational efficiency, reduce manual effort, and enhance…
Added 1 hour ago
Chaos Engineer
Yochana
Toronto, ON
Contract
Design and execute resiliency and chaos testing scenarios across cloud, Kubernetes, APIs, microservices, and distributed environments.
Added 1 hour ago
Lead Platform Engineer (DevOps & MLOps)
Shore Consulting
Toronto, ON
Full-time
Reporting to the Director, Platform Services, the Lead DevOps Engineer is a senior, hands-on technical leader responsible for building, operating, and continuously improving Afflo’s…
Added 1 hour ago
Harness & DevOps Engineer_Hybrid@Any DC
BURGEON IT SERVICES
ON · Ontario, Canada
Contract
Implement and manage DevOps practices and CI/CD pipelines
Added 1 hour ago
Java Full stack With React Developer
NAM Info Inc
Mississauga, ON
Full-time
We are looking for an experienced Java + React Full Stack Engineer to design, develop, test, deploy, and maintain scalable enterprise applications. The ideal candidate will have strong…
Added 1 hour ago
AI Native Engineer
United Software Group Inc
Vancouver, BC
Contract
We're looking for a hands-on Senior AI Native Engineer to design, build, and ship production-grade AI agents, LLM-integrated applications, and developer productivity tooling on AWS. This is…
Added 1 hour ago
Azure Platform Engineer/Azure Cloud Engineer/Cloud Platform Engineer
Tek Leaders Inc
Halifax, NS
Contract
Job Title : Senior Software Engineer – (Azure Platform Engineer/Azure Cloud Engineer/Cloud Platform Engineer)
Added 1 hour ago
Senior Software Developer - Java
Highspring
Montreal, QC
Full-time
…backend solutions. This role is ideal for an experienced software engineer who thrives in cloud-native environments and enjoys building robust, scalable applications using modern Java…
Added 2 hours ago
DevOps Engineer – Canada Any Nearby client Office
BURGEON IT SERVICES
Toronto, ON
Contract
We are looking for a DevOps Engineer with strong hands-on experience in cloud infrastructure, CI/CD, automation, and deployment.
Added 2 hours ago
Senior Site Reliability Application Manager
Bevertec
Toronto, ON
Contract
Experienced Application Manager (Site Reliability Engineer) who is responsible for day-to-day reliability
Added 2 hours ago
AI Automation & Software Engineer
WBM Technologies
Winnipeg, MB · Regina, SK · Saskatoon, SK · Edmonton, AB · Calgary, AB
Full-time
The AI Automation & Software Engineer designs, builds, and supports AI, automation, and software solutions for both customer environments and WBM's internal operations. You'll work across…
Added 4 hours ago
Cloud Infrastructure & DevSecOps Engineer
InfoTrack Canada
Toronto, ON
Full-time
As the Cloud Infrastructure and DevSecOps Engineer, you will own the end-to-end cloud infrastructure and deployment pipeline for InfoTrack Canada. You will unblock critical environment…
Added 11 hours ago
Senior Data Platform Engineer
Norton Rose Fulbright
Toronto, ON
Full-time
The Senior Data Platform Engineer will act as a technical lead for our technologies in any project or initiative, and is responsible for designing, developing, implementing, and supporting…
Added 11 hours ago
Senior Data Platform Engineer
Norton Rose Fulbright
Calgary, AB
Full-time
The Senior Data Platform Engineer will act as a technical lead for our technologies in any project or initiative, and is responsible for designing, developing, implementing, and supporting…
Added 14 hours ago
AI Engineer with Python - (Hybrid)
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with Python with 8+ years of software engineering experience and strong expertise in Python, FastAPI/Flask, AI/LLM applications, REST APIs, data…
Added 14 hours ago
AI Engineer with Python - (Hybrid)
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with Python with 8+ years of software engineering experience and strong expertise in Python, FastAPI/Flask, AI/LLM applications, REST APIs, data…
Added 14 hours ago
AI Engineer with Python - (Hybrid)
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with Python with 8+ years of software engineering experience and strong expertise in Python, FastAPI/Flask, AI/LLM applications, REST APIs, data…
Added 17 hours ago
DevOps Engineer, New Grad
Jobright.ai
Canada
Full-time
…accelerating your route to the best job outcomes. As a New Grad DevOps Engineer, you will help build and operate the infrastructure behind our AI-powered job search platform, focusing on…
Added 19 hours ago
AI Platform Engineer (35577)
Myticas Consulting
Toronto, ON
Contract
5–8+ years of platform engineering, infrastructure, or DevOps experience supporting AI workloads.
Added 19 hours ago
Senior Cloud Engineer – Google Cloud Platform Firebase (35740)
Myticas Consulting
Toronto, ON
Contract
Position: Senior Cloud Engineer – Google Cloud Platform (GCP) / Firebase

AceStack

Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 21, 2026
Posting language: English
Posted: Sep 21, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Sr Software Quality Engineer (AI Focused)

Location: Toronto, ON (Onsite)

Experience: 8+ years

Type: Full Time Permanent

Roles and Responsibilities:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

The role involves designing and executing exploratory, automated, and AI-focused tests to ensure product quality across various platforms. You will collaborate with cross-functional teams to integrate automated testing and AI quality checks into CI/CD pipelines.

Requirements

Candidates must have 8+ years of experience in quality engineering with strong proficiency in programming languages like Java or Python. You should possess hands-on experience with automation frameworks and a deep understanding of AI quality concepts such as hallucination detection and prompt evaluation.

Skills

Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
AI Testing
Test Automation
CI/CD
API Testing
Agile

Visa sponsorship

Not detected in the job text

Keywords

Software Quality Engineer
AI
DevOps
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
API
Microservices
Agile
LLM
Prompt Engineering
Retrieval-Augmented Generation
Kubernetes
AWS
SonarQube
Jira
CSTE
Regression Testing
Quality Assurance
Machine Learning

Report this job