Find work in Canada.

329,706 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 2 hours ago
Responsable Architecte IA (Intelligence Artificielle)
Avanade
Montreal, QC
Full-time
Provide continuous advice, best practices, and quality assurance to AI project teams related to delivery approach and strategy.
Added 3 hours ago
Test Automation Engineer
Accenture
Mississauga, ON
Full-time
A Technology Analyst/Associate with a passion for quality engineering, automation, and modern software development. You have experience through academic projects, internships, co-op…
Added 3 hours ago
Senior Software Developer - SQL/Python
Royal Bank of Canada
Toronto, ON
Full-time
Unified Engineer background with full-stack quality assurance perspective.
Added 3 hours ago
Test Automation Engineer
Accenture
Mississauga, ON
Full-time
A Technology Analyst/Associate with a passion for quality engineering, automation, and modern software development. You have experience through academic projects, internships, co-op…
Added 5 hours ago
Senior Systems Engineer
ATS Industrial Automation
Cambridge, ON
Full-time
As a Senior Systems Engineer - Nuclear you are the driving technical force behind problem solving efforts. You will work with the customer, ATS project manager, and ATS design, assembly,…
Added 6 hours ago
Electronics Engineer (Southfield)
Safe Fleet
Coquitlam, BC
Full-time
…vision products in our Vancouver office, forge valves and high-quality nozzles to fight fires, or dream up new ways to protect fleet operators in our Corporate HQ in Kansas City, you’ll…
Added 7 hours ago
QA Engineer (Early Career) (Canada)
Jobright.ai
Canada
Full-time
…your route to the best job outcomes. They are seeking a QA Engineer to design and execute test plans, identify bugs, and collaborate with teams to ensure product…
Added 8 hours ago
Senior Systems Engineer
ATS Automation
Cambridge, ON
As a Senior Systems Engineer - Nuclear you are the driving technical force behind problem solving efforts. You will work with the customer, ATS project manager, and ATS design, assembly,…
Added 9 hours ago
Junior Air Emissions Engineer
Process Ecology Inc
Calgary, AB
Full-time
● Stay updated on relevant air quality regulations and emission reporting standards to ensure clients' adherence to regulatory requirements. Provide expert guidance on compliance matters.
Added 10 hours ago
Quality Engineering III
TD
Toronto, ON
Full-time
…accountability on test approach and test delivery, maximizing automation to provide for fast delivery based on requirements and…
Added 10 hours ago
Quality Engineering III
TD
Toronto, ON
Full-time
…accountability on test approach and test delivery, maximizing automation to provide for fast delivery based on requirements and…
Added 11 hours ago
Semiconductor Packaging Modeling and Simulation Engineer
onsemi
Waterloo, ON
Full-time
…Canada. As a semiconductor packaging modeling and simulation engineer, you will have the opportunities to support new power module development and new product design, assembly and process,…
Added 11 hours ago
Senior Air Emissions Engineer
Process Ecology Inc
Calgary, AB
Full-time
We are seeking a highly skilled and motivated Senior Air Emissions Engineer (P.Eng.) to join our dynamic team. In this role, you will play a crucial part in helping our emissions management…
Added 12 hours ago
Technical Consultant III (35732)
Myticas Consulting
Toronto, ON
Full-time
Technical Consultant III (Software Engineer, Senior/Lead)
Added 14 hours ago
Project Manager
Pack-Smart Inc.
Concord, ON
$100,000 to $140,000 CAD / year
Full-time
At Pack-Smart Inc. Automation, creativity and innovation are at our core. We’re a global leader in high-speed automation solutions for the packaging, print, and converting industries. For…
Added 15 hours ago
QA Engineer (Early Career) (Canada)
Jobright.ai
Canada
Full-time
…your route to the best job outcomes. They are seeking a QA Engineer to design and execute test plans, identify bugs, and collaborate with teams to ensure product…
Added 16 hours ago
QA Playwright Engineer
Envision Technology Solutions
Toronto, ON
Full-time
Experience working with Postman and API automation testing using Pytest.
Added 16 hours ago
Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP
AceStack
Toronto, ON
Full-time
5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
Added 17 hours ago
Quality engineer (AEM)
Insight Global
Toronto, ON
$50 to $55 CAD / hour
Contract
The Digital Platform & Content Management team is searching for an experienced Quality Engineer to join our team. As a Quality Engineer, you will partner with development, architecture,…
Added 17 hours ago
3rd Class Power Engineer
Alberta-Pacific Forest Industries Inc.
Boyle, AB
Full-time
Carry out quality assurance tasks and ensure compliance with testing protocols.
Added 17 hours ago
Staff DevSecOps Specialist
AlayaCare
Montreal, QC
Build the technical control automation that makes SOC 2, HIPAA, and customer assurance continuous, partnering with GRC so evidence is a by-product of how systems run.
Added 17 hours ago
Automation Engineer - API/Data/SQL
PLATO
Ottawa, ON · Calgary, AB · Sault Ste. Marie, ON · Vancouver, BC · Prince Albert, SK · Regina, SK · Gatineau, QC · BC · Winnipeg, MB · Fredericton, NB · Toronto, ON · Halifax, NS
$90,000 to $110,000 CAD / year
Full-time
…database reconciliation, and regression testing. Build reusable automation frameworks, integrate test suites with CI/CD pipelines, and produce execution evidence and reporting to support…
Added 19 hours ago
Chef technique laboratoire
Sicame Energie
Brossard, QC
Full-time
…the energy and industrial sectors, with a strong emphasis on quality, safety, and collaboration. SICAME is a global industrial group specializing in electrical equipment and solutions for…
Added 1 day ago
AI Architect, Manager
Avanade
Toronto, ON
Full-time
Provide continuous advice, best practices, and quality assurance to AI project teams related to delivery approach and strategy.
Added 2 days ago
Test Automation Engineer
Montreal Robot Inc.
Montreal, QC
Full-time
Solid understanding of SDLC, STLC best/proven practices in Software Testing and Quality Assurance, and Risk Based Testing.

AceStack

Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 21, 2026
Posting language: English
Posted: Sep 21, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Sr Software Quality Engineer (AI Focused)

Location: Toronto, ON (Onsite)

Experience: 8+ years

Type: Full Time Permanent

Roles and Responsibilities:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

The role involves designing and executing exploratory, automated, and AI-focused tests to ensure product quality across various platforms. You will collaborate with cross-functional teams to integrate automated testing and AI quality checks into CI/CD pipelines.

Requirements

Candidates must have 8+ years of experience in quality engineering with strong proficiency in programming languages like Java or Python. You should possess hands-on experience with automation frameworks and a deep understanding of AI quality concepts such as hallucination detection and prompt evaluation.

Skills

Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
AI Testing
Test Automation
CI/CD
API Testing
Agile

Visa sponsorship

Not detected in the job text

Keywords

Software Quality Engineer
AI
DevOps
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
API
Microservices
Agile
LLM
Prompt Engineering
Retrieval-Augmented Generation
Kubernetes
AWS
SonarQube
Jira
CSTE
Regression Testing
Quality Assurance
Machine Learning

Report this job