Find work in Canada.

327,873 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 5 mins ago
Data Engineer (Early Career) (Canada)
Jobright.ai
Canada
Full-time
…the job search process. They are seeking an early-career Data Engineer to design and build data pipelines, ensuring data quality and collaborating with analytics and product…
Added 5 mins ago
AI Engineer with Python - (Hybrid)
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with Python with 8+ years of software engineering experience and strong expertise in Python, FastAPI/Flask, AI/LLM applications, REST APIs, data…
Added 5 mins ago
AI Engineer
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with 7+ years of experience in software and AI engineering to design, develop, and deploy AI/ML solutions. The ideal candidate will have strong…
Added 5 mins ago
AI Engineer with Python - (Hybrid)
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with Python with 8+ years of software engineering experience and strong expertise in Python, FastAPI/Flask, AI/LLM applications, REST APIs, data…
Added 5 mins ago
AI Engineer
S M Software Solutions Inc
Mississauga, ON
Full-time
We are seeking an experienced AI Engineer with 7+ years of experience in software and AI engineering to design, develop, and deploy AI/ML solutions. The ideal candidate will have strong…
Added 5 mins ago
Platform Engineer - AI/ML Infrastructure
Zodiac Solutions, Inc
Toronto, ON
Full-time
Were seeking a skilled Platform Engineer to deploy and manage our AI/ML infrastructure, e.g LlamaIndex Cloud and KDB.AI applications on Kubernetes Platform.
Added 5 mins ago
Python Developer - AI Engineer
Highspring
Montreal, QC
Full-time
Highspring is seeking a Senior Python Developer (AI Engineer) to join a growing Artificial Intelligence and Machine Learning team. In this role, you will contribute to the design,…
Added 5 mins ago
Senior Data Engineer
Extendicare
Markham, ON
Full-time
Advanced experience with Microsoft SQLrver, SSIS, Python, and ETL development methodologies.
Added 5 mins ago
Privileged Access Engineer
Tekgence Inc
Montreal, QC
Contract
Privileged Access Engineer (PAM) with AI Capabilities
Added 6 mins ago
Staff Software Engineer (Infrastructure)
Amplitude
Vancouver, BC
…and Square - build better products and digital experiences. With powerful AI Agents embedded across our platform, teams can analyze, test, and optimize user experiences faster than ever.…
Added 22 mins ago
DevOps Engineer
Infosys
ON
Collaborate with Dev, QA, and Ops teams for seamless releases
Added 52 mins ago
Senior Machine Learning Systems Engineer (CAD)
PointClickCare
Mississauga, ON
Full-time
The Senior Machine Learning Systems Engineer will work closely with the Product and Engineering teams to design, build, and operate the machine learning platform that enables teams across…
Added 1 hour ago
Python Developer
Dexian
Mississauga, ON
Other
Experience with FastAPI, Flask, or similar Python frameworks.
Added 1 hour ago
Technology Lead - Databricks Admin
Infosys
ON
Infosys is seeking an experienced Databricks Administrator with strong expertise in managing, securing, and optimizing Databricks environments on cloud platform: AWS. The ideal candidate…
Added 1 hour ago
Software/Firmware Engineer Intern
Marvell Technology
Toronto, ON · CA-ON - Toronto - TOR
Full-time
challenges with the most outstanding group of collaborators in the industry. Join our team of world-class
Added 1 hour ago
Firmware Engineer Intern
Marvell Technology
Toronto, ON · CA-ON - Toronto - TOR
Full-time
…years, we move, store, process, and secure the world’s data with semiconductor solutions designed…
Added 1 hour ago
Senior Machine Learning Systems Engineer (CAD)
PointClickCare
Mississauga, ON
$154,000 to $193,000 CAD / year
Full-time
The Senior Machine Learning Systems Engineer will work closely with the Product and Engineering teams to design, build, and operate the machine learning platform that enables teams across…
Added 2 hours ago
Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP
AceStack
Toronto, ON
Full-time
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
Added 4 hours ago
Systems Validation Engineer – Data Center GPU
AMD
Markham, ON
$120,800 to $181,200 USD / year
Full-time
As a Systems Validation Engineer within the Datacenter and GPU Accelerated Processing division, you will drive SOC and system/rack level validation, triage and debug for the AMD Data Center…
Added 4 hours ago
Forward Deployed Engineer (FDE) (Mid/Senior Level)
Salesforce Partner Canada
Toronto, ON
Full-time
…You'll work as part of a delivery team, partnering closely with a Deployment Strategist (Strategic Builder - a customer-facing advisor who shapes AI strategy and drives adoption) to…
Added 5 hours ago
Principal AI/ML Engineer
lululemon
Vancouver, BC
Full-time
…platforms and services that enable the enterprise to operate with intelligence at scale. The team leads the design and delivery of a trusted unified data foundation, AI-driven data…
Added 5 hours ago
AI/ML Engineer
lululemon
Vancouver, BC
Full-time
As an AI/ML Engineer, you will contribute to the design and implementation of AI/ML systems across the full model lifecycle from dataset curation, feature engineering, and model training…
Added 5 hours ago
Senior Software Developer - Full Stack [CONSUMER]
HelloFresh
Toronto, ON
We are looking for an engineer to help implement solutions & write beautiful code, working with various team members as we build out our consumer facing applications & the infrastructure…
Added 5 hours ago
Senior Security Engineer
PheedLoop
Toronto, ON
Full-time
Comfort in modern stacks like Python / Django, React, and AWS. You don't need to be a senior software engineer, but you can read application code, understand a deployment pipeline, and…
Added 5 hours ago
Full-Stack Web Engineer
White Widget
MB · Back, MB
Full-time
Each engineer in White Widget takes responsibility over their code and projects. We endeavor to create code that’s clean with legibility, reusability, testability, and maintainability in…

AceStack

Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 22, 2026
Posting language: English
Posted: Sep 22, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Sr Software Quality Engineer (AI Focused)

Location: Toronto, ON (Onsite)

Experience: 8+ years

Type: Full Time Permanent

Roles and Responsibilities:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

The role involves designing and executing automated and AI-focused tests to ensure product quality across various platforms. You will collaborate with cross-functional teams to integrate quality checks into CI/CD pipelines and validate AI-enabled features.

Requirements

Candidates must have over 5 years of experience in quality engineering and test automation using languages like Java or Python. Proficiency in AI quality concepts and experience with testing frameworks such as Selenium and Playwright is required.

Skills

Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
JMeter
API Testing
AI Quality Assurance
CI/CD
Test Automation
Agile
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Software Quality Engineer
AI
DevOps
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Microservices
API
Agile
Generative AI
LLM
Prompt Engineering
Retrieval-Augmented Generation
Kubernetes
AWS
Git
Jenkins
SonarQube
Jira
CSTE

Report this job