Find work in Canada.

327,939 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 7 mins ago
Tax Intern – Tax Technology & AI Enablement-EN
CAE
Montreal, QC
Full-time
Added 7 mins ago
Sales Hunter- Sales & Business Development- Canada
Inadev
Toronto, ON
Full-time
Position Inadev’s portfolio - including AI/ML, Cloud Engineering, Application Modernization, SRE/DevOps, Data Engineering, Human-Centered Design, and Ceebit - as high-impact business…
Added 7 mins ago
Industrial Software Validation|
Husky Technologies
Bolton, ON
Full-time
Experience with Agile/Scrum practices and Azure DevOps tools
Added 7 mins ago
Lead Java Developer - Strong in Spring Boot, Struts and Angular
Smart IT Frame LLC
Toronto, ON
Contract
Job Title: Java Pure Backend Developer - Strong in Spring Boot, Struts and Angular
Added 7 mins ago
ArcGIS Developer - Strong in Networks suite of utility products
Smart IT Frame LLC
Calgary, AB
Contract
Job Title: ArcGIS Developer - Strong in Networks suite of utility products
Added 7 mins ago
React Native Application developer
TEKFORTUNE INC
Toronto, ON
Contract
Role : Application Developer - Experience Fullstack
Added 8 mins ago
Distinguished Enterprise Architect, Flights
Priceline
Toronto, ON
Full-time
Champion engineering best practices across key domains, including software design, APIs, DevOps/CI/CD, QA, SRE/observability, cloud, data, AI/ML, security, and experimentation, partnering…
Added 22 mins ago
J10197 -Senior Full Stack Developer Cloud & Platform Engineering
TechDoQuest
Calgary, AB
Contract
Improve CI/CD pipelines and release processes using GitHub Actions or Azure DevOps.
Added 22 mins ago
DevOps Specialist
Techso
Montreal, QC
Full-time
Techso is looking for a DevOps Specialist – AWS and Azure to contribute to challenging projects for clients located across Canada.
Added 22 mins ago
Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP
AceStack
Toronto, ON
Full-time
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
Added 22 mins ago
C-GE-017 – Stagiaire développeur(se) de logiciels-EN
CAE
Montreal, QC
Full-time
Actualiser nos composantes logicielles pour utiliser le pipeline DevOps et améliorer le délai d’exécution pour la préparation de notre suite de produits et de tests systèmes.
Added 22 mins ago
C-GE-055 – Développeur Logiciel [Système d’exploitation & Configuration]
CAE
Montreal, QC
Full-time
Apprendre et utiliser les nouvelles technologies DevOps et conteneurs afin de développer et déployer des solutions logicielles novatrices.
Added 22 mins ago
Senior Full Stack .NET Developer
Techso
Montreal, QC
Full-time
Techso is looking for a Senior Full Stack .NET Developer to help design and develop digital solutions used by our clients across Canada.
Added 22 mins ago
Senior Full Stack Java Developer
Techso
Montreal, QC
Full-time
Techso is looking for a Senior Full Stack Java Developer to help design and develop digital solutions used by leading clients in Montreal and internationally.
Added 22 mins ago
Senior Devops
Archie
Montreal, QC
Full-time
We are hiring a talented Senior Devops who will assist the CTO in helping scale the architecture. The role will also take responsibility for different certification requirements (SOC2 -…
Added 23 mins ago
Territory Partner Manager, Canada
Atlassian
Canada
…Atlassian’s solution portfolios (Service Management, Agile/DevOps, Work Management, and…
Added 23 mins ago
Software Engineer II
TD
Toronto, ON
Full-time
Familiarity with DevOps, automation, and monitoring tools.
Added 23 mins ago
Student, Jr. Analytics and Automation Developer (Winter 2027)
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
Full-time
Assist in advancing the enabling technologies for Automation, Data & Analytics, DevOps, API, and Digital Assets, within Network Services’ and business partners for on-premises or in-cloud…
Added 38 mins ago
C-GE-017 – Stagiaire développeur(se) de logiciels
CAE
Montreal, QC
Full-time
Actualiser nos composantes logicielles pour utiliser le pipeline DevOps et améliorer le délai d’exécution pour la préparation de notre suite de produits et de tests systèmes.
Added 38 mins ago
C-GE-055 – Développeur Logiciel [Système d’exploitation & Configuration]
CAE
Montreal, QC
Full-time
Apprendre et utiliser les nouvelles technologies DevOps et conteneurs afin de développer et déployer des solutions logicielles novatrices.
Added 38 mins ago
Senior Manager, Solution Operations - Business Analysis & Quality
BDO
Barrie, ON · Toronto, ON · Ottawa, ON · Oakville, ON · Markham, ON · Halifax, NS · Calgary, AB
Full-time
Added 52 mins ago
Quality engineer (AEM)
Insight Global
Toronto, ON
$50 to $55 CAD / hour
Contract
…develop and optimize multi-stage CI/CD pipelines (Jenkins, Azure DevOps) integrating automated…
Added 52 mins ago
Senior Software Developer Full Stack
TechDoQuest
Toronto, ON
Contract
We are looking for a Senior Full Stack Developer with strong hands-on experience in Java and Angular to join an enterprise application development team.
Added 52 mins ago
Java Developer
Tata Consultancy Services
Mississauga, ON
$100,000 to $130,000 CAD / year
Full-time
Collaborate with Business Analysts, Architects, QA, and DevOps teams
Added 53 mins ago
GRO Program - Data
Manulife
Toronto, ON
Full-time
Understanding of Agile, Scrum, DevOps, or CI/CD practices.

AceStack

Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 21, 2026
Posting language: English
Posted: Sep 21, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Sr Software Quality Engineer (AI Focused)

Location: Toronto, ON (Onsite)

Experience: 8+ years

Type: Full Time Permanent

Roles and Responsibilities:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

The role involves designing and executing exploratory, automated, and AI-focused tests to ensure product quality across various platforms. You will collaborate with cross-functional teams to integrate automated testing and AI quality checks into CI/CD pipelines.

Requirements

Candidates must have 8+ years of experience in quality engineering with strong proficiency in programming languages like Java or Python. You should possess hands-on experience with automation frameworks and a deep understanding of AI quality concepts such as hallucination detection and prompt evaluation.

Skills

Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
AI Testing
Test Automation
CI/CD
API Testing
Agile

Visa sponsorship

Not detected in the job text

Keywords

Software Quality Engineer
AI
DevOps
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
API
Microservices
Agile
LLM
Prompt Engineering
Retrieval-Augmented Generation
Kubernetes
AWS
SonarQube
Jira
CSTE
Regression Testing
Quality Assurance
Machine Learning

Report this job