Find work in Canada.

327,931 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 6 mins ago
Data Scientist
SPECTRAFORCE
Toronto, ON · Scarborough, ON
Contract
Partner with various line of business teams, Data Engineering, DevOps, and platform teams to ensure scalable, production-ready analytics solutions are deployed and maintained.
Added 6 mins ago
Lead Cloud Platform Architect, GTCS
Manulife
Toronto, ON · Waterloo, ON
Full-time
Designs, governs, and scales an organization's core cloud infrastructure, internal developer platforms, and multi-cloud strategies.
Added 36 mins ago
Sr. Full Stack Developer (.NET, C#, Angular)
Insight Global
Toronto, ON
$110,000 to $134,000 CAD / year
Full-time
True full-stack developer who can work across the front end (Angular), back end (C#/.NET), and database (SQL)
Added 1 hour ago
Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP
AceStack
Toronto, ON
Full-time
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
Added 1 hour ago
Quality Engineering Lead
Infosys
BC
Experience in Agile, Scrum, SAFe, DevOps, CI/CD, Shift-Left, and Shift-Right testing practices.
Added 1 hour ago
Lead Consultant-SAP Portal – S/4HANA Migration
Infosys
Quebec, QC
Knowledge of Agile methodology and DevOps tools.
Added 1 hour ago
Junior Software Developer (contract position) / Développeur débutant de logiciels (poste contractuel)
CCMTA
Ottawa, ON
Full-time
Job Title: Junior Software Developer (contract position)
Added 3 hours ago
Manager, Software Engineering
AltaML
Toronto, ON
Full-time
Lead or actively participate in cross-pod technical guilds (e.g., Frontend, AI/ML, DevOps)
Added 3 hours ago
Industrial Software Validation|
Husky Technologies
Bolton, ON
Full-time
Experience with Agile/Scrum practices and Azure DevOps tools
Added 4 hours ago
Director of Engineering
TAIRC
ON · Regional Municipality of York, ON
Volunteer
Expertise in software architecture, DevOps practices, and infrastructure planning.
Added 4 hours ago
Senior Software Developer - Full Stack [CONSUMER]
HelloFresh
Toronto, ON
Apply DevOps practices and engineering best practices to build, deploy, and operate reliable software
Added 4 hours ago
DevOps/Sysadmin engineer
1WorldOnline R&D Center (Business Automatics)
Montreal, QC · Urban agglomeration of Montreal, QC
Full-time
Now we are looking for DevOps/Sysadmin engineer to our team.
Added 4 hours ago
DevOps Engineer
White Widget
MB · Back, MB
Full-time
Understand that security and DevOps go hand-in-hand: knowledge of OWASP a plus
Added 4 hours ago
Full-Stack Web Engineer
White Widget
MB · Back, MB
Full-time
Interested in learning or seasoned with DevOps, Continuous Integration / Continuous Delivery, Jenkins CI, Apache, NGINX
Added 4 hours ago
QA Engineer
White Widget
MB · Back, MB
Full-time
Understand that security and DevOps go hand-in-hand: knowledge of OWASP a plus
Added 5 hours ago
Director Solution Architect
Royal Bank of Canada
Toronto, ON
Full-time
Knowledge of development languages like .NET, Java, Spring, Python, Docker containers, Kubernetes, Devops and JavaScript.
Added 7 hours ago
Responsable Architecte IA (Intelligence Artificielle)
Avanade
Montreal, QC
Full-time
Added 7 hours ago
Senior Software Developer
Royal Bank of Canada
Vancouver, BC
Full-time
We're seeking a Senior Software Developer to join our engineering team. You'll design, build, and maintain scalable applications across our full technology stack, working with modern…
Added 7 hours ago
Senior Backend Developer
RemitBee™
Mississauga, ON
$60,000 to $90,000 CAD / year
Full-time
…GraphQL. You'll work onsite in a small agile team alongside QA, DevOps and the founders, which means you're in the room when requirements get decided rather than receiving them as…
Added 7 hours ago
Test Automation Engineer
Accenture
Mississauga, ON
Full-time
Understanding of software development lifecycle (SDLC), software testing lifecycle (STLC), Agile delivery methodologies, and DevOps practices.
Added 8 hours ago
Lead Site Reliability Engineer - Database Management
SimCorp
Toronto, ON
Full-time
Linux for DBAs, Shell scripting, managing large data warehouse DBs, Infrastructure as Code, CI/CD pipelines, Azure DevOps for deployment automation, and willingness to learn new…
Added 8 hours ago
Senior Software Developer - SQL/Python
Royal Bank of Canada
Toronto, ON
Full-time
Assist DevOps/support teams in troubleshooting production issues and performance optimization
Added 8 hours ago
Test Automation Engineer
Accenture
Mississauga, ON
Full-time
Understanding of software development lifecycle (SDLC), software testing lifecycle (STLC), Agile delivery methodologies, and DevOps practices.
Added 9 hours ago
Industrial Software Validation|
Husky Technologies
Bolton, ON
Full-time
Experience with Agile/Scrum practices and Azure DevOps tools
Added 9 hours ago
Senior Software Developer
RBC
Toronto, ON · Vancouver, BC
Full-time
We're seeking a Senior Software Developer to join our engineering team. You'll design, build, and maintain scalable applications across our full technology stack, working with modern…

AceStack

Sr Software Quality Engineer (AI Focused) : Toronto ON// FTP

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 22, 2026
Posting language: English
Posted: Sep 22, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Sr Software Quality Engineer (AI Focused)

Location: Toronto, ON (Onsite)

Experience: 8+ years

Type: Full Time Permanent

Roles and Responsibilities:

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5+ years of programming experience with Java, Python, Groovy, or a comparable language.

5+ years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or other analytics and visualization platforms.

CSTE certification or an equivalent quality engineering certification.

Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

The role involves designing and executing automated and AI-focused tests to ensure product quality across various platforms. You will collaborate with cross-functional teams to integrate quality checks into CI/CD pipelines and validate AI-enabled features.

Requirements

Candidates must have over 5 years of experience in quality engineering and test automation using languages like Java or Python. Proficiency in AI quality concepts and experience with testing frameworks such as Selenium and Playwright is required.

Skills

Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
JMeter
API Testing
AI Quality Assurance
CI/CD
Test Automation
Agile
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Software Quality Engineer
AI
DevOps
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Microservices
API
Agile
Generative AI
LLM
Prompt Engineering
Retrieval-Augmented Generation
Kubernetes
AWS
Git
Jenkins
SonarQube
Jira
CSTE

Report this job