Find work in Canada.

325,392 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 16 mins ago
Senior Chassis Diagnostic Engineer – Driveline & Trailering
General Motors
Markham, ON
Full-time
This role is intended for a highly capable technical engineer who can define diagnostic requirements that will be translated into production-ready embedded controls for Driveline and…
Added 30 mins ago
Sr. Data Analyst -1806 (Asset Management)
Amyantek
Toronto, ON
Contract
1 year contract with Sunlife with a possibility of extension,
Added 1 hour ago
Software Engineer, C#/.NET
Moody's Corporation
Toronto, ON
Full-time
…environment where everyone feels welcome to be who they are - with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways. Moody’s is…
Added 1 hour ago
Infra / Cloud & GenAI Architect
Tata Consultancy Services
Calgary, AB
Full-time
…clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top…
Added 1 hour ago
Test Automation Engineer
Accenture
Mississauga, ON
Full-time
A Technology Sr Analyst with a passion for quality engineering, automation, and modern software development. You have experience through academic projects, internships, co-op placements, or…
Added 1 hour ago
Security Engineer (17-Month Contract)
Varicent
Toronto, ON
Innovate with Purpose: Build impactful solutions for customers worldwide.
Added 1 hour ago
Senior AI Engineer - Evisort AI
Workday
Vancouver, BC · Canada, BC, Vancouver
Full-time
As an AI Engineer, you will help develop tailored user experiences using advanced LLMs, Knowledge Graphs, personalization, and predictive analysis. You will collaborate with other engineers…
Added 1 hour ago
Senior Software Engineer, Security Engineering (Auth0)
Okta
Toronto, ON
…work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with…
Added 1 hour ago
Agentic AI Lead Engineer - Vice President
Citi
Mississauga, ON
Full-time
Architect and build full-stack AI platform components using Python and Angular, including internal large language model fine-tuning interfaces and experiment tracking dashboards.
Added 1 hour ago
Software Quality Engineer (AI Acceleration Global DevOps)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Full-time
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team…
Added 1 hour ago
Security Engineer (17-Month Contract)
Varicent
Toronto, ON
Contract
Innovate with Purpose: Build impactful solutions for customers worldwide.
Added 1 hour ago
AI Developer
Apptoza Inc.
Toronto, ON
Contract
Role : Senior AI Developer – AI/ML, Python, LangChain, RAG & NLP
Added 1 hour ago
AI Platform Engineer (35577)
Myticas Consulting
Toronto, ON
Contract
Experience with Infrastructure-as-Code (Terraform).
Added 1 hour ago
Data Engineer
Hays
Toronto, ON
Contract
We are seeking an experienced Senior Data Engineer with a strong background in Asset Management and modern cloud-based data platforms. The successful candidate will play a key role in…
Added 1 hour ago
Sr. Software Quality Engineer – AI Acceleration / Global DevOps
J&M Group
Toronto, ON
Full-time
5 years of programming experience with Java, Python, Groovy, or a comparable language.
Added 1 hour ago
Sr Ai/Agentic Engineer
Dawn Recruiting Agency
Toronto, ON
$80 to $90 CAD / hour
Full-time
We are seeking a highly skilled Sr Ai/Agentic Engineer to join our dynamic team. In this role, you will leverage your expertise in artificial intelligence and agentic systems to develop…
Added 1 hour ago
Data Engineer
Mycionics Inc.
Kitchener, ON
Full-time
We are seeking a versatile Data Analytics & Backend Engineer to build the backbone of our data ecosystem. While our robots harvest mushrooms, your role is to harvest the data - architecting…
Added 1 hour ago
AI & Computer Vision Engineer
Mycionics Inc.
Kitchener, ON
Full-time
We are seeking a capable AI & Computer Vision Engineer to advance our robotic harvesting and packing capabilities. In this role, you will work directly with our AI Lead to develop, train,…
Added 1 hour ago
Site Reliability Specialist
Robertson & Company Ltd.
Toronto, ON
Contract
Our client is a top financial institution with significant North American holdings. They have operations across most major verticals, including institutional & corporate, wealth management,…
Added 1 hour ago
AI Engineer/developer
Procom
Toronto, ON
Contract
Full-stack programming experience with React/Angular and Python Flask.
Added 2 hours ago
Forward Deployed Engineer (FDE) - GenAI / Agentic AI
Tiger Analytics Inc.
Toronto, ON
Full-time
Tiger Analytics is looking for experienced Forward Deployed Engineer with Gen AI experience to join our fast-growing advanced analytics consulting firm. Our employees bring deep expertise…
Added 2 hours ago
Senior Conversation Bot Engineer - Dialogflow CX
Quantiphi
Toronto, ON
Full-time
Headquartered in Boston, with more than 4,000 professionals worldwide, we partner with global enterprises to deliver large-scale digital, cloud, and AI-driven transformation.…
Added 2 hours ago
Senior Cloud DevOps Engineer
Robertson & Company Ltd.
Ottawa, ON
Contract
Our client is a top financial institution with significant North American holdings. They have operations across most major verticals, including institutional & corporate, wealth management,…
Added 2 hours ago
AI Engineer
Raise
Brampton, ON
Full-time
Raise is currently hiring an AI Engineer on behalf of our client. They’re expanding their team to meet growing needs, making this a unique opportunity to work with an industry leader. Our…
Added 3 hours ago
Agent DevOps Platform Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Full-time
…cloud infrastructure, and security-first CICD ecosystems. The engineer will develop and deploy production-grade AI agents, automate software delivery processes, build secure AWS-based…

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Software Quality Engineer (AI Acceleration Global DevOps)

Toronto, ON, Canada

Job type: Full-time
Posting language: English
Posted: Sep 30, 2026

Apply About employer

Applications open in a new tab.

Original job description

SOFTWARE QUALITY ENGINEER (AI ACCELERATION GLOBAL DEVOPS)

JOB DESCRIPTION

We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.

WHAT YOU WILL DO

Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.

Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.

Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.

Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.

Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.

Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.

Integrate automated testing and AI quality checks into CICD pipelines in partnership with DevOps teams.

Use tools and frameworks such as Selenium, CucumberGherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.

Identify, document, prioritize, and track defects through resolution.

Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.

Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.

Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

ESSENTIAL SKILLS: WHAT YOU WILL NEED TO SUCCEED

5 years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.

5 years of programming experience with Java, Python, Groovy, or a comparable language.

5 years of experience building and maintaining test automation frameworks.

Hands-on experience with Selenium, CucumberGherkin, Playwright, RestAssured, or similar automation technologies.

Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.

Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.

Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.

Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.

Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.

Ability to create effective test data and evaluation datasets for AI-driven functionality.

Strong analytical, problem-solving, communication, and technical documentation skills.

Ability to work effectively in a fast-paced, cross-functional Agile environment.

NICE TO HAVE

Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.

Experience with Git, Bitbucket, Jenkins, CICD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.

Experience testing cloud-native applications and distributed microservice architectures.

Experience with security, performance, accessibility, or reliability testing.

Experience developing automation scripts and reusable testing utilities.

Experience with Tableau or oth

Apply About employer

More about this job

Responsibilities

Develop and execute functional, integration, regression, API, and AI-focused testing strategies, including scalable automation frameworks and evaluation approaches for AI behavior. Integrate quality checks into CI/CD pipelines, track defects and quality trends, and communicate risks and release recommendations to cross-functional stakeholders.

Requirements

Requires at least five years of experience in quality engineering or related work, programming, and building test automation frameworks, with hands-on experience using automation tools and testing APIs, integrations, databases, and microservices. Candidates should also have experience testing AI or machine-learning applications and understand AI quality evaluation, test data creation, and Agile testing practices.

Skills

Quality Engineering
Test Automation
Java
Python
Groovy
AI Testing
Prompt Evaluation
Selenium
Playwright
RestAssured
API Testing
CI/CD
JUnit
TestNG
Agile
Risk-Based Testing

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Quality Assurance
Test Automation
Java
Python
Groovy
Selenium
Cucumber
Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
AI Testing
Machine Learning
Generative AI
Prompt Evaluation
Hallucination Detection
CI/CD
TDD
ATDD
BDD
Risk-Based Testing
Microservices
API Testing
Jenkins
Kubernetes
AWS

Report this job