Find work in Canada.

484,419 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 1 month ago
Software Development Engineer, WW Deals & Promotions
Amazon
Vancouver, BC
…Amazon shoppers around the globe? As a Software Development Engineer II on our WW Deals and Promotions team in Vancouver, you'll have the opportunity to do just…
Added 1 month ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 1 month ago
FG
Machine Learning Engineer, Associate Director
Fitch Group, Inc.
Toronto, ON
- Full-time
Machine Learning Engineer, Associate Director – AI Innovation Teams
Added 1 month ago
A
Forward Deployed Engineer
Arcadia
Toronto, ON
- $120,000 to $150,000 CAD / year
- Full-time
We are working with a fast-growing AI software company, and they are looking to hire a Forward Deployed Engineer in Toronto to help bring AI into real-world healthcare environments. It's AI…
Added 1 month ago
N
Staff Engineer - Inference /AI
Nutanix
Vancouver, BC
- $171,000 to $257,000 CAD / year
- Full-time
…enabling organizations to easily build, fine-tune, and run Generative AI, Large Language Models (LLMs), and next-generation Agentic AI applications without the complexity of managing AI…
Added 1 month ago
TC
AI Deployment & Solutions Lead
Tata Consultancy Services
Toronto, ON
- $115,000 to $165,000 CAD / year
- Full-time
The Forward Deployment Engineer (FDE) Technical Lead is a hands-on engineering leader responsible for solving complex problems by combining software engineering, AI/GenAI, data, cloud,…
Added 1 month ago
B&
Expert Senior Manager, AI Engineering
Bain & Company
Zurich, ON
- Full-time
The Expert Senior Manager / Associate Partner AI Engineer will architect, build, and scale next-generation generative AI systems and agentic solutions for Bain’s clients. As a leader in the…
Added 1 month ago
V
AI/ML Engineer
Vanguard
Toronto, ON
- Full-time
At Vanguard's Corporate Services division, we are seeking a Machine Learning/ AI Engineer to design, build, and scale enterprise AI/ML solutions that drive business innovation and support…
Added 1 month ago
C
Sr Data & AI Governance Architect (Purview Platform Lead)
CGI
Toronto, ON
- Full-time
Develop data usage policies to support AI and Generative AI initiatives
Added 1 month ago
K
Staff Software Engineer
kadence
Toronto, ON
- Full-time
They’re looking for a Staff Software Engineer, AI to provide hands-on technical leadership across the design, development, and scaling of enterprise-grade AI systems. This is a senior…
Added 1 month ago
C
Data Analyst
Citylitics
Toronto, ON
- $65,000 to $80,000 CAD / year
- Full-time
…hand the engineering work to the team. You don’t need to be an engineer, but you need enough confidence in SQL and data structures to know what’s realistic. You’re also comfortable…
Added 1 month ago
HC
Research Engineer – Multimodal AI & Interaction
Huawei Canada
Markham, ON
- Full-time
Technical depth in multimodal learning, speech/audio, computer vision, NLP, generative AI, or foundation models
Added 1 month ago
CI
Software Engineer (Full Stack) - 6 Month Contract
Citylitics Inc.
Toronto, ON
- $100,000 to $140,000 CAD / year
- Contract
We believe that Data and AI will play an outsized role in our future, so we equip every team member with access to Generative AI tools and our full Data Universe to enhance their…
Added 2 months ago
BV
Senior Full Stack Engineer, AI
Big Viking Games
Toronto, ON
- $100,000 to $150,000 CAD / year
- Full-time
Big Viking Games is hiring a Senior Full Stack Engineer to build AI-enabled products, workflows, tools, and systems that help turn creative direction into production-ready game content at…
Added 1 month ago
TA
Manager, Analytics Consulting
Tiger Analytics
Canada
- Full-time
Ability to learn new technologies quickly without needing to be a deep software engineer
Added 1 month ago
CI
Data Analyst
Citylitics Inc.
Toronto, ON
- $65,000 to $80,000 CAD / year
- Full-time
…hand the engineering work to the team. You don't need to be an engineer, but you need enough confidence in SQL and data structures to know what's realistic. You're also comfortable…
Added 1 month ago
P
Software Engineer II
Planview
Vancouver, BC
- Full-time
We’re seeking an Intermediate Software Engineer to join our team in Vancouver, BC. In this role, working closely with our senior team members, you will design, implement, and test features…
Added 1 month ago
ES
Senior Content Strategist - AI Strategy
EPAM Systems
Canada
- Full-time
…with emerging regulations, and optimize content visibility in generative search…
Added 1 month ago
O
Senior Data Engineer, Data Integration & Performance Platform (12-Month Contract)
OMERS
Toronto, ON · Head Office Toronto
- Full-time
Custom Solutions. Engineer data services and APIs that close gaps between Aladdin native functionality and what our investment, risk, performance, and finance teams require.
Added 1 month ago
O
Data Engineer, Data Integration & Performance Platform (12-Month Contract)
OMERS
Toronto, ON · Head Office Toronto
- Full-time
…simply complete tickets. We are looking for a future senior engineer - someone who wants to learn how enterprise data platforms are built, operated, and scaled, and who is willing to do the…
Added 1 month ago
Senior Data Engineer
Capgemini
Calgary, AB
Added 1 month ago
Senior Visualization Professional
Capgemini
Toronto, ON
- Microsoft Fabric Analytics Engineer Associate
Added 1 month ago
Senior Data Engineer - Calgary
Capgemini
Calgary, AB
Added 2 months ago
C
Senior Java Developer, Applications Development – Assistant Vice President
Citi
Mississauga, ON
- Full-time
…process high-volume, latency-sensitive workloads. If you are an engineer who takes full ownership of what you build and thrives in a fast-moving, technically demanding environment, this is…
Added 1 month ago
C
Generative AI Engineer -Vice President
Citi
Mississauga, ON
- Full-time
We're searching for a highly skilled and experienced senior engineer and Python expert to lead the design and development of the various AI-related technologies as part of the Services Tech…

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job