Find work in Canada.

348,403 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 25 days ago
P
Senior Software Engineer -Waterloo
PointClickCare
Kitchener, ON
- Full-time
· Experience writing clean code that performs well at scale using Java
Added 25 days ago
M
Java Software Engineer
mthree
Montreal, QC
- Full-time
Une banque d’investissement internationale de premier plan recherche un(e) développeur(se) Java pour rejoindre son équipe Capital Technology.
Added 25 days ago
A
Développeur Senior SRE
Astek
Montreal, QC
- Full-time
Maîtrise d'un ou plusieurs langages tels que Python, Go, Java, C++, Ruby, JavaScript
Added 25 days ago
P
Agent & DevOps Platform Engineer
PeoplePilot
Toronto, ON
- Full-time
We are looking for an Agent & DevOps Platform Engineer to join our team in Toronto, ON (Onsite). The ideal candidate will have strong hands-on experience in AWS, Python, CI/CD, Kubernetes,…
Added 25 days ago
P
Senior Software Engineer -Waterloo
PointClickCare
Waterloo, ON
- $142,000 to $158,000 CAD / year
- Full-time
Experience writing clean code that performs well at scale using Java
Added 25 days ago
TC
Sr Software Quality Engineer (AI Focused)
Tata Consultancy Services
Toronto, ON
- $90,000 to $110,000 CAD / year
- Full-time
Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
Added 25 days ago
P
Senior Software Quality Engineer – AI
PeoplePilot
Toronto, ON
- Full-time
We are seeking a Senior Software Quality Engineer – AI Focused to drive quality, reliability, and automation for AI-enabled software products. The role will collaborate with Development,…
Added 25 days ago
IG
Sr. Integration Architect - Automation
Infotree Global Solutions
Toronto, ON
- Contract
Job Title: Sr Integration Engineer (Intelligent Automation)
Added 25 days ago
DevOps/Cloud Engineer
impact.com
Victoria, BC
As a DevOps/Cloud Engineer, you will be responsible for working hands-on to design, develop and implement processes that automate the build, staging, release & deployment of the software…
Added 25 days ago
P
Full Stack Engineer
PeoplePilot
Toronto, ON
- $110,000 to $120,000 CAD / year
- Full-time
Design, develop, and maintain high-quality, scalable, and maintainable Java applications and services using clean code principles and established design patterns.
Added 25 days ago
SS
Senior Java Software Engineer
Soho Square Solutions
Toronto, ON
- Contract
Frontend: Angular; backend: Spring Boot / Java
Added 25 days ago
F
Staff Product Engineer - Brand
Forerunner
Kitchener, ON
- Full-time
As a Staff Product Engineer on the Brand pillar, you will be responsible for helping teams execute on our hardest features, coaching engineers, and working alongside product, design, and…
Added 25 days ago
P
Senior Java Software Engineer
PeoplePilot
Toronto, ON
- $100,000 to $120,000 CAD / year
- Full-time
Design, develop, and maintain high-quality, maintainable Java applications using clean code principles, SOLID principles, and established design patterns.
Added 25 days ago
CS
Java Integration Developer
Cloud SynApps Inc.
Mississauga, ON
- Contract
Hands-on engineer responsible for building and configuring the Red Hat-hosted HIP layer - Apache Camel microservices on Spring Boot, and API exposure/management through 3Scale. Implements…
Added 26 days ago
AI
Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Working experience with at least one additional language or ecosystem such as Java, .NET, Groovy, or Node.js.
Added 25 days ago
J
Java Engineer
Jobright.ai
Canada
- Full-time
…search process and helps users reach better job outcomes. The Java Engineer develops and maintains backend services, APIs, database integrations, tests, and technical documentation while…
Added 25 days ago
C
Crypto Engineer (Contract)
Capco
Toronto, ON
- Full-time
As a Contract Crypto Engineer at Capco, you’ll design, develop, and support cryptographic solutions that protect data at rest and in transit across complex enterprise environments.
Added 25 days ago
Software Engineer, Intern (Summer 2027) - TOR
DoorDash Canada
Toronto, ON
We believe interns are essential to our mission of attracting and retaining top talent. During our 12-week Software Engineer internship, interns are completely immersed in their teams and…
Added 26 days ago
MS
Software Developer in Test II
Motorola Solutions
Vancouver, BC
- Full-time
3-5 years of experience as an SDET or QA Automation Engineer
Added 25 days ago
Crypto Engineer (Contract)
Capco
Toronto, ON
As a Contract Crypto Engineer at Capco, you’ll design, develop, and support cryptographic solutions that protect data at rest and in transit across complex enterprise environments.
Added 25 days ago
J
Senior Software Engineer, Applied AI (Toronto)
Justworks
Toronto, ON
- $188,000 to $242,000 CAD / year
- Full-time
We are seeking a Senior Software Engineer with a strong passion for building AI-native systems in a product environment. The ideal candidate will be able to take ownership of large segments…
Added 26 days ago
Software Development Engineer, WW Deals & Promotions
Amazon
Vancouver, BC
…Amazon shoppers around the globe? As a Software Development Engineer II on our WW Deals and Promotions team in Vancouver, you'll have the opportunity to do just…
Added 26 days ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 25 days ago
KR
Senior Java Software Engineer
KTek Resourcing
Montreal, QC
- Contract
Design, develop, and maintain scalable applications using Java, JavaScript, and Spring Boot frameworks.
Added 26 days ago
IF
Principal, Software Engineering – InsurTech Claims & Billing Core Systems
Intact FC
Toronto, ON · Montreal, QC
- Full-time
We are looking for a Principal Engineer to provide hands-on technical leadership across Intact’s InsurTech Claims and Billing Core Systems.

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Oct 14, 2026
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job