Find work in Canada.

318,874 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 17 days ago
ND
Tech Consultant - Senior Full-Stack Engineer
NTT DATA North America
Vancouver, BC
- Other
We are seeking an experienced Senior Full Stack Engineer to design, develop, and deliver scalable, secure, and high-performing enterprise applications. The ideal candidate should have…
Added 17 days ago
JT
Senior Java Software Engineer
Jobility Talent Solutions
Toronto, ON
- Contract
Job Title: Java Developer – Capital Markets (eTrading)
Added 1 month ago
Sr. DevSecOps Engineer
Rogers Communications
Brampton, ON · Toronto, ON
We are currently seeking a Sr DevSevOps Engineer to join the Rogers Enterprise DevSecOps Engineering Team. Working from Toronto or Brampton office, you will work with the Enterprise DevOps…
Added 18 days ago
ES
Offensive Security Engineer
Epsilon Solutions Ltd.
Toronto, ON
- Contract
As “Principal Consultant, Agentic AI Cybersecurity Engineer” you will work hands-on alongside our cybersecurity engineering and application security teams to build, operate, and advance the…
Added 18 days ago
C
Ingénieur(e) solutions
ChapsVision
Montreal, QC
- Full-time
En fonction de votre expérience, vous jouerez soit un rôle clé, soit celui de responsable technique senior dans le cadre de mises en œuvre stratégiques : vous concevrez des solutions,…
Added 1 month ago
OP
Staff Software Engineer
Open People Network (OPN)
Toronto, ON
- Full-time
Senior product leadership. Less about the technical work at this point and more about whether you’re someone we want in the room: how you collaborate, how you handle disagreement, and…
Added 18 days ago
Senior Software Engineer
Questrade Financial Group
Toronto, ON
We’re looking for our next Senior Software Engineer. Could It Be You?
Added 18 days ago
RT
Sr Integration Engineer (Intelligent Automation)
Russell Tobin
Toronto, ON
- $90 to $100 CAD / hour
- Contract
Position: Sr Integration Engineer (Intelligent Automation)
Added 18 days ago
B
Node JS / NestJS Engineer (Backend)
BeachHead
Markham, ON
- Contract
Working with one of our top financial clients, this role calls for a Node JS / NestJS Engineer (Backend). This position involves developing backend capabilities and APIs for a key…
Added 18 days ago
T
Senior Software Engineer
Tactable
Toronto, ON
- Full-time
The Role: Senior Software Engineer (Cloud, Data & APIs)
Added 18 days ago
MM
Senior Software Engineer
Mohawk Medbuy Corporation
Toronto, ON · Greater Toronto Area, Canada
- Full-time
We are currently recruiting for a Senior Software Engineer to support our IT – Application Development team. This role can be based out of our Toronto, London or Burlington offices.
Added 18 days ago
IT - Senior Software Engineer
Mohawk Medbuy Corporation (MMC)
Burlington, ON · London, ON · Toronto, ON
We are currently recruiting for a Senior Software Engineer to support our IT – Application Development team.
Added 18 days ago
P
Senior Software Engineer -Waterloo
PointClickCare
Kitchener, ON
- Full-time
· Experience writing clean code that performs well at scale using Java
Added 18 days ago
A
Développeur Senior SRE
Astek
Montreal, QC
- Full-time
Senior Developer SRE "Site Reliability Engineer"
Added 18 days ago
P
Senior Software Engineer -Waterloo
PointClickCare
Waterloo, ON
- $142,000 to $158,000 CAD / year
- Full-time
Experience writing clean code that performs well at scale using Java
Added 18 days ago
P
Senior Software Quality Engineer – AI
PeoplePilot
Toronto, ON
- Full-time
We are seeking a Senior Software Quality Engineer – AI Focused to drive quality, reliability, and automation for AI-enabled software products. The role will collaborate with Development,…
Added 18 days ago
HS
Senior Integration Engineer (Boomi/Workato)
HeartCentrix Solutions
ON · Ontario, Canada
- Contract
We are seeking a Senior Integration Engineer with deep expertise in Boomi and Workato, specializing in payroll and HR system integrations. This role will focus on designing, developing, and…
Added 18 days ago
IG
Sr. Integration Architect - Automation
Infotree Global Solutions
Toronto, ON
- Contract
Job Title: Sr Integration Engineer (Intelligent Automation)
Added 18 days ago
P
Senior Java Software Engineer
PeoplePilot
Toronto, ON
- $100,000 to $120,000 CAD / year
- Full-time
Design, develop, and maintain high-quality, maintainable Java applications using clean code principles, SOLID principles, and established design patterns.
Added 19 days ago
J
Senior Software Engineer, Applied AI (Toronto)
Justworks
Toronto, ON
- $188,000 to $242,000 CAD / year
- Full-time
We are seeking a Senior Software Engineer with a strong passion for building AI-native systems in a product environment. The ideal candidate will be able to take ownership of large segments…
Added 19 days ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 19 days ago
IF
Principal, Software Engineering – InsurTech Claims & Billing Core Systems
Intact FC
Toronto, ON · Montreal, QC
- Full-time
We are looking for a Principal Engineer to provide hands-on technical leadership across Intact’s InsurTech Claims and Billing Core Systems.
Added 19 days ago
Staff/ Sr. Staff HW Test Automation Engineer
Lightmatter
Toronto, ON
As a Hardware Test Automation Engineer you'll have the opportunity to work across some combination of: an internal test software framework (Java/Python-based), industry-standard ATE test…
Added 19 days ago
L
Staff/ Sr. Staff HW Test Automation Engineer
Lightmatter
Toronto, ON
- Full-time
As a Hardware Test Automation Engineer you'll have the opportunity to work across some combination of: an internal test software framework (Java/Python-based), industry-standard ATE test…
Added 19 days ago
L
Staff/ Sr. Staff HW Test Automation Engineer
Lightmatter
Toronto, ON
- Full-time
As a Hardware Test Automation Engineer you'll have the opportunity to work across some combination of: an internal test software framework (Java/Python-based), industry-standard ATE test…

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Oct 14, 2026
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job