Find work in Canada.

484,132 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 1 month ago
CG
Senior DevOps/SRE Engineer
Credit Genie
Toronto, ON
- Full-time
As a Senior DevOps / SRE Engineer on this team, you'll own reliability and deployments across our AWS and Kubernetes environment, take real ownership of our compliance work, and help build…
Added 1 month ago
B
Sr Analyst, DevOps
Brookfield
Toronto, ON
- Full-time
The Senior AI Cloud Developer Analyst within Brookfield’s Technical Service Group (TSG) builds and delivers AI solutions from prototype to production, implementing scalable, secure and…
Added 1 month ago
BT
Senior DevOps Engineer
Bison Transport
Winnipeg, MB
- Full-time
The Senior DevOps Engineer is responsible for the reliability, security, scalability, automation, and operational support of Bison’s enterprise integration platforms and containerized…
Added 1 month ago
JG
Senior Core Java Engineer
J&M Group
Montreal, QC
- Contract
We are seeking a Senior Core Java Engineer to design, develop, and support high-performance, scalable enterprise applications. The ideal candidate will have strong expertise in Core Java,…
Added 1 month ago
BA
Sr Analyst, DevOps
Brookfield Asset Management
Toronto, ON · Brookfield Place
- Full-time
The Senior AI Cloud Developer Analyst within Brookfield’s Technical Service Group (TSG) builds and delivers AI solutions from prototype to production, implementing scalable, secure and…
Added 1 month ago
Senior Engineer (Platform)
Later
Vancouver, BC
The Senior Engineer is responsible for driving large-scale projects, delivering impactful features, and maintaining high engineering standards. You’ll solve complex problems, collaborate…
Added 1 month ago
Senior Specialist, IT Infrastructure
Celestica International LP
Toronto, ON
We are seeking a highly skilled, hands-on Technical Lead to design, build, nd actively engineer our enterprise cloud and hybrid platform infrastructure. The candidate will directly write…
Added 1 month ago
R-
Senior Operations Engineer
RiverMeadow - Workload Mobility Platform
Canada
- Full-time
We are looking for a highly experienced Senior Operations Engineer to join our team and support the automation, security, reliability, and operational stability of our infrastructure, CI/CD…
Added 1 month ago
II
Senior Data Engineer – Microsoft Fabric
Iteration Insights
Calgary, AB · Greater Calgary Metropolitan Area
- Full-time
We're looking for a Senior Data Engineer to help our clients build modern data platforms, pipelines, and analytics solutions using Microsoft Fabric and the broader Azure ecosystem.
Added 1 month ago
GT
Databricks Engineer
Global Technical Talent, an Inc. 5000 Company
Toronto, ON
- $80 to $95 CAD / hour
- Contract
…successful contractor will work on a daily basis with the Data Engineer Lead and client stakeholders, within a team composed of 1 Data Engineer Lead, 5 Senior Data Engineers, and 3…
Added 1 month ago
A
Développeur Senior SRE
Astek
Montreal, QC
- Full-time
Senior Developer SRE "Site Reliability Engineer"
Added 1 month ago
BC
Senior Consultant, Migration Engineer
BDO Canada
Toronto, ON
- Full-time
At BDO, our purpose is helping people thrive. As a Senior Consultant, Migration Engineer, you will join a growing team focused on helping organizations modernize their technology…
Added 1 month ago
BT
Senior DevOps Engineer
Bison Transport Inc.
Winnipeg, MB
- Full-time
The Senior DevOps Engineer is responsible for the reliability, security, scalability, automation, and operational support of Bison’s enterprise integration platforms and containerized…
Added 1 month ago
KG
IBM Sterling File Gateway (SFG) Consultant
K&K Global Talent Solutions INC.
Toronto, ON
- Full-time
Experience with cloud platforms such as Azure or AWS.
Added 1 month ago
EB
Lead AI Platform Engineer
EQ Bank
Toronto, ON
- Full-time
7+ years of experience in platform engineering, site reliability engineering, DevOps, cloud operations, enterprise IT operations, or production platform support.
Added 1 month ago
EB
Lead AI Platform Engineer
EQ Bank | Canada's Challenger Bank
Toronto, ON
- Full-time
7+ years of experience in platform engineering, site reliability engineering, DevOps, cloud operations, enterprise IT operations, or production platform support.
Added 1 month ago
P
Senior Java Software Engineer
PeoplePilot
Toronto, ON
- $100,000 to $120,000 CAD / year
- Full-time
Added 1 month ago
AI
DevOps Engineer – GitHub Enterprise, GitHub Actions & CI/CD
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Collaborate with senior engineers, platform specialists, and developers to gather feedback and refine solutions.
Added 1 month ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 1 month ago
KR
Senior BI ETL Developer
KTek Resourcing
Canada
- Contract
Working closely with application engineering, architecture, data/analytics and vendor teams. The Senior / Lead ETL Developer designs, develops, tests, deploys, and supports enterprise data…
Added 1 month ago
FE
Senior RPA Automation Engineer
Future Electronics
Kirkland, QC
- Full-time
…and optimize business processes across the organization. As a Senior Automation Engineer, you will lead the full lifecycle of automation initiatives - from process discovery and solution…
Added 1 month ago
VT
Senior AI Engineer
Vision Talent Co.
Toronto, ON
- $110,000 to $130,000 CAD / year
- Full-time
Vision Talent is supporting a financial services client who is seeking a Senior AI Engineer – AWS / Automation / Agentic AI to join their growing team. This is a permanent role and requires…
Added 1 month ago
D
Senior Cloud Infrastructure Engineer - Operate (Future Opportunity)
Deloitte
Toronto, ON
- Full-time
HIMS Operations is proactively seeking a Senior Consultant for a "future opportunity" to operate, and continuously improve secure, resilient infrastructure across public cloud and…
Added 1 month ago
T
Senior Software Security Engineer
TimePlay
Toronto, ON
- Full-time
The right candidate may have held titles such as Senior Security Engineer, Security Architect, Application Security Engineer, Cloud Security Engineer, Infrastructure Security Engineer, or…
Added 1 month ago
SE
Senior DevOps Engineer
Samsung Electronics
Vancouver, BC · Greater Vancouver Metropolitan Area
- Full-time
We are looking for a Senior DevOps Engineer to join our Vancouver team.

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job