Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 1 month ago
TC
Integrator engineer
Tata Consultancy Services
Montreal, QC
- Full-time
Required – The candidate must have working experience in at least three of the following application/network security domains:
Added 1 month ago
C
Applications Development Technology Lead Analyst - Lead Java Developer - Vice President
Citi
Mississauga, ON
- Full-time
Build & CI/CD Tooling: Proficient with Maven/Gradle, Git, Jenkins/Tekton pipelines, and modern DevOps release management.
Added 1 month ago
SC
Lead Platform Engineer (DevOps & MLOps)
Shore Consulting
Toronto, ON
- Full-time
Reporting to the Director, Platform Services, the Lead DevOps Engineer is a senior, hands-on technical leader responsible for building, operating, and continuously improving Afflo’s…
Added 1 month ago
C
Senior Data Platform Engineer - Zonda - Toronto, ON
CoStar
Toronto, ON
- $140,000 to $170,000 CAD / year
- Full-time
Senior Data Platform Engineer: Senior Data Platform Engineer – Zonda – Toronto, ON
Added 1 month ago
C
Senior Data Platform Engineer - Zonda - Toronto, ON
CoStar
Toronto, ON
- $140,000 to $170,000 CAD / year
- Full-time
Senior Data Platform Engineer: Senior Data Platform Engineer – Zonda – Toronto, ON
Added 1 month ago
M
Scrum Master
McKesson
Montreal, QC
- Full-time
Added 1 month ago
CG
Senior Data Platform Engineer - Zonda - Toronto, ON
CoStar Group
Toronto, ON
- $140,000 to $170,000 CAD / year
- Full-time
Senior Data Platform Engineer: Senior Data Platform Engineer – Zonda – Toronto, ON
Added 1 month ago
BC
Senior Cloud Engineer - Google Firebase
BDO Canada
Toronto, ON
- Full-time
BDO Canada's Google Cloud Advisory Practice is seeking a Senior Cloud Engineer - Google Firebase to help clients design, build, modernize, and scale cloud-native applications on Google…
Added 1 month ago
S
QA Automation Engineer with AI
Synechron
Calgary, AB
- $75,000 to $85,000 CAD / year
- Full-time
Must have logical aptitude to understand interactions/workings of systems
Added 1 month ago
ND
Tech Consultant - Senior Full-Stack Engineer
NTT DATA North America
Vancouver, BC
- Other
We are seeking an experienced Senior Full Stack Engineer to design, develop, and deliver scalable, secure, and high-performing enterprise applications. The ideal candidate should have…
Added 2 months ago
Sr. DevSecOps Engineer
Rogers Communications
Brampton, ON · Toronto, ON
We are currently seeking a Sr DevSevOps Engineer to join the Rogers Enterprise DevSecOps Engineering Team. Working from Toronto or Brampton office, you will work with the Enterprise DevOps…
Added 1 month ago
B
Senior DevOps Engineer
Bounteous
Montreal, QC
- Full-time
Location: Montreal, QC (Hybrid - 3 days per week in office) Experience: 4+ years · Ability to work on-site in Montreal 3 days per week and provide coverage during EST
Added 1 month ago
Senior Specialist, IT Infrastructure
Celestica International LP
Toronto, ON
Build, manage, and optimize enterprise build and release pipelines using Azure DevOps (ADO) and GitLab CI/CD.
Added 1 month ago
R-
Senior Operations Engineer
RiverMeadow - Workload Mobility Platform
Canada
- Full-time
We are looking for a highly experienced Senior Operations Engineer to join our team and support the automation, security, reliability, and operational stability of our infrastructure, CI/CD…
Added 1 month ago
P
Senior Software Quality Engineer – AI
PeoplePilot
Toronto, ON
- Full-time
We are seeking a Senior Software Quality Engineer – AI Focused to drive quality, reliability, and automation for AI-enabled software products. The role will collaborate with Development,…
Added 1 month ago
EB
Lead AI Platform Engineer
EQ Bank
Toronto, ON
- Full-time
The Lead AI Platform Engineer is accountable for technical leadership, engineering excellence, reliability, operability, and the controlled enablement of the organization’s enterprise AI…
Added 1 month ago
EB
Lead AI Platform Engineer
EQ Bank | Canada's Challenger Bank
Toronto, ON
- Full-time
The Lead AI Platform Engineer is accountable for technical leadership, engineering excellence, reliability, operability, and the controlled enablement of the organization’s enterprise AI…
Added 1 month ago
AI
DevOps Engineer – GitHub Enterprise, GitHub Actions & CI/CD
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Collaborate with senior engineers, platform specialists, and developers to gather feedback and refine solutions.
Added 1 month ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Experience working directly with DevOps teams to implement automated quality gates and release controls.
Added 1 month ago
KR
Senior BI ETL Developer
KTek Resourcing
Canada
- Contract
Working closely with application engineering, architecture, data/analytics and vendor teams. The Senior / Lead ETL Developer designs, develops, tests, deploys, and supports enterprise data…
Added 2 months ago
SE
Senior DevOps Engineer
Samsung Electronics
Vancouver, BC · Greater Vancouver Metropolitan Area
- Full-time
We are looking for a Senior DevOps Engineer to join our Vancouver team.
Added 2 months ago
BV
Senior DevOps Engineer, Agentic Automation & Live Games
Big Viking Games
Toronto, ON
- $140,000 to $180,000 CAD / year
- Full-time
Hybrid, 3 days per week in office · This is a hybrid role based in Toronto, with an expectation of working in office three days per week
Added 2 months ago
C
AI Inference Core - Senior SW Engineer for Platform & DevOps
Cerebras
Toronto, ON
- Full-time
We are hiring a Software Engineer to build and operate the platform layer behind Cerebras engineering infrastructure.
Added 2 months ago
KD
AI/ML Engineer
Katalyst Data Management
Calgary, AB
- Full-time
Join the dynamic and collaborative team at Katalyst Data Management (KDM)! KDM is seeking an AI/ML Engineer to support the operation, optimization, and reliability of the infrastructure…
Added 2 months ago
SE
Senior DevOps Engineer
Samsung Electronics
Vancouver, BC
- Full-time
We are looking for a Senior DevOps Engineer to join our Vancouver team.

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on LinkedIn About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job

Work requirements

Jobs in Canada