Find work in Canada.

324,864 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 11 days ago
Développeur Senior SRE
Astek
Montreal, QC
Full-time
Senior Developer SRE "Site Reliability Engineer"
Added 11 days ago
Senior Software Engineer -Waterloo
PointClickCare
Waterloo, ON
$142,000 to $158,000 CAD / year
Full-time
Experience writing clean code that performs well at scale using Java
Added 11 days ago
Senior Software Quality Engineer – AI
PeoplePilot
Toronto, ON
Full-time
We are seeking a Senior Software Quality Engineer – AI Focused to drive quality, reliability, and automation for AI-enabled software products. The role will collaborate with Development,…
Added 12 days ago
Sr. Integration Architect - Automation
Infotree Global Solutions
Toronto, ON
Contract
Expert-level Senior Integration Developer with Intelligent Automation experience to design, build, and govern mission-critical enterprise automation and integration solutions on Workato and…
Added 11 days ago
Architecte de solutions SAP BTP et IA | SAP BTP AI Solutions Architect
Talan
Montreal, QC
Full-time
Reporting to the Senior Director, Alliances and Presales, with a delivery reporting line to the Vice President, Delivery for engagement work, the SAP BTP AI Solutions Architect defines the…
Added 12 days ago
Java/Kubernetes Developer - French
Accion Labs
Montreal, QC
Contract
Requirements: Java, Kubernetes, containerized environment. Intermediate or senior level.
Added 12 days ago
Java backend Developer
Maven Companies Inc.
Montreal, QC
Full-time
We are looking for an experienced Senior Java Backend Developer to design, develop, and maintain scalable, high-performance backend applications and distributed systems.
Added 12 days ago
Senior Java Software Engineer
Soho Square Solutions
Toronto, ON
Contract
Hands-on Senior Full Stack Developer responsible for contributing to the design, development, testing, and maintenance of scalable backend services and REST APIs using Java and Spring Boot;
Added 12 days ago
Senior Java Software Engineer
PeoplePilot
Toronto, ON
$100,000 to $120,000 CAD / year
Full-time
Design, develop, and maintain high-quality, maintainable Java applications using clean code principles, SOLID principles, and established design patterns.
Added 13 days ago
Senior Software Developer - Enterprise Permit & Licensing (Computer Services Officer 4)
The Government of Nova Scotia
Halifax, NS
We're seeking a Senior Software Developer who's not just looking for a job but an opportunity to make a real difference. This role is your chance to be at the core of innovation, shaping…
Added 29 days ago
Technical Lead / Senior Developer - Software Development
EY
Dieppe, NB
Full-time
As a Technical Lead or a Senior Consultant, you will be responsible for leading the design, development, and delivery of scalable enterprise applications. This role combines deep hands-on…
Added 12 days ago
Senior Technical Manager - Networking & DNS Infrastructure
BlueCat
Toronto, ON
Full-time
…to the codebase when appropriate. You will work closely with senior engineers on architectural direction while helping the team make sound technical decisions and maintain a high standard…
Added 2 months ago
Web-to-Print Solutions Specialist
PressCentric SEZC
Vancouver, BC
Full-time
Please SelectFront End Web DeveloperBack End Developer (Java)Senior Customer Support SpecialistBusiness Developer
Added 13 days ago
Senior Developer
RBC
Toronto, ON · Bedford, QC
Full-time
Added 12 days ago
Senior Developer
RBC
Toronto, ON
Full-time
Added 12 days ago
Senior Developer
RBC
Bedford, NS
Full-time
Added 13 days ago
Global Markets, Summer 2027 Analyst or Associate (12 months)
CIBC
Toronto, ON
Full-time
Experience in software development in two or more general purpose programming languages such as Python, JavaScript, Java, or C++.
Added 13 days ago
Sr. Application Developer - (Java / AWS / Payment Systems / Leadership)
BMO
Toronto, ON · BMOPLACE
Full-time
Strong hands-on experience in enterprise software engineering, including senior or lead-level development responsibility
Added 12 days ago
Senior Software Engineer, Applied AI (Toronto)
Justworks
Toronto, ON
$188,000 to $242,000 CAD / year
Full-time
We are seeking a Senior Software Engineer with a strong passion for building AI-native systems in a product environment. The ideal candidate will be able to take ownership of large segments…
Added 13 days ago
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 12 days ago
Senior Applications Developer- Mobile Apps (React Native)
Sobeys
Mississauga, ON
Full-time
…join our team! We currently have a full-time opportunity for a Senior Applications Developer. This role is based is based out our office located in Mississauga,…
Added 12 days ago
Senior Java Software Engineer
KTek Resourcing
Montreal, QC
Contract
Design, develop, and maintain scalable applications using Java, JavaScript, and Spring Boot frameworks.
Added 12 days ago
Senior Application Support Analyst
eHealth Saskatchewan
SK · Saskatchewan
$45.73 to $55.64 CAD / hour
Full-time
Reporting to the Manager, Drug and Pharmacy Services, eHealth Saskatchewan is seeking a Senior Application Support Analyst with strong application support, programming, and problem-solving…
Added 12 days ago
Staff/ Sr. Staff HW Test Automation Engineer
Lightmatter
Toronto, ON
…across some combination of: an internal test software framework (Java/Python-based), industry-standard ATE test method and testflow development, wafer prober integration, instrument control…
Added 12 days ago
Développeur.euse JAVA Desktop Senior / Senior, Java Desktop Developer
Portage CyberTech
Montréal-Ouest, QC
Full-time
Titre du poste : Développeur JAVA Desktop Senior

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Job type: Full-time
Apply by: Oct 14, 2026
Posting language: English
Posted: Sep 14, 2026

Apply About employer

Applications open in a new tab.

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job