Find work in Canada.

499,408 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 1 month ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 1 month ago
KR
Senior Java Software Engineer
KTek Resourcing
Montreal, QC
- Contract
Experience with Python, Spring Boot, and REST API development
Added 1 month ago
Software Dev Engineer, Machine Learning Compilers, Edge AI Compiler and Runtime Team
Amazon
Vancouver, BC
Participate in design reviews, API development, and documentation
Added 1 month ago
PC
Développeur.euse JAVA Desktop Senior / Senior, Java Desktop Developer
Portage CyberTech
Montréal-Ouest, QC
- Full-time
Titre du poste : Développeur JAVA Desktop Senior
Added 1 month ago
EB
Intern - Retail Lending AI Engineer, Winter 2027
EQ Bank
Toronto, ON
- Volunteer
API and integration modernization initiatives within Lending Technology.
Added 1 month ago
PC
Développeur.euse JAVA Desktop Senior / Senior, Java Desktop Developer
Portage CyberTech
Montreal, QC
- Full-time
Titre du poste : Développeur JAVA Desktop Senior
Added 1 month ago
A
Intermediate Software Developer
AppDirect
Montreal, QC
- Full-time
You are a Software Developer with at least 2 years of professional development experience, ready to join AppDirect’s Firstbase engineering team. Whether you hold a degree in Computer…
Added 1 month ago
Intermediate Software Development
AppDirect
Montreal, QC
We are looking to hire a skilled and ambitious software developer in Montreal. You are a highly technical, hands-on fullstack developer with a passion for producing maintainable and robust…
Added 1 month ago
T
Développeur(euse) Full-Stack et intégration, SAP BTP | SAP BTP Full-Stack and Integration Developer
Talan
Montreal, QC
- Full-time
Créer des interfaces SAP Fiori et SAPUI5, des API et des services reliant les processus SAP et non SAP.
Added 1 month ago
T
Architecte de solutions SAP BTP et IA | SAP BTP AI Solutions Architect
Talan
Montreal, QC
- Full-time
Créer des interfaces SAP Fiori et SAPUI5, des API et des services reliant les processus SAP et non SAP.
Added 1 month ago
B
Staff/Principal Software Engineer (Strong AI/ML and Java exp)
Bevertec
Toronto, ON
- Contract
Backend Deep expertise in Java Spring Boot - API design, microservices, event-driven architectures
Added 1 month ago
WI
Java Backend Developer
Work in Ottawa
Ottawa, ON
- $105,000 to $120,000 CAD / year
- Full-time
We are excited to partner with Compax to attract top talent for a Java Backend Developer position. This job posting is a new position within our organization.
Added 1 month ago
A
Développeur(euse) Full Stack - Java Spring Boot / Angular
Astek
Montreal, QC
- Full-time
La conception et le développement de services backend évolutifs, sécurisés et performants en Java - API REST et microservices
Added 1 month ago
A
Jira Service Management Intake & Automation Developer : Toronto, ON (Hybrid) : FTE
AceStack
Toronto, ON
- Full-time
We are seeking a Jira Service Management Intake & Automation Developer to design, develop, and scale enterprise Jira Service Management solutions and workflow automation. The ideal…
Added 1 month ago
TC
AI Deployment & Solutions Lead
Tata Consultancy Services
Toronto, ON
- $115,000 to $165,000 CAD / year
- Full-time
Strong programming skills in Python, Java/JavaScript, C++ or equivalent.
Added 1 month ago
E
Technical Lead / Senior Developer - Software Development
EY
Saskatoon, SK
- Full-time
Understanding of API gateways and service mesh architectures.
Added 1 month ago
C
Senior Java Developer, Assistance Vice President
Citi
Mississauga, ON
- Full-time
4+ years of relevant experience in Java (JDK 1.8 or more) , experience with Spring Boot, KAFKA, GRPC, ECS, Mongo, REST API, JUNIT and SQL Basics
Added 1 month ago
OI
Senior Full Stack Developer
OXARO Inc.
Ottawa, ON
- Full-time
We are seeking a Senior Full Stack Developer to join a collaborative Agile team and lead the development of modern, scalable applications that deliver real business value. This role…
Added 1 month ago
JC
Staff Site Reliability Engineer
Johnson Controls
Toronto, ON · Richmond Hill, ON
- Full-time
Working proficiency in Java and C#, sufficient to read, diagnose, and correct application code
Added 1 month ago
BI
Data Engineer
BALLY’S INTRALOT SA
Toronto, ON
- Full-time
Programming Skills: Experience with backend development using Python, and optionally Java.
Added 1 month ago
E
Technical Lead / Senior Developer - Software Development
EY
Calgary, AB
- Full-time
Understanding of API gateways and service mesh architectures.
Added 1 month ago
S
Java Developer
Synechron
Calgary, AB
- $110,000 to $115,000 CAD / year
- Full-time
We are seeking a highly skilled and adaptable Senior Java Developer to join our dynamic, global engineering team. The ideal candidate thrives in fast-paced, ever-evolving environments and…
Added 1 month ago
C
Senior Java Engineer
Cognizant
Toronto, ON
- Full-time
We are seeking a highly skilled Senior Java Engineer with strong hands‑on experience building backend services using Java, Spring, and Kafka. This role is deeply technical and requires…
Added 2 months ago
ST
Java API Engineer
SIDRAM TECHNOLOGIES
Mississauga, ON
- Full-time
Strong hands-on experience with Java and Spring Boot
Added 5 months ago
C
AWS Solution Architect
CGI
Toronto, ON
- Full-time
…expertise is the primary requirement; experience with Python or Java is an added…

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job