Jobs in Canada

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 27 days ago
AI Automation Engineer (Data Products)
CGI
Montréal, QC
CGI Montréal is hiring a Senior AI/Automation Engineer to industrialize how data products are designed, built, and operated for clients in the manufacturing sector. You will apply and…
Added 27 days ago
Lead AI Platform Specialist
CGI
Montréal, QC
In this context, the PSC is creating a new Lead AI Platform Engineer position. The role will be responsible for structuring and evolving our AI capabilities, both on-premises and in the…
Added 28 days ago
Technical Consultant III (Software Engineer, Senior/Lead)
Myticas Consulting
Toronto, ON
We are seeking a Senior Technical Consultant / Software Engineer III (Team Lead) to lead the technical delivery of complex enterprise SaaS implementations within the banking and financial…
Added 28 days ago
Technical Consultant II (Software Engineer, Intermediate)
Myticas Consulting
BC
Technical Consultant II / Software Engineer II
Added 28 days ago
Senior QA Engineer III – Automation | Banking | API | Kafka | ETL
Myticas Consulting
Ottawa, ON
This is a senior, hands-on quality engineering role focused on automation framework development, API and backend testing, Kafka/event-driven testing, ETL and data pipeline validation,…
Added 28 days ago
Application Developer – Sr Python Engineer
BeachHead
Toronto, ON
Create reusable frameworks, automation patterns, and documentation to improve delivery quality, reliability, and maintainability.
Added 28 days ago
Senior Software Engineer (C++/C#) - Frostbite
Electronic Arts
Vancouver, BC
…animation technologies across our AAA games are built upon. As a Senior Software Engineer on the Frostbite Animation team, you will work on core runtime animation systems, as well as the…
Added 28 days ago
Senior Software Engineer
Velora
BC
We’re hiring a Senior Software Engineer to help build Velora’s AI-native software platform, giving nonprofit teams more time for their mission and less time spent on administration. Your…
Added 28 days ago
Senior Microsoft Platform Software Engineer
Quest Software
NS · ON
Identify opportunities to improve developer productivity, code quality, automated testing, troubleshooting, technical documentation, and delivery using AI-powered development tools.
Added 29 days ago
Senior Quality Assurance (QA) Engineer - Manual
YDTS Global
Vancouver, BC
tech-savvy Senior Quality Assurance (QA) Engineer - Manual to help customers and partners evaluate,
Added 29 days ago
Senior Quality Assurance (QA) Engineer - AUTOMATION
YDTS Global
Vancouver, BC
Our client is looking for a passionate, entrepreneurial, and tech-savvy Senior Quality Assurance (QA) Engineer - Automation to help customers and partners evaluate, adopt and expand the use…
Added 29 days ago
Electrical & Controls Engineers/ Technologists (Junior/ Intermediate/ Senior)
QCA Systems & QCA Insights
Coquitlam, BC
…at different levels of experience (Junior, Intermediate, and Senior) to join our team. Candidates will be involved in EIC system design and project execution for industrial applications.…
Added 29 days ago
RQ08343 - Systems Testing/QA Specialist - Senior
Rubicon Path
Toronto, ON
· Collaborate with DevOps engineer to integrate automation testing scripts to DevOps CD/CI pipeline
Added 29 days ago
RC
Sr Data Engineer
Randstad Canada
Mississauga, ON
- $66.42 to $73.8 CAD / hour
…within an Agile delivery pod under a technical lead, you will engineer high-volume ingestion workloads across a multi-tier Delta Lake architecture (Bronze, Silver, Gold) while porting and…
Added 29 days ago
Sr Staff Engineer - Full Stack
Futuretek
Toronto, ON
Senior Staff Engineer - Full-Stack, Solution Architecture
Added 29 days ago
Sr Staff Engineer, Solution Architect - Full Stack
Futuretek
Toronto, ON
Technical must have: · Delivery & Ownership - must have:
Added 29 days ago
RQ09229 - Software Developer - ETL - Senior
Rubicon Path
Toronto, ON
Perform testing and quality assurance related tasks such as to conduct thorough testing to verify the accuracy and integrity of the data manipulated in interfaces. Define test cases and…
Added 29 days ago
RQ09230 - Software Developer - ETL - Senior
Rubicon Path
Toronto, ON
Perform testing and quality assurance related tasks such as to conduct thorough testing to verify the accuracy and integrity of the data manipulated in interfaces. Define test cases and…
Added 29 days ago
RQ09315 - Software Developer - ETL - Senior
Rubicon Path
Toronto, ON
· Must have strong knowledge and hands-on experience with:
Added 29 days ago
QA - Quality Analyst (PL868)
Paralucent
Toronto, ON
Our client is seeking a pragmatic, detail-oriented QA Engineer to lead API testing, automation, and database validation for public‑facing and internal government services. The role…
Added 29 days ago
UG
Principle Quality Engineer - B.C. Canada On Site
UnitedHealth Group
Vancouver, BC
- $108,500 to $225,200 CAD / year
As a Principal Quality Engineer within the Optum Enterprise Imaging team, you will serve as the senior technical quality leader for Enterprise Imaging integration and solution-level…
Added 29 days ago
A
Data Engineer
Autodesk
Toronto, ON
- $88,000 to $128,700 CAD / year
Autodesk is looking for a skilled and innovative Senior Data Engineer to join our Compliance team, which builds data-driven systems to detect and address non-compliant usage of Autodesk…
Added 29 days ago
AI Inference Core - Senior Infrastructure Software Engineer
Cerebras Systems
Toronto, ON
These systems are primarily built in Python, but the work goes far beyond scripting or automation. Our frameworks act as the control plane for distributed workflows, managing resources,…
Added 1 month ago
Sr Software Developer
Thales DIS CPL USA, Inc.
Vancouver, BC
Our technologies and services help banks exchange funds, people cross borders, energy become smarter and much more
Added 1 month ago
Sr Software Developer
Thales DIS CPL USA, Inc.
Vancouver, BC
Our technologies and services help banks exchange funds, people cross borders, energy become smarter and much more

Astra North Infoteck Inc.

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Apply on astra-north.zohorecruit.ca About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI
Roles and Responsibilities:
- Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
- Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
- Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
- Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
- Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
- Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
- Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
- Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
- Identify, document, prioritize, and track defects through resolution.
- Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
- Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
- Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.
Required Skills:
- 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
- 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
- 5+ years of experience building and maintaining test automation frameworks.
- Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
- Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
- Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
- Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
- Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
- Ability to create effective test data and evaluation datasets for AI-driven functionality.
- Strong analytical, problem-solving, communication, and technical documentation skills.
- Ability to work effectively in a fast-paced, cross-functional Agile environment.
Nice to Have:
- Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
- Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
- Experience testing cloud-native applications and distributed microservice architectures.
- Experience with security, performance, accessibility, or reliability testing.
- Experience developing automation scripts and reusable testing utilities.
- Experience with Tableau or other analytics and visualization platforms.
- CSTE certification or an equivalent quality engineering certification.
- Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on astra-north.zohorecruit.ca About employer

More about this job

Responsibilities

The Senior Quality Engineer at Astra North Infoteck will design and maintain test automation frameworks and write automated tests for both standard and AI-enabled features. They will also work with DevOps and development teams to put quality checks into the release pipeline, track defects and report quality risks to stakeholders.

Requirements

Candidates need 5+ years in quality engineering or test automation and 5+ years of programming in Java, Python or Groovy. They also need hands-on experience with Selenium, Playwright or RestAssured, and experience testing AI or machine learning applications.

Skills

Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
qTest
ReadyAPI
JMeter
API testing
Regression testing
AI quality evaluation
Prompt evaluation
Hallucination detection
LLM testing
Test data creation
TDD
ATDD
BDD
Risk-based testing
CI/CD integration

Keywords

Test Automation
AI Testing
GenAI
LLM Testing
Java
Python
Groovy
Selenium
Cucumber
Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
qTest
CI/CD
Quality Engineer
QA Automation

Seniority

Senior

Tools

Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
qTest
Jenkins

Languages

English

Report this job

Work requirements

Jobs in Canada