Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 1 month ago
C
Senior AI Engineer
Comm100
Vancouver, BC
- $100,000 to $150,000 CAD / year
- Full-time
Deeply engage in key tasks such as AI Assistant data construction, LLM pre-training, fine-tuning, algorithm optimization, prompt engineering, and model deployment.
Added 1 month ago
C
AI Engineer
Comm100
Vancouver, BC
- $80,000 to $120,000 CAD / year
- Full-time
Deeply engage in key tasks such as AI Assistant data construction, LLM pre-training, fine-tuning, algorithm optimization, prompt engineering, and model deployment.
Added 1 month ago
U
AI/ Prompt Developer
UST
Montreal, QC
- Full-time
Participate in prompt benchmarking experiments.
Added 1 month ago
E
Services Professional (Early Career)
Ericsson
Toronto, ON
- Full-time
Familiarity with LLMOps concepts: prompt and version management, offline/online evaluation, and grounding versus hallucination fundamentals
Added 1 month ago
I
AI Engineer
Insight
Remote, Canada
- Full-time
- Remote
Implement prompt strategies, guardrails, and evaluation loops to improve reliability, safety, and quality.
Added 1 month ago
S
Founding Engineer
Superpower
Toronto, ON
- $75,000 to $100,000 CAD / year
- Full-time
You'll be the first hired engineer for Superpower, you'll be expected to own the outcomes of your work and you'll have to assess yourself independently at times.
Added 1 month ago
J
AI Engineer, Entry Level (Canada)
Jobright.ai
Canada
- Full-time
…the job search experience. They are seeking an entry-level AI Engineer to build and refine autonomous AI agents, develop sophisticated prompt engineering workflows, and integrate Large…
Added 1 month ago
J
Prompt Engineer - Early Career (Canada)
Jobright.ai
Canada
- Full-time
Jobright is your personal AI job search agent transforming the job search process. They are seeking an early-career Prompt Engineer to craft and evaluate prompts that enhance the…
Added 2 months ago
Machine Learning Engineer, Associate Director
Fitch Group
Toronto, ON
Machine Learning Engineer, Associate Director – AI Innovation Teams
Added 1 month ago
UT
Automation Engineer 4- #26-23046
US Tech Solutions
Markham, ON
- $65 to $70 CAD / hour
- Contract
We are looking for a dynamic, energetic experienced Systems Design Engineer to join our growing team. As a key contributor to the success of Client’s product, you will be part of a leading…
Added 1 month ago
BV
Live Content Marketing Specialist, Live Games
Big Viking Games
Remote, Canada
- Contract
- Remote
Hybrid, 4 days per week in office at Queens Quay West · This is a hybrid contractor role based in Toronto, with an expectation of working from our Queens Quay West office four days per week
Added 1 month ago
BV
Live Content Marketing Specialist, Live Games
Big Viking Games
Toronto, ON
- $61,000 CAD / year
- Contract
Hybrid, 4 days per week in office at Queens Quay West · This is a hybrid contractor role based in Toronto, with an expectation of working from our Queens Quay West office four days per week
Added 1 month ago
AI
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Quality Engineer – Test Automation, Java/Python & GenAI
Added 1 month ago
T
Staff Engineer or Architect (AI Agentic Team)
Trulioo
Vancouver, BC
- $175,000 to $205,000 CAD / year
- Full-time
Our offices support a hybrid model and staff typically work three days per week at a hub location
Added 2 months ago
FG
Machine Learning Engineer, Associate Director
Fitch Group, Inc.
Toronto, ON
- Full-time
Machine Learning Engineer, Associate Director – AI Innovation Teams
Added 1 month ago
N
Staff Engineer - Inference /AI
Nutanix
Vancouver, BC
- $171,000 to $257,000 CAD / year
- Full-time
Familiarity with modern LLM concepts including reasoning workflows, tool calling, prompt templates, and agent.
Added 1 month ago
TC
AI Deployment & Solutions Lead
Tata Consultancy Services
Toronto, ON
- $115,000 to $165,000 CAD / year
- Full-time
The Forward Deployment Engineer (FDE) Technical Lead is a hands-on engineering leader responsible for solving complex problems by combining software engineering, AI/GenAI, data, cloud,…
Added 1 month ago
B&
Expert Senior Manager, AI Engineering
Bain & Company
Zurich, ON
- Full-time
The Expert Senior Manager / Associate Partner AI Engineer will architect, build, and scale next-generation generative AI systems and agentic solutions for Bain’s clients. As a leader in the…
Added 1 month ago
VT
Senior AI Engineer
Vision Talent Co.
Toronto, ON
- $110,000 to $130,000 CAD / year
- Full-time
Vision Talent is supporting a financial services client who is seeking a Senior AI Engineer – AWS / Automation / Agentic AI to join their growing team. This is a permanent role and requires…
Added 1 month ago
EG
Construction Manager, Land Development
Egis Group
Edmonton, AB
- $130,000 to $170,000 CAD / year
- Full-time
…payments in a timely manner and maintains compliance with the prompt payment requirements defined by contract documents and statutory…
Added 1 month ago
F
Cloud Security Specialist
Fortinet
Burnaby, BC
- Full-time
5+ years of dedicated experience in security engineering role, e.g. Security Engineer, Penetration Tester or DevSecOps/SRE.
Added 2 months ago
L
AI Benchmark Engineer | Native Language Specialist - French (Canada) - Remote
LILT
Remote, Canada
- Contract
- Remote
…challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal…
Added 2 months ago
EC
Digital - ASIC Design Automation Engineer
Eliyan Corporation
Toronto, ON · Greater Toronto Area, Canada
- Full-time
The AI work here is applied engineering, not research: prompt and agent design, evaluation harnesses, and the plumbing that makes a pipeline reliable the night before a tapeout deadline. If…
Added 2 months ago
N
Principal Security Lead- Cloud
Nokia
Ottawa, ON · Kanata, ON
- Full-time
Added 3 months ago
BV
Senior Full Stack Engineer, AI
Big Viking Games
Toronto, ON
- $100,000 to $150,000 CAD / year
- Full-time
This is a hybrid role based in Toronto, with an expectation of working in office three days per week

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI

Roles and Responsibilities:

• Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
• Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
• Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
• Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
• Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
• Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
• Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
• Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
• Identify, document, prioritize, and track defects through resolution.
• Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
• Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
• Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.

Required Skills:

• 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
• 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
• 5+ years of experience building and maintaining test automation frameworks.
• Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
• Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
• Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
• Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
• Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
• Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
• Ability to create effective test data and evaluation datasets for AI-driven functionality.
• Strong analytical, problem-solving, communication, and technical documentation skills.
• Ability to work effectively in a fast-paced, cross-functional Agile environment.

Nice to Have:

• Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
• Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
• Experience testing cloud-native applications and distributed microservice architectures.
• Experience with security, performance, accessibility, or reliability testing.
• Experience developing automation scripts and reusable testing utilities.
• Experience with Tableau or other analytics and visualization platforms.
• CSTE certification or an equivalent quality engineering certification.
• Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on LinkedIn About employer

More about this job

Responsibilities

Partner with cross-functional teams to design and execute automated, exploratory, and AI-focused tests to ensure product quality. Establish testing strategies for both deterministic and non-deterministic AI behaviors while integrating quality checks into CI/CD pipelines.

Requirements

Requires 5+ years of experience in quality engineering and test automation using languages like Java or Python. Candidates must have hands-on experience with automation frameworks and a strong understanding of AI quality concepts and testing methodologies.

Skills

Java
Python
Test Automation
GenAI
Selenium
Playwright
Cucumber
RestAssured
API Testing
CI/CD
Agile
Quality Engineering
JUnit
TestNG
JMeter
Microservices

Visa sponsorship

Not detected in the job text

Keywords

Quality Engineering
Test Automation
Java
Python
Groovy
GenAI
Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
CI/CD
Agile
API Testing
Microservices
Prompt Engineering
Retrieval-Augmented Generation
Git
Jenkins
AWS
Kubernetes
Maven
Gradle
SonarQube
Jira
CSTE
Cloud-native

Report this job

Work requirements

Jobs in Canada