Find work in Canada.

320,143 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 42 mins ago
M
AI Business Solutions
Microsoft
Calgary, AB
- Full-time
…business requirements into prioritized Copilot scenarios and agent solutions, and drive deployment, active usage, adoption, and expansion across the customer's…
Added 3 hours ago
EI
Agent · e de ventes - Gatineau
Emplo Inc.
Gatineau, QC
- Part-time
Added 3 hours ago
T
Senior Contact Center Support Specialist (Amazon Connect)
TD
Toronto, ON
- Full-time
Contact Control Panel (CCP) and agent workspace
Added 4 hours ago
IF
Agent service client - Indemnisation (BG-EFT)
Intact FC
Laval, QC · Montreal, QC
- Full-time
Excellentes aptitudes d'écoute et de communication avec la capacité de favoriser de solides relations de travail.
Added 8 hours ago
Northern Station Agent
The Talent Team at Perimeter Aviation
Brochet, MB · Cross Lake 19, MB · MB · God'S River 86A, MB · Grand Rapids, MB · Island Lake, MB · Lac Brochet 197A, MB · Norway House 17, MB · Oxford House 24, MB · Shamattawa 1, MB · South Indian Lake, MB · St. Theresa Point, MB · Wasagamack, MB · Lake, ON · Sachigo Lake, ON · ON · Gods Lake Narrows, MB · Gods River, MB · Lac Brochet, MB · Little Grand Rapids, MB · North Spirit Lake, ON · Pikangikum, ON · Red Sucker Lake, MB · Saint Theresa Point, MB · Sandy Lake, ON · Tadoule Lake, MB · Weagamow Lake, ON
The Northern Stations Agent’s duties include performing tasks related to aircraft loading/unloading and ensuring that there is constant communication with Flight Crew personnel and other…
Added 8 hours ago
Northern Station Agent
The Talent Team at Perimeter Aviation
Brochet, MB · Cross Lake 19, MB · MB · God'S River 86A, MB · Grand Rapids, MB · Island Lake, MB · Lac Brochet 197A, MB · Norway House 17, MB · Oxford House 24, MB · Shamattawa 1, MB · South Indian Lake, MB · St. Theresa Point, MB · Wasagamack, MB · Lake, ON · Sachigo Lake, ON · ON · Gods Lake Narrows, MB · Gods River, MB · Lac Brochet, MB · Little Grand Rapids, MB · North Spirit Lake, ON · Pikangikum, ON · Red Sucker Lake, MB · Saint Theresa Point, MB · Sandy Lake, ON · Tadoule Lake, MB · Weagamow Lake, ON
The Northern Stations Agent’s duties include performing tasks related to aircraft loading/unloading and ensuring that there is constant communication with Flight Crew personnel and other…
Added 9 hours ago
PA
Specialist, Training and Content
Porter Airlines Inc.
Toronto, ON
- Full-time
Maintain familiarity with the Customer Support environment, systems and agent experience.
Added 14 hours ago
SS
Platform Architect
Simpro Software
Montreal, QC
- Full-time
…et l’AI gateway qui constituent le point d’entrée de chaque agent vers les systèmes métier, avec orchestration des API, fédération des tenants et exposition via…
Added 14 hours ago
P
Managing Director & Strategic Advisor
PwC
Ottawa, ON
- Full-time
…Business Transformation, Change Management, Coaching and Feedback, Communication, Creativity, Embracing Change, Emotional Regulation, Empathy, Epic Software, Epic Systems, Exemplary…
Added 14 hours ago
FR
Agent(e) de location / Leasing Agent - Trois-Rivières (temps partiel)
Fox Real Estate
Trois-Rivières, QC
- Part-time
Added 14 hours ago
SS
SDET Lead
Simpro Software
Montreal, QC
- Full-time
Build evaluation suites for LLM-based agents: curated test datasets, regression checks on prompts and tool calls, and LLM-as-judge scoring, run on every change to a model, prompt or agent.
Added 18 hours ago
PC
Deals Real Assets, Data Engineering & Digital Solutions, Senior Associate
PwC Canada
Vancouver, BC
- Full-time
Added 18 hours ago
CI
Agent(e) junior en commerce international / Junior International Trade Clerk
Copap Inc.
Pointe-Claire, QC
- Full-time
Nous sommes actuellement à la recherche d’un(e) Agent(e) junior en commerce international pour se joindre à notre équipe dynamique.
Added 18 hours ago
R
Stage : Superviseur Maintenance COOP - Hiver 2027 | Internship - COOP Maintenance Supervisor – Winter 2027
RTX
Longueuil, QC
- Full-time
Agir en tant qu’agent de prévention et de respect des règles de santé sécurité au travail.
Added 19 hours ago
P
Deals Real Assets, Data Engineering & Digital Solutions, Senior Associate
PwC
Calgary, AB · Vancouver, BC · Toronto, ON
- Full-time
Added 19 hours ago
BB
Représentant(e) des services techniques à domicile (Saisonnier(ère)) / Field Technical Service Representative (Seasonal)
Best Buy Canada
Canada
- Part-time
…services techniques à domicile, que nous appelons chez Best Buy agent(e) des services à…
Added 20 hours ago
DF
Team Manager - Clinic Operations
Decisive Farming by TELUS Agriculture
Montreal, QC
- Full-time
Ensure transparent, compassionate, and professional communication with patients
Added 20 hours ago
Executive Protection Agent, On Call/Agent(e) de protection exécutive, sur appel - Ottawa
GardaWorld
Ottawa, ON
Experience working independently and as part of a multi-agent protective detail.
Added 21 hours ago
NJ
Agent•e de programmes / Program Officer
National Judicial Institute (NJI) - l'Institut national de la magistrature (INM), Canada
Ottawa, ON
- Full-time
L’INM souhaite pourvoir un poste d’agent·e de programmes au sein du Service de la formation en personne. Ce poste temporaire situé à Montréal, est prévu pour remplacer une employée en congé…
Added 21 hours ago
TT
Agent/agente de sécurité en magasin, Prévention des pertes
The TJX Companies, Inc.
Mississauga, ON · Montreal, QC · CAN Home Office Mississauga ON
- $37,590 to $52,626 CAD / year
Nous sommes à la recherche d’un(e) agent(e) de sécurité en magasin, Prévention des pertes, pour nous aider à créer un environnement sûr, sécurisé et accueillant dans nos magasins. Dans ce…
Added 22 hours ago
Team Manager - Clinic Operations
TELUS
Montreal, QC
Ensure transparent, compassionate, and professional communication with patients
Added 1 day ago
BC
Purchasing Agent - Industrial West
Bird Construction
Edmonton, AB
- Full-time
Purchasing Agent - Industrial WestReporting to the Supply Chain Manager, the Purchaser is pivotal in ensuring the efficient and cost-effective procurement of materials and services for our…
Added 1 day ago
V
Software Engineer (Product - Backend)
Vasco
Remote, Canada
- Full-time
- Remote
…CTO, and work closely with our DevOps, Platform, Data, and Agent teams. The mission is to make GTM agents production-ready: reliable, fast, context-aware, and triggered at the right moment.…
Added 1 day ago
IF
Rental Sales Associate
Impact Fulfillment Services
Montreal, QC
- Full-time
Le Représentant des Ventes en Location agira en tant qu'agent de ventes de première ligne pour la location de véhicules au crédit-bailactuel de l’entreprise, pour les comptes commerciaux de…
Added 1 day ago
IF
Rental Sales Associate / Agent de vente de location
Impact Fulfillment Services
Montreal, QC
- Full-time
Le Représentant des Ventes en Location agira en tant qu'agent de ventes de première ligne pour la location de véhicules au crédit-bailactuel de l’entreprise, pour les comptes commerciaux de…

Simpro Software

SDET Lead

Montreal, QC, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 1, 2026
Experience: 7+ years of experience in software testing or software development, including 5+ years of hands-on experience writing test automation and 2+ years in a technical leadership role.
Posting language: English · French
Posted: Oct 2, 2026

Original job description

English section of this bilingual listing.

We are seeking an experienced SDET Lead to take ownership of test engineering for our AI agents and AI platform: the automation frameworks, the evaluation suites for LLM-based agents, and the quality gates in our pipelines. This is a hands-on role. You will write and review test code every week and set the testing standards the engineering teams follow.

You will bridge the gap between internal product management, engineering teams, and the AI engineers who build our agents - ensuring that our software releases meet the highest standards of reliability, performance, and security.

Design, build and maintain the test automation frameworks for our AI agents, the AI platform and its APIs.
Build evaluation suites for LLM-based agents: curated test datasets, regression checks on prompts and tool calls, and LLM-as-judge scoring, run on every change to a model, prompt or agent.
Test what is specific to agents: non-deterministic output, multi-step workflows, tool and API calls, guardrails, prompt injection and data leakage.
Establish automated quality gates within our CI/CD pipelines so that a change to code, a prompt or a model can't ship without passing its tests and evals.
Drive test planning, execution strategy, risk analysis, and test data management strategies.
Lead root-cause analysis (RCA) sessions for high-severity production defects and institute preventative measures.
Review test code and application code, and coach engineers on testability and automation.
Partner closely with Product Managers, Software Engineering Leads and AI engineers to integrate testing early in the AiDLC.
Serve as the primary escalation point for quality-related issues across all release streams.
Report quality health dashboards and operational status directly to senior technology leadership.
Professional proficiency in both French and English is standard for Montreal-based leadership positions to align with local business operations and Quebec language laws (Bill 96).
7+ years of experience in software testing or software development, including 5+ years of hands-on experience writing test automation and 2+ years in a technical leadership role.
Strong programming skills in TypeScript or Python. Ability to write production-quality test automation code and conduct code reviews for other engineers.
Expert, hands-on experience with test automation frameworks, preferably Playwright, or alternatively Cypress or Selenium, as well as API testing using tools such as Postman and REST APIs.
Experience testing LLM-based features or AI agents, including building evaluation suites, prompt regression tests, and red-team testing or security checks for AI systems.
Deep knowledge of release management and continuous delivery (CI/CD) pipelines, with experience using platforms such as Jenkins, GitHub Actions, or Azure DevOps.
Professional fluency in both French and English, spoken and written, required for local collaboration, communication, and compliance in Montreal.
Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.

Read the full bilingual original

Nous recherchons un(e) SDET Lead expérimenté(e) pour prendre en charge l’ingénierie des tests de nos agents d’IA et de notre plateforme d’IA, notamment les frameworks d’automatisation, les suites d’évaluation pour les agents basés sur les LLM et les contrôles qualité intégrés à nos pipelines.

Il s’agit d’un rôle très pratique et technique. Vous développerez et réviserez du code de test chaque semaine et définirez les normes de qualité et de test que les équipes d’ingénierie devront appliquer.

Vous serez le lien entre la gestion des produits internes, les équipes d’ingénierie et les ingénieurs spécialisés en IA qui développent nos agents. Votre rôle sera de vous assurer que nos versions logicielles respectent les normes les plus élevées en matière de fiabilité, de performance et de sécurité.

Key Responsibilities / Responsabilités principales

Test Engineering & Automation / Ingénierie des tests et automatisation

Design, build and maintain the test automation frameworks for our AI agents, the AI platform and its APIs.
Concevoir, développer et maintenir les frameworks d’automatisation des tests pour nos agents d’IA, notre plateforme d’IA et ses API.
Build evaluation suites for LLM-based agents: curated test datasets, regression checks on prompts and tool calls, and LLM-as-judge scoring, run on every change to a model, prompt or agent.
Créer des suites d’évaluation pour les agents basés sur les LLM : jeux de données de test soigneusement sélectionnés, tests de régression des prompts et des appels aux outils, ainsi que des évaluations utilisant un LLM comme juge, exécutées à chaque modification d’un modèle, d’un prompt ou d’un agent.
Test what is specific to agents: non-deterministic output, multi-step workflows, tool and API calls, guardrails, prompt injection and data leakage.
Tester les aspects spécifiques aux agents : sorties non déterministes, workflows en plusieurs étapes, appels aux outils et aux API, mécanismes de protection (guardrails), injections de prompts et fuites de données.
Establish automated quality gates within our CI/CD pipelines so that a change to code, a prompt or a model can't ship without passing its tests and evals.
Mettre en place des contrôles qualité automatisés (quality gates) dans nos pipelines CI/CD afin qu’aucune modification du code, d’un prompt ou d’un modèle ne puisse être mise en production sans avoir réussi les tests et les évaluations requis.
Drive test planning, execution strategy, risk analysis, and test data management strategies.
Piloter la planification des tests, la stratégie d’exécution, l’analyse des risques ainsi que les stratégies de gestion des données de test.
Lead root-cause analysis (RCA) sessions for high-severity production defects and institute preventative measures.
Diriger les séances d’analyse des causes profondes (RCA - Root Cause Analysis) pour les anomalies de production critiques et mettre en place des mesures préventives.
Review test code and application code, and coach engineers on testability and automation.
Effectuer des revues du code de test et du code applicatif, et accompagner les ingénieurs sur les pratiques favorisant la testabilité et l’automatisation.

Cross-Functional Collaboration / Collaboration interfonctionnelle

Partner closely with Product Managers, Software Engineering Leads and AI engineers to integrate testing early in the AiDLC.
Collaborer étroitement avec les Product Managers, les responsables de l’ingénierie logicielle et les ingénieurs IA afin d’intégrer les tests dès les premières étapes de l’AiDLC (AI Development Life Cycle).
Serve as the primary escalation point for quality-related issues across all release streams.
Être le principal point d’escalade pour les problèmes liés à la qualité sur l’ensemble des flux de mise en production.
Report quality health dashboards and operational status directly to senior technology leadership.
Présenter directement aux responsables technologiques seniors les tableaux de bord sur la santé de la qualité ainsi que l’état opérationnel des produits et des versions.

Core Competencies / Compétences clés

Test Automation Architecture / Architecture de l’automatisation des tests
QA Strategy & Test Governance / Stratégie QA et gouvernance des tests
AI Agent Testing / Tests des agents IA
Distributed Team Leadership / Leadership d’équipes distribuées
Metrics & Quality Analytics / Indicateurs et analyse de la qualité
Bilingual Communication / Communication bilingue
Professional proficiency in both French and English is standard for Montreal-based leadership positions to align with local business operations and Quebec language laws (Bill 96).
Maîtrise professionnelle du français et de l’anglais, à l’oral comme à l’écrit, généralement requise pour les postes de leadership basés à Montréal afin de répondre aux besoins des activités locales et aux exigences linguistiques du Québec (projet de loi 96).

Tool Stack / Stack Technologique:

Test & Defect Management / Gestion des tests et des anomalies: Jira, Xray, Zephyr, TestRail
Test Automation Frameworks / Frameworks d’automatisation des testss: Cypress, Playwright, Selenium, Appium, Postman, RestAssured
CI/CD & Pipeline Integration / Intégration CI/CD et pipelinesn: Jenkins, GitHub Actions, GitLab CI, Azure DevOps
Performance & Load Testing / Tests de performance et de charge: JMeter, k6, BlazeMeter
Collaboration / Collaboration: Confluence, Slack, MS Teams, Miro, Notion
Analytics & Reporting / Analyse et reporting: Power BI, Tableau, Jira Dashboards
AI Tooling / Outils d'intelligence artificielle: Claude, Codex...
AI Evaluation & Observability / Évaluation et observabilité de l'IA Langfuse, promptfoo, DeepEval, Ragas
Languages / Langages: TypeScript, Python

Qualifications & Requirements / Qualifications et exigences

Experience / Expérience

7+ years of experience in software testing or software development, including 5+ years of hands-on experience writing test automation and 2+ years in a technical leadership role.
Plus de 7 ans d’expérience en tests logiciels ou en développement logiciel, dont au moins 5 ans d’expérience pratique en automatisation des tests et 2 ans ou plus dans un rôle de leadership technique.

Programming / Programmation

Strong programming skills in TypeScript or Python. Ability to write production-quality test automation code and conduct code reviews for other engineers.
Solides compétences en programmation avec TypeScript ou Python. Capacité à développer du code d’automatisation de tests de qualité production et à effectuer des revues de code pour d’autres ingénieurs.

Technical Depth / Expertise technique

Expert, hands-on experience with test automation frameworks, preferably Playwright, or alternatively Cypress or Selenium, as well as API testing using tools such as Postman and REST APIs.
Expertise pratique et approfondie des frameworks d’automatisation des tests, idéalement Playwright, ou Cypress ou Selenium, ainsi que des tests d’API à l’aide d’outils tels que Postman et des API REST.

AI Testing / Tests d’IA

Experience testing LLM-based features or AI agents, including building evaluation suites, prompt regression tests, and red-team testing or security checks for AI systems.
Expérience dans les tests de fonctionnalités basées sur les LLM ou d’agents IA, notamment la création de suites d’évaluation, de tests de régression des prompts et de tests de type red team ou de contrôles de sécurité pour les systèmes d’IA.

Process Mastery / Maîtrise des processus

Deep knowledge of release management and continuous delivery (CI/CD) pipelines, with experience using platforms such as Jenkins, GitHub Actions, or Azure DevOps.
Connaissance approfondie de la gestion des mises en production et des pipelines de livraison continue (CI/CD), avec une expérience de plateformes telles que Jenkins, GitHub Actions ou Azure DevOps.

Language / Langues

Professional fluency in both French and English, spoken and written, required for local collaboration, communication, and compliance in Montreal.
Maîtrise professionnelle du français et de l’anglais, à l’oral comme à l’écrit, requise pour assurer la collaboration locale, la communication et la conformité à Montréal.

Education / Formation

Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
Diplôme de baccalauréat en informatique, en génie logiciel, dans un domaine connexe, ou expérience pratique équivalente.

Apply About employer

More about this job

Responsibilities

Lead hands-on test engineering for AI agents, the AI platform, and APIs by building automation frameworks, LLM evaluation suites, and automated quality gates in CI/CD pipelines. Set testing standards, guide engineers, lead root-cause analysis for critical production defects, and coordinate quality efforts with product, software engineering, and AI teams.

Requirements

Requires 7+ years in software testing or development, including 5+ years of hands-on test automation and 2+ years in technical leadership, with strong TypeScript or Python skills and expertise in automation and API testing. Candidates need experience testing LLM features or AI agents, CI/CD and release management knowledge, professional fluency in French and English, and a bachelor's degree in a relevant field or equivalent practical experience.

Skills

Test Automation Architecture
Quality Assurance Strategy
AI Agent Testing
TypeScript
Python
Playwright
Cypress
Selenium
API Testing
CI/CD
LLM Evaluation
Prompt Regression Testing
AI Security Testing
Test Planning
Root-Cause Analysis
Technical Leadership

Visa sponsorship

Not detected in the job text

Keywords

SDET
Test Automation
Test Engineering
AI Agents
AI Platform
LLM Evaluation
Prompt Regression Testing
LLM-as-Judge
Prompt Injection
Data Leakage
Guardrails
CI/CD
Jira
Xray
Zephyr
TestRail
Playwright
Cypress
Selenium
Appium
Postman
REST APIs
Jenkins
GitHub Actions
GitLab CI
Azure DevOps
JMeter
k6
Langfuse
promptfoo

Report this job