Find work in Canada.

A simpler way to find your next job.

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 5 mins ago
A|
Civil Designer - Level 1
AGI | Global Food Infrastructure
Winnipeg, MB
- Full-time
AGI is a global food-based infrastructure company publicly traded in Canada. With over 3,800 employees and over 30 global manufacturing brands, AGI is a leading provider of equipment and…
Added 5 mins ago
NT
ENO Field Engineer
NORTHWEST TERRITORIES POWER CORPORATION
Inuvik, NT
- Full-time
Reporting to the Asset Manager, Energy North Operations Division, the Thermal Field Engineer provides critical engineering support for the operation, maintenance, and reliability of thermal…
Added 36 mins ago
V
Senior NPI Engineer
Voltera
Waterloo, ON
- Full-time
Partner closely with offshore contract manufacturers (CMs) and suppliers in Shenzhen, China, to ensure the final manufactured product strictly matches our design intent, accuracy, and…
Added 52 mins ago
TJ
Intermediate Mechanical Engineer, Industrial HVAC & Building Systems
The JNE Group of Companies
Hamilton, ON
- Full-time
…supporting industrial projects primarily within the steel, mining, and heavy industrial sectors. The role will primarily involve the design of HVAC, ventilation, plumbing, natural gas, and…
Added 1 hour ago
BH
Tech Lead - ToolHound
Beacon Holdings
Remote, Canada
- Full-time
- Remote
This role is one of those seats. You will be the technical leader for ToolHound, a mature, profitable tool-and-asset-management platform used by industrial, construction, energy, and…
Added 1 hour ago
VE
Senior Electrical Engineer
Vard Electro
Vancouver, BC
- Full-time
The Electrical Engineer will be responsible for the design, integration, and optimization of electrical systems for maritime applications. This role involves leading multidisciplinary…
Added 1 hour ago
UO
Assistant Professor in High Temperature Metals Processing
University of British Columbia
Vancouver, BC · UBCV | Frank Forward Building (FORW)
- Full-time
…distinguished itself with excellence in research, teaching and service in Materials Engineering. The Department has a strong record of collaborative work within UBC and industry and…
Added 1 hour ago
UO
Assistant Professor in High Temperature Metals Processing
University of British Columbia
Vancouver, BC · UBCV | Frank Forward Building (FORW)
- Full-time
…distinguished itself with excellence in research, teaching and service in Materials Engineering. The Department has a strong record of collaborative work within UBC and industry and…
Added 1 hour ago
JI
Engineer-in-Training, Production
J.D. Irving, Limited
Halifax, NS
- Full-time
As a Production Engineer-in-Training (EIT), you'll play a key role in transforming complex shipbuilding designs into safe, efficient, and executable production plans. Working within our…
Added 1 hour ago
J
Structural Engineering Professional Career - NW Region (CAN) 46997
Jacobs
Calgary, AB
- Full-time
Jacobs is recognized globally as one of the leading design firms for advanced technology industrial projects. We design some of the most complex and specialized facilities being constructed…
Added 1 hour ago
FA
Industrial Engineer
FTAI Aviation LLC
Montreal, QC
- Full-time
As an Industrial Engineer, you will support the growth and operational readiness of FTAI’s aeroderivative engine program while driving continuous improvement initiatives across the…
Added 1 hour ago
FA
Asset Management Junior Propulsion Engineer
FTAI Aviation LLC
Montreal, QC
- Full-time
FTAI owns and maintains commercial jet engines with a focus on CFM56 and V2500 engines. FTAI’s propriety portfolio of products, including the Module Factory and a joint venture to…
Added 1 hour ago
PR
Lead Structural Engineer - Solar
Polar Racking Inc.
Mississauga, ON
- $100,000 to $115,000 CAD / year
- Full-time
Polar Racking Inc. is a North American leader in the design, engineering and manufacturing of PV mounting systems. We are at the forefront of PV innovation, leading the industry in…
Added 1 hour ago
I
Mechanical Engineer (Precision Systems)
icspi
Kitchener, ON
- Full-time
Our desktop AFM instruments have reset the expectations for nanoscale imaging and are used by hundreds of scientists and engineers in over 40 countries to accelerate R&D and drive…
Added 1 hour ago
M
Control Systems Engineer
Mantu
Laval, QC
- Full-time
Amaris Consulting is looking for a Control Systems Engineer to join a heavy-equipment and industrial technology team in Laval.
Added 1 hour ago
RC
Rotating Equipment Engineer
Randstad Canada
Vancouver, BC · Greater Vancouver Metropolitan Area
- $75 to $100 CAD / hour
- Contract
We are seeking a Rotating Equipment Engineer for a 6 month contract engagement with a client of ours in the Vancouver area. This role works closely with Operations, Maintenance, Technical…
Added 1 hour ago
WM
Junior Mechanical Engineer
Weldco-Beales MFG Alberta Ltd
Edmonton, AB
- $28 to $33 CAD / hour
- Full-time
The Mechanical Engineering Technologist position is detail-oriented and skilled. This position is required to support design, development, and production of heavy equipment attachments.…
Added 2 hours ago
A
Mechanical Engineer – Nuclear Industry
AspiringIT
Oshawa, ON
- $70,000 to $80,000 CAD / year
- Full-time
We are seeking a Mechanical Engineer with 7+ years of experience to support engineering design, analysis, testing, and field activities for nuclear power projects. The ideal candidate will…
Added 2 hours ago
M
Security Software Engineer
Motive
Vancouver, BC
- Full-time
As a Sr Software Engineer, Security, you will design and build secure, scalable systems that protect Motive’s products, infrastructure, and customer data. You will report into Pankaj…
Added 2 hours ago
CC
Principal Embedded Software Engineer
Coherent Corp.
Markham, ON
- Full-time
Design and develop software features based on high level customer and product line management requirements
Added 2 hours ago
CC
Lead Embedded Software Engineer
Coherent Corp.
Markham, ON
- Full-time
Design and develop software features based on high level customer and product line management requirements
Added 3 hours ago
HT
PD Service - Mechanical
Husky Technologies
Bolton, ON
- Full-time
Husky TechnologiesTM Canadian manufacturing facilities and global headquarters are located in Bolton, Ontario on a large, beautiful campus located just 20 minutes north of Toronto’s Pearson…
Added 3 hours ago
HT
Product Development Engineer
Husky Technologies
Bolton, ON
- Full-time
Our Development Engineering team is looking to hire an experienced Product Development Engineer. The successful candidate will lead the technical development of packaging products working…
Added 3 hours ago
PI
Electrical Engineer
ProMach Innovation Center
Oakville, ON
- Full-time
This role is ideal for a design-focused engineer who enjoys developing complete electrical systems and seeing their designs come to life in complex, automated packaging environments.
Added 3 hours ago
HT
PD Software for Service
Husky Technologies
Bolton, ON
- Full-time
Husky TechnologiesTM Canadian manufacturing facilities and global headquarters are located in Bolton, Ontario on a large, beautiful campus located just 20 minutes north of Toronto’s Pearson…

Nexxa.AI

Senior Software Development Engineer in Test (SDET), QA - AI Systems

Remote, Canada

Remote

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Remote
Posting language: English
Posted: Oct 19, 2026

Original job description

About Nexxa

Nexxa is building the best AI systems for heavy industries, enabling machines, systems and operations to think, decide and act autonomously across manufacturing, large-scale infrastructure, logistics and legacy environments.

Our mission is to translate deep technical breakthroughs into operational reality, solving some of the hardest systems-level problems in industry.

Role Overview

We’re looking for a Senior / Staff SDET to own quality for Nexxa’s AI agent systems, combining deep test automation with hands-on manual and exploratory testing. Our agents plan, call tools, and take multi-step actions autonomously in industrial environments. You’ll write production-grade code to build evaluation harnesses, simulation environments, and CI/CD quality gates, and you’ll also get hands-on with the agents yourself: probing behavior, reviewing traces, and validating releases where automation alone can’t judge whether the agent did the right thing.

You’ll work closely with ML engineers, backend engineers, and Forward Deployed Engineers to define what “good” looks like for an agent operating in high-stakes industrial settings, then build and run the systems and processes that measure it continuously.

Key Responsibilities

Automation and Infrastructure

Design, build, and maintain test frameworks, evaluation harnesses, and regression suites for LLM-based agents, covering reasoning quality, tool-call correctness, task completion, and multi-turn coherence.
Build automated pipelines that run evals and test suites on every model, prompt, or tool-integration change, and integrate them into CI/CD as enforceable quality gates.
Develop simulators, mocks, and sandbox environments for industrial systems and tool APIs so agents can be tested safely, repeatably, and at scale.
Implement API, contract, integration, and end-to-end tests for the services, tools, and orchestration layers that agents depend on.
Develop performance, load, and reliability tests for agent workflows, including failure injection and resilience testing.

Manual and Exploratory Testing

Perform hands-on exploratory testing of agent behavior, including new capabilities, ambiguous or underspecified requests, long multi-turn sessions, and unusual operational scenarios that scripted tests don’t anticipate.
Manually review agent traces and outputs to judge reasoning quality, appropriateness of actions, and safety, and use those findings to improve automated checks.
Execute manual regression and release verification passes in staging and customer-like environments before new agent capabilities ship.
Conduct manual red-teaming sessions (prompt injection, jailbreaks, tool misuse, unsafe actions) in partnership with security teams, then convert successful attacks into automated test cases.
Support user acceptance testing and pilot rollouts with Forward Deployed Engineers, capturing real-world failures and feeding them back into test suites.
Write clear test plans, test charters, and bug reports, and maintain manual test documentation where automation isn’t yet practical or cost-effective.

Datasets, Metrics, and Quality Strategy

Create and manage golden datasets and labeled test sets, including edge cases, ambiguous inputs, and adversarial prompts specific to industrial and operational contexts, with tooling for versioning and drift detection.
Design rubrics and run human-in-the-loop evaluations where automated scoring isn’t reliable enough.
Define and instrument quality metrics beyond simple accuracy (groundedness, hallucination rate, task success rate, latency/cost tradeoffs, and safety violations) and build dashboards to track them over time.
Test agent behavior across the full action loop (planning, tool selection, tool execution, error recovery, and final output), not just the final response.
Investigate and triage failures where the root cause could be the model, the prompt, the tool/API, or the orchestration logic, and turn them into reproducible, actionable bug reports.
Establish quality bars, release criteria, and sign-off processes for new agent capabilities, blending automated gates with manual verification.
Decide what to automate and what to keep manual, and continually shift repeatable manual work into automation.
Mentor engineers on testing strategies and test-driven practices for probabilistic, LLM-driven systems.
Advocate for testability, observability, and tracing in agent architecture from day one.

Qualifications

5+ years as an SDET, QA engineer, or software engineer with a strong testing focus, with demonstrated ownership of test strategy and automation for complex distributed systems.
Proven experience in both manual and automated testing, including exploratory testing, test planning, and writing high-quality bug reports.
Strong programming skills (Python preferred) with a software engineering mindset: clean, maintainable, well-reviewed code for frameworks, data pipelines, and tooling.
Experience building test frameworks and infrastructure from the ground up, not just writing test cases within an existing framework.
Hands-on experience with CI/CD systems (e.g., GitHub Actions, GitLab CI, Jenkins) and containerized test environments (Docker, Kubernetes).
Experience testing APIs and microservices, including contract, integration, and end-to-end testing.
Hands-on experience testing LLM-based products, chatbots, or AI agents, and an understanding of why traditional deterministic assertions break down for generative systems.
Practical experience with eval frameworks or tooling (e.g., promptfoo, DeepEval, RAGAS, LangSmith) or a track record of building your own.
Understanding of how LLM agents work: prompting, tool/function calling, context management, RAG, memory, and orchestration frameworks.
Experience designing test data and labeled datasets, including sourcing, sampling, and managing dataset drift over time.
Familiarity with LLM-specific failure modes: hallucination, prompt injection, context poisoning, tool misuse, goal drift, and non-determinism.
Comfort operating in ambiguity, defining what “correct” means for a task when there’s no single right answer.
Strong written communication skills for turning fuzzy quality signals into clear, actionable findings for engineering and product stakeholders.

Preferred

Experience with human-in-the-loop evaluation workflows (labeling pipelines, inter-rater reliability, rubric design).
Experience with performance and load testing tools (e.g., k6, Locust) and chaos or fault-injection testing.
Background in ML/data science sufficient to read model evals and statistical significance.
Experience red-teaming or doing adversarial/security testing on ML systems.
Familiarity with observability and tracing tools for LLM applications (e.g., LangSmith, Arize, Langfuse, Weights & Biases) and general observability stacks (OpenTelemetry, Grafana, Datadog).
Experience testing systems in industrial, IoT, or operational technology (OT) environments, including industrial protocols (OPC UA, MQTT, Modbus) or simulation and hardware-in-the-loop setups.
Experience supporting UAT, pilots, or customer-facing validation of complex products.
Experience setting up test and eval infrastructure from scratch at a startup or fast-moving team.

What We’re Looking For

An engineer who is equally comfortable writing a test framework and sitting down to break an agent by hand.
Someone who can build rigorous evaluation systems for problems that don’t have a single right answer, and who knows when human judgment is the right tool.
A systems thinker who enjoys turning ambiguous agent behavior into measurable, trustworthy signals.
A strong collaborator who partners well with ML engineers, backend engineers, and Forward Deployed teams.

Why Join Nexxa.AI?

Innovative Environment: Play a critical role in transforming heavy industries through groundbreaking AI and automation technologies.
Collaborative Culture: Be part of a team that values innovation, discipline, and continuous improvement.
Professional Growth: Benefit from significant opportunities for career development and advancement.
Competitive Compensation: Enjoy a comprehensive salary and equity package reflective of your expertise and contributions.

If you’re passionate about AI quality and eager to help define what trustworthy autonomous systems look like in heavy industry, we’d love to connect.

Apply About employer

More about this job

Responsibilities

You will design and maintain automated test frameworks and evaluation harnesses for LLM-based AI agents in industrial environments. Additionally, you will perform manual exploratory testing, red-teaming, and define quality metrics to ensure the reliability and safety of autonomous systems.

Requirements

The role requires 5+ years of experience in SDET or software engineering with a strong focus on testing complex distributed systems. Candidates must possess strong Python programming skills and practical experience with CI/CD pipelines, containerization, and testing generative AI or LLM-based products.

Skills

Python
Test automation
LLM evaluation
CI/CD
Exploratory testing
API testing
Distributed systems
Docker
Kubernetes
Prompt engineering
Performance testing
Data pipelines
Software engineering
Quality assurance
Debugging
System architecture

Benefits

Competitive salary
Equity package

Remote locations

Toronto, Canada

Remote locations (standardized)

Toronto, Ontario, Canada

Visa sponsorship

Not detected in the job text

Keywords

SDET
AI Systems
LLM
Python
Test Automation
CI/CD
GitHub Actions
Docker
Kubernetes
API Testing
Exploratory Testing
Red-teaming
Prompt Injection
RAG
LangSmith
DeepEval
Promptfoo
Distributed Systems
Quality Assurance
Industrial Automation
Observability
OpenTelemetry
Data Pipelines
Regression Testing
Performance Testing
Chaos Engineering
Software Engineering
Machine Learning
Evaluation Harnesses
Autonomous Systems

Report this job