Find work in Canada.

623,179 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 3 hours ago
CS
Instructor, AI Machine Learning and AI Robotics with Python (Vancouver)
Circuit Stream
Vancouver, BC
- $1,500 to $1,650 CAD / week
- Contract
We’re looking for a software engineer, AI practitioner, python educator, data professional, or Masters/PhD student who can make Python, AI, machine learning, and robotics approachable for…
Added 15 hours ago
N
Software Engineer - Backend
Nominal
Montreal, QC
- $179,000 to $250,000 CAD / year
- Full-time
Nominal is building the Hardware Intelligence Platform that gives engineers increased visibility into complex physical systems, helps them make better decisions, and ultimately gets their…
Added 1 day ago
MB
Reliability Engineer / Project Engineer
Martin Brower UK and Ireland
New Westminster, BC
- Full-time
Primary role of the Reliability/ Project Engineer is to identify, manage, improve equipment run time and preventative maintenance program. At the same time, the role requires hands-on work…
Added 1 day ago
GD
QMS Auditor
General Dynamics Land Systems–Canada
London, ON
- Full-time
Physical Environment: manufacturing/shop floor, some office
Added 1 day ago
Développeur.se de logiciels sénior.e - applications réseau / Senior Software Developer - Networking
Electronic Arts
Vancouver, BC · Montreal, QC
As a Senior Software Engineer, you will collaborate with Research Scientists and Engineers to shape how new technologies integrate into core engine architecture. You will translate ideas…
Added 1 day ago
Sr/Staff Digital Design Engineer
Lightmatter
Toronto, ON
We are hiring a Digital Design Engineer to help develop an ASIC for the next-generation artificial intelligence computing architecture alongside a team of world-class scientists and…
Added 1 day ago
F
Principal Electrical Engineer - High Voltage Power Systems
Fluor
Calgary, AB
- Full-time
At Fluor, we believe that overall wellness encompasses the four wellness pillars of mental, physical, financial and social. Upon these pillars we are committed to fostering a healthy,…
Added 1 day ago
F
Principal Mechanical Engineer - Power
Fluor
Calgary, AB
- Full-time
Professional Engineer (P.Eng.) registration in Canada.Experience with major gas turbine, steam turbine, generator, HRSG, boiler, and related OEM technologies and suppliers.
Added 1 day ago
L
Sr/Staff Digital Design Engineer
Lightmatter
Toronto, ON
- Full-time
We are hiring a Digital Design Engineer to help develop an ASIC for the next-generation artificial intelligence computing architecture alongside a team of world-class scientists and…
Added 1 day ago
Développeur.se de logiciels sénior.e - applications dorsales / Senior Software Developer - Backend
Electronic Arts
Vancouver, BC
As a Senior Software Engineer, you will collaborate with Research Scientists and Engineers to shape how new technologies integrate into backend architecture. You will translate ideas from…
Added 1 day ago
CC
Process Engineer
Coca-Cola Canada Bottling Limited
Toronto, ON · North York, ON
- Full-time
The Reliability & Process Engineer is the plant technical owner for asset health, chronic-loss elimination and sustained line performance. Working closely with Operations and Maintenance,…
Added 1 day ago
X
Photonics Engineer - Systems Integration
Xanadu
Toronto, ON
- Full-time
We are looking for a hands-on, analytical, and driven Photonics Engineer to join our hardware team and accelerate the development of our Fault-Tolerant Quantum Computing (FTQC) systems. If…
Added 1 day ago
X
Senior Photonic Engineer – Experimentalist
Xanadu
Toronto, ON
- Full-time
We are seeking a Senior Photonic Engineer – Experimentalist to participate in designing, developing and experimentally validating cutting-edge photonic systems. Your primary focus will be…
Added 1 day ago
AC
Application Engineer
Atlas Copco Group
Montreal, QC
- Full-time
The Application Engineer plays a key technical expert role in the early stage of the sales process of compressed air installations, product customizations as well as complete engineered…
Added 1 day ago
AC
Application Engineer
Atlas Copco Group
Toronto, ON
- Full-time
The Application Engineer plays a key technical expert role in the early stage of the sales process of compressed air installations, product customizations as well as complete engineered…
Added 1 day ago
L
Process Automation Software Engineer - MEMS
Lumentum
Ottawa, ON · Canada - Ottawa (Bill Leathem)
- Full-time
Position Title: Process Automation Software Engineer - MEMS
Added 1 day ago
Staff Software Engineer, Integration Network (OIN)
Okta
Toronto, ON
As a Staff Software Engineer on the OIN team, you'll be a technical leader for a platform a very large share of Okta's customers depend on every day. You'll independently own complex,…
Added 1 day ago
FC
Principal Mechanical Engineer - Power
Fluor Corporation
Calgary, AB
- Full-time
Professional Engineer (P.Eng.) registration in Canada.Experience with major gas turbine, steam turbine, generator, HRSG, boiler, and related OEM technologies and suppliers.
Added 1 day ago
C&
EHS Specialist
Cushman & Wakefield
Markham, ON
- Full-time
…sign on behalf of AMD. Submit documentation to onsite AMD EHS…
Added 1 day ago
FC
Principal Electrical Engineer - High Voltage Power Systems
Fluor Corporation
Calgary, AB
- Full-time
At Fluor, we believe that overall wellness encompasses the four wellness pillars of mental, physical, financial and social. Upon these pillars we are committed to fostering a healthy,…
Added 1 day ago
MS
Senior QA Automation Engineer
Motorola Solutions
Vancouver, BC
- Full-time
As a Senior QA Automation Engineer, you will be a primary driver of our "Automation First" strategy. This role is weighted heavily toward technical development (70% Automation / 30%…
Added 1 day ago
MS
System Development Engineer II
Motorola Solutions
Vancouver, BC
- Full-time
As a System Development Engineer II, you sit at the high-velocity intersection of Software Engineering and Systems Architecture, building the sophisticated tooling that allows our systems…
Added 1 day ago
FI
Quality Engineer - Mainframe
FP Inc.
Toronto, ON · Scarborough, ON
- $50 to $65 CAD / hour
- Contract
…regardless of race, colour, religion, national origin, sex, physical or mental disability, or…
Added 1 day ago
C
Software Engineer - Crowdsourcing Platform
Calder
Toronto, ON
- Full-time
…4D data needed to reason on spatial problems and operate in physical environments. We capture, process, and deliver high-fidelity human-generated spatial data at scale, providing the…
Added 1 day ago
C
Finance & Business Engineer
Calder
Toronto, ON
- Full-time
…4D data needed to reason on spatial problems and operate in physical environments. We capture, process, and deliver high-fidelity human-generated spatial data at scale, providing the…

Digivance Solutions

Member of Technical Staff – AI Evaluation

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Oct 12, 2026

Original job description

Member of Technical Staff – AI Evaluation | Physical AI

Location: US or Canada (Remote) | On-site in San Mateo, CA, one week every six weeks

Experience: 5–15 years

Employment Type: Full-time

Equity: Competitive equity

Work Authorization: Existing work authorization required; visa sponsorship is not available.

About the Role

What does it take to evaluate an AI system that can engineer real-world physical systems?

We’re looking for a Member of Technical Staff – AI Evaluation to build evaluation frameworks for an AI engineer working across physical engineering domains. This is an opportunity to define how AI engineering capabilities are measured, benchmarked against human engineers, and improved over time.

You will work at the intersection of agentic AI, AI evaluation, and physical engineering, building systems that determine not just whether an AI model produces an answer, but whether its engineering decisions are technically sound, reliable, and practically useful.

This is a high-ownership, individual contributor role for someone who enjoys solving ambiguous problems, building from scratch, and turning rigorous evaluations into measurable improvements.

What You'll Do

Build and own AI evaluation frameworks from the ground up, defining what high-quality engineering design and reasoning look like when there is no single correct answer.
Create realistic evaluation tasks based on real-world engineering workflows, constraints, edge cases, and failure modes.
Design automated evaluation judges, including LLM-as-a-Judge systems, and validate their results against expert human judgment.
Develop human-in-the-loop evaluation processes and reproducible testing environments for agentic AI systems.
Collaborate with engineering subject matter experts, customers, partners, and internal technical teams to understand how expert engineers work.
Analyze evaluation results, identify model weaknesses, and translate findings into actionable priorities for improving AI reasoning and performance.

What We're Looking For

5–15 years of relevant experience as a Member of Technical Staff, AI Engineer, AI Research Scientist, or in a closely related technical role.
Hands-on AI evaluation experience is mandatory: You have created evaluation tasks, designed evaluation judges, and conducted human evaluations for AI systems.
A strong understanding of agentic AI systems and the challenges involved in evaluating multi-step reasoning, task execution, and complex outputs.
A technical background in physical engineering, such as mechanical, electrical, aerospace, robotics, or power systems engineering, with the ability to assess engineering design quality.
Experience validating automated evaluation results against human or expert judgment.
Strong ownership and communication skills, with experience working directly with technical experts, customers, partners, or cross-functional teams.
Ability to work independently in an ambiguous, fast-moving environment.

Nice to Have

Experience at a physical AI, robotics, or engineering automation company.
Experience building technical systems, products, or evaluation frameworks from zero to one in an early-stage startup.
Familiarity with human-in-the-loop evaluation, evaluation harnesses, benchmark design, and LLM-as-a-Judge.
Exposure to supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), simulation environments, or engineering design tools.

Why Consider This Opportunity?

Own a critical evaluation framework for an ambitious AI engineering product.
Work at the intersection of frontier AI, agentic systems, robotics, and physical engineering.
Collaborate directly with engineering experts and technical teams to shape how AI engineering capabilities are measured and improved.
Take end-to-end ownership of a challenging, zero-to-one technical initiative.
Receive competitive equity and comprehensive benefits.

Location and Eligibility

This is a full-time opportunity for candidates based in the United States or Canada, with remote work and a required on-site week in San Mateo, California, every six weeks. Relocation is considered on a case-by-case basis.

Candidates must already have appropriate work authorization. Visa sponsorship is not available.

Apply About employer

More about this job

Responsibilities

Build and own evaluation frameworks, realistic engineering tasks, automated judges, human-in-the-loop processes, and reproducible testing environments for agentic AI systems. Analyze evaluation results, validate them against expert judgment, and turn identified weaknesses into actionable improvements to AI reasoning and performance.

Requirements

Requires 5–15 years of relevant technical experience, hands-on experience creating AI evaluation tasks and judges and conducting human evaluations, and a strong understanding of agentic AI evaluation. Candidates need a physical engineering background, experience validating automated evaluations against expert judgment, and the ability to work independently and communicate with technical stakeholders.

Skills

AI Evaluation
Agentic AI
Evaluation Framework Design
Evaluation Task Design
LLM-as-a-Judge
Human-in-the-Loop Evaluation
Benchmark Design
Automated Evaluation
Expert Judgment Validation
Multi-Step Reasoning Evaluation
Physical Engineering
Engineering Design Assessment
Reproducible Testing Environments
Evaluation Analysis
Supervised Fine-Tuning
Reinforcement Learning with Verifiable Rewards

Benefits

Competitive Equity
Comprehensive Benefits

Visa sponsorship

Not detected in the job text

Keywords

Physical AI
Agentic AI
AI Evaluation
Evaluation Frameworks
Engineering Design
Engineering Reasoning
Evaluation Tasks
LLM-as-a-Judge
Human-in-the-Loop Evaluation
Evaluation Harnesses
Benchmark Design
Automated Evaluation
Expert Human Judgment
Multi-Step Reasoning
Task Execution
Reproducible Testing Environments
Mechanical Engineering
Electrical Engineering
Aerospace Engineering
Robotics
Power Systems Engineering
Supervised Fine-Tuning
Reinforcement Learning with Verifiable Rewards
Simulation Environments
Engineering Design Tools
AI Reasoning
Model Performance
Engineering Automation

Report this job