Find work in Canada.

441,664 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 6 mins ago
F
Senior Control Systems Engineer
Fluor
Calgary, AB
- Full-time
We are seeking a Senior Control Systems Engineer to lead the design, development, and implementation of control and automation systems for complex industrial projects. In this role, you…
Added 6 mins ago
M
Solution Engineer - Apps & Agents
Microsoft
Toronto, ON
- Full-time
In this role you will be the Solution Engineer, Apps & Agents (pre-sales consultant) for your assigned workload and a member of the sales team that consists of Solution Specialist, Customer…
Added 6 mins ago
M
Solution Engineer - Apps & Agents
Microsoft
Calgary, AB · Edmonton, AB · Vancouver, BC
- Full-time
In this role you will be the Solution Engineer, Apps & Agents (pre-sales consultant) for your assigned workload and a member of the sales team that consists of Solution Specialist, Customer…
Added 18 mins ago
C
MEP VDC/BIM Specialist
CadMakers
Burnaby, BC
- $75,000 to $95,000 CAD / year
- Full-time
🚀 Optimize Processes: Improve our MEP standards, templates, families and automation (e.g. Dynamo, pyRevit and cmCore tools) so every project runs faster and cleaner than the last
Added 19 mins ago
C
MEP VDC/BIM Specialist
CadMakers
Remote, Canada
- $75,000 to $95,000 CAD / year
- Full-time
- Remote
🚀 Optimize Processes: Improve our MEP standards, templates, families and automation (e.g. Dynamo, pyRevit and cmCore tools) so every project runs faster and cleaner than the last
Added 1 hour ago
Principal Engineer, CAD
SiTime Corporation
Ottawa, ON
The Principal Engineer, CAD will provide CAD Software support for Digital, Analog and Mixed-Signal designs, using Cadence, Synopsys, Siemens, Keysight & 3rd party vendor tools.…
Added 1 hour ago
ASIC Digital Verification Engineer
SiTime Corporation
Ottawa, ON
As a Systems Engineer we are the first in line to work on brand new devices from Silicon Designers before they get into the hands of customers. The devices that SiTime Canada works on are…
Added 1 hour ago
7
Senior Security Engineer
7shifts
Remote, Canada
- $140,000 to $170,000 CAD / year
- Full-time
- Remote
Engineer and tune Datadog SIEM detections and our wider technical controls to cut noise, close coverage gaps, and route high-fidelity alerts straight to #secops
Added 1 hour ago
7
AI Workflow Engineer
7shifts
Canada
- Full-time
As an AI Workflow Engineer at 7shifts, you’ll help teams across the business rethink how work gets done and build the automations that create meaningful capacity and output. Reporting to…
Added 1 hour ago
C
AI Builder
Clarity
Vancouver, BC
- $85,000 to $185,000 CAD / year
- Full-time
You will work alongside a senior engineer as part of a small, high-impact team, embedded at the intersection of technology and business. Your work will directly shape how ~180 people work,…
Added 1 hour ago
L
Senior Software Engineer
LyveChat
Toronto, ON
- $150,000 to $190,000 CAD / year
- Full-time
Added 1 hour ago
C
AI Builder
Clarity
Vancouver, BC
- $85,000 to $185,000 CAD / year
- Full-time
You will work alongside a senior engineer as part of a small, high-impact team, embedded at the intersection of technology and business. Your work will directly shape how ~180 people work,…
Added 2 hours ago
I
Database Automation Test Engineer
INFOYA
Toronto, ON
- $75,000 to $80,000 CAD / year
- Full-time
experienced Senior Automation Engineer with strong expertise
Added 2 hours ago
IW
Platform Engineering Lead - Privileged Access Management (PAM) Vault Engineer
IG Wealth Management
MB · Manitoba, Canada
- Full-time
The Senior Manager, Platform Engineering (Privileged Access Management (PAM) Vault Engineer) is accountable for platform outcomes that enable consistent, secure, and scalable delivery…
Added 2 hours ago
IW
Platform Engineering Lead - Privileged Access Management (PAM) Vault Engineer
IG Wealth Management
ON · Ontario, Canada
- Full-time
The Senior Manager, Platform Engineering (Privileged Access Management (PAM) Vault Engineer) is accountable for platform outcomes that enable consistent, secure, and scalable delivery…
Added 2 hours ago
N
Senior Data Engineer, Analytics
nesto
Vancouver, BC
- Full-time
Python (PySpark or pandas) for ingestion, validation and automation.
Added 2 hours ago
PA
Site Reliability Engineer
Porter Airlines Inc.
Toronto, ON
- Full-time
Porter is hiring an experienced Site Reliability Engineer to help improve the reliability, scalability, and performance of a modern cloud platform supporting thousands of users.
Added 3 hours ago
AI
Adobe Site Reliability Engineer - Content Delivery Network
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Senior Site Reliability Engineer - AEM - Content Delivery Network
Added 3 hours ago
AI
Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Strong proficiency in Python for automation, API integrations, infrastructure tooling, agent services, and production scripting.
Added 3 hours ago
FS
Senior Platform Engineer, Performance Management
Four Seasons Hotels and Resorts
Toronto, ON · Four Seasons Corporate Headquarters Toronto
- Full-time
The Senior Platform Engineer is responsible for managing the technical delivery lifecycle of Dynamics 365 Finance & Operations (D365 F&O), including source control, branching strategies,…
Added 3 hours ago
Data Engineer Sr
Insight Enterprises, Inc.
Toronto, ON
We are seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence, and AI-driven solutions.
Added 3 hours ago
PC
DevOps Engineer, Capital Markets
Pyramid Consulting, Inc
Halifax, NS
- $42 CAD / hour
- Contract
Immediate need for a talented DevOps Engineer, Capital Markets. This is a 06+months contract opportunity with long-term potential and is located in Halifax, NS(Hybrid). Please review the…
Added 3 hours ago
PA
Site Reliability Engineer
Porter Airlines Inc.
Toronto, ON
- Full-time
Porter is hiring an experienced Site Reliability Engineer to help improve the reliability, scalability, and performance of a modern cloud platform supporting thousands of users.
Added 3 hours ago
I
Database Automation Test Engineer
Infoya
Toronto, ON
- $75,000 to $80,000 CAD / year
- Full-time
About the Job: Infoya is looking for an experienced Senior Automation Engineer with strong expertise in database testing and automation, data pipeline testing and ETL validation. The…
Added 4 hours ago
Mechanical Design Manager
ATS Automation
Cambridge, ON
Join our globally growing team at ATS Industrial Automation where we create complex automation solutions at the highest level that sustainably impact lives around the world.

Digivance Solutions

Member of Technical Staff – AI Evaluation

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Oct 12, 2026

Original job description

Member of Technical Staff – AI Evaluation | Physical AI

Location: US or Canada (Remote) | On-site in San Mateo, CA, one week every six weeks

Experience: 5–15 years

Employment Type: Full-time

Equity: Competitive equity

Work Authorization: Existing work authorization required; visa sponsorship is not available.

About the Role

What does it take to evaluate an AI system that can engineer real-world physical systems?

We’re looking for a Member of Technical Staff – AI Evaluation to build evaluation frameworks for an AI engineer working across physical engineering domains. This is an opportunity to define how AI engineering capabilities are measured, benchmarked against human engineers, and improved over time.

You will work at the intersection of agentic AI, AI evaluation, and physical engineering, building systems that determine not just whether an AI model produces an answer, but whether its engineering decisions are technically sound, reliable, and practically useful.

This is a high-ownership, individual contributor role for someone who enjoys solving ambiguous problems, building from scratch, and turning rigorous evaluations into measurable improvements.

What You'll Do

Build and own AI evaluation frameworks from the ground up, defining what high-quality engineering design and reasoning look like when there is no single correct answer.
Create realistic evaluation tasks based on real-world engineering workflows, constraints, edge cases, and failure modes.
Design automated evaluation judges, including LLM-as-a-Judge systems, and validate their results against expert human judgment.
Develop human-in-the-loop evaluation processes and reproducible testing environments for agentic AI systems.
Collaborate with engineering subject matter experts, customers, partners, and internal technical teams to understand how expert engineers work.
Analyze evaluation results, identify model weaknesses, and translate findings into actionable priorities for improving AI reasoning and performance.

What We're Looking For

5–15 years of relevant experience as a Member of Technical Staff, AI Engineer, AI Research Scientist, or in a closely related technical role.
Hands-on AI evaluation experience is mandatory: You have created evaluation tasks, designed evaluation judges, and conducted human evaluations for AI systems.
A strong understanding of agentic AI systems and the challenges involved in evaluating multi-step reasoning, task execution, and complex outputs.
A technical background in physical engineering, such as mechanical, electrical, aerospace, robotics, or power systems engineering, with the ability to assess engineering design quality.
Experience validating automated evaluation results against human or expert judgment.
Strong ownership and communication skills, with experience working directly with technical experts, customers, partners, or cross-functional teams.
Ability to work independently in an ambiguous, fast-moving environment.

Nice to Have

Experience at a physical AI, robotics, or engineering automation company.
Experience building technical systems, products, or evaluation frameworks from zero to one in an early-stage startup.
Familiarity with human-in-the-loop evaluation, evaluation harnesses, benchmark design, and LLM-as-a-Judge.
Exposure to supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), simulation environments, or engineering design tools.

Why Consider This Opportunity?

Own a critical evaluation framework for an ambitious AI engineering product.
Work at the intersection of frontier AI, agentic systems, robotics, and physical engineering.
Collaborate directly with engineering experts and technical teams to shape how AI engineering capabilities are measured and improved.
Take end-to-end ownership of a challenging, zero-to-one technical initiative.
Receive competitive equity and comprehensive benefits.

Location and Eligibility

This is a full-time opportunity for candidates based in the United States or Canada, with remote work and a required on-site week in San Mateo, California, every six weeks. Relocation is considered on a case-by-case basis.

Candidates must already have appropriate work authorization. Visa sponsorship is not available.

Apply About employer

More about this job

Responsibilities

Build and own evaluation frameworks, realistic engineering tasks, automated judges, human-in-the-loop processes, and reproducible testing environments for agentic AI systems. Analyze evaluation results, validate them against expert judgment, and turn identified weaknesses into actionable improvements to AI reasoning and performance.

Requirements

Requires 5–15 years of relevant technical experience, hands-on experience creating AI evaluation tasks and judges and conducting human evaluations, and a strong understanding of agentic AI evaluation. Candidates need a physical engineering background, experience validating automated evaluations against expert judgment, and the ability to work independently and communicate with technical stakeholders.

Skills

AI Evaluation
Agentic AI
Evaluation Framework Design
Evaluation Task Design
LLM-as-a-Judge
Human-in-the-Loop Evaluation
Benchmark Design
Automated Evaluation
Expert Judgment Validation
Multi-Step Reasoning Evaluation
Physical Engineering
Engineering Design Assessment
Reproducible Testing Environments
Evaluation Analysis
Supervised Fine-Tuning
Reinforcement Learning with Verifiable Rewards

Benefits

Competitive Equity
Comprehensive Benefits

Visa sponsorship

Not detected in the job text

Keywords

Physical AI
Agentic AI
AI Evaluation
Evaluation Frameworks
Engineering Design
Engineering Reasoning
Evaluation Tasks
LLM-as-a-Judge
Human-in-the-Loop Evaluation
Evaluation Harnesses
Benchmark Design
Automated Evaluation
Expert Human Judgment
Multi-Step Reasoning
Task Execution
Reproducible Testing Environments
Mechanical Engineering
Electrical Engineering
Aerospace Engineering
Robotics
Power Systems Engineering
Supervised Fine-Tuning
Reinforcement Learning with Verifiable Rewards
Simulation Environments
Engineering Design Tools
AI Reasoning
Model Performance
Engineering Automation

Report this job