Find work in Canada.

341,228 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 23 mins ago
TC
Adobe Site Reliability Engineer
Tata Consultancy Services
Toronto, ON
- $100,000 to $130,000 CAD / year
- Full-time
…certificates, cache and invalidation health, and every third-party integration on the page – Search, Consent Management, Analytics, Personalization and AI services and many more to…
Added 23 mins ago
HS
Senior Software Engineer, Dentrix Ascend
Henry Schein One UK
Surrey, BC
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 23 mins ago
ZT
Senior Electrical Engineer
Zebra Technologies
Mississauga, ON
- Full-time
We are seeking an Advanced Electrical Engineer to join our Hardware Platform Engineering team. In this role, your primary focus will be assisting core hardware platform development and…
Added 24 mins ago
Field Application Engineer (Integrated Photonics)
Axiomatic_AI
Toronto, ON
We are seeking an experienced Field Application Engineer with expertise across the PIC development lifecycle - from device and circuit design through simulations, tapeout, characterization,…
Added 24 mins ago
FI
Staff Supply Chain Simulation Scientist
Fulfillment IQ
Remote, Canada
- Full-time
- Remote
Workbench is FIQ's warehouse-design platform: it lets a solutions engineer draw a warehouse the way an architect draws a building. You will design, build and own Workbench’s warehouse…
Added 24 mins ago
FI
Senior Simulation Scientist
Fulfillment IQ
Remote, Canada
- Full-time
- Remote
Workbench is FIQ's warehouse-design platform: it lets a solutions engineer draw a warehouse the way an architect draws a building. You will design, build and own Workbench’s warehouse…
Added 24 mins ago
I
QA Automation Engineer - ETL/Database
INFOYA
Toronto, ON
- $100,000 to $115,000 CAD / year
- Full-time
experienced Senior Automation Engineer with strong expertise
Added 1 hour ago
1
Applied AI Engineer - Evaluation & Reliability
15Rock
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own
Added 2 hours ago
AI
Site Reliability Engineer – Azure Operations, Databricks Support & Incident Response
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
As an Intermediate Site Reliability Engineer, you will support and continuously improve enterprise Azure and Databricks platforms. The role focuses on production reliability, monitoring,…
Added 3 hours ago
SP
Software Engineering LMTS
Salesforce Partner Canada
Vancouver, BC
- Full-time
The software engineer role at Salesforce encompasses architecture, design, implementation, and testing to ensure we build products right and release them with high quality. Equally…
Added 4 hours ago
K
Senior Software Engineer – DevTest / QA Automation
Kaseya
Toronto, ON
- Full-time
Kaseya is seeking a Senior Software Engineer – DevTest / QA Automation to design, build, and maintain robust automated testing capabilities across enterprise software platforms.
Added 6 hours ago
LG
Server Engineer - Unannounced Project
Lightfox Games
Vancouver, BC
- Full-time
Lightfox Games is seeking a talented and enthusiastic Server Engineer to join our Vancouver based team to work on an unannounced mobile game for a world-class IP and Publisher. This role is…
Added 6 hours ago
AC
D365 F&O Functional Analyst
Aston Carter
Richmond, BC
- Full-time
Support ERP-to-BI data integration and interfaces in collaboration with technical resources, where applicable.
Added 11 hours ago
H
Project Engineer - Area Lead (Subsurface and Infrastructure)
Hydrostor
Toronto, ON
- $110,000 to $150,000 CAD / year
- Full-time
Title: Project Engineer – Area Lead (Subsurface and Infrastructure)
Added 11 hours ago
C
Data Architect
CPKC
Calgary, AB
- Contract
Proven experience designing and implementing ETL/ELT frameworks, data flows, and scalable data integration solutions using SQL and database technologies
Added 12 hours ago
W
Senior Technical Consultant
Worley
Calgary, AB · Edmonton, AB
- Full-time
Professional Engineer (P.Eng.) designation or eligibility is preferred.
Added 12 hours ago
I
Software Engineer
Insight
Remote, Canada
- Full-time
- Remote
We are seeking a highly skilled and experienced Software Engineer to join Insight's Application Development department. This is a department role rather than a position on a single customer…
Added 12 hours ago
N
Senior Software Engineer, NeMo Helix Core Platform
NVIDIA
Toronto, ON
- Full-time
We are looking for a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role is for a senior…
Added 12 hours ago
AM
Senior Firmware Engineer
Advanced Micro Devices, Inc
Markham, ON
- Full-time
We are looking for an experienced and passionate Firmware Engineer to join the NBIO team and drive HW/FW co-development for IP sub-systems. In this role, you will collaborate with hardware,…
Added 13 hours ago
B
Intern, Developer (Winter 2027)
Bombardier
Mississauga, ON
- $17.95 to $31 CAD / hour
- Volunteer
Engineer backend automation scripts and data integration pipelines with Python and SQL, leveraging operational data to drive real-time insights and transformation on the shop floor.
Added 14 hours ago
SO
Senior Software Engineer, Dentrix Ascend
Software of Excellence
Surrey, BC
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 14 hours ago
HS
Senior Software Engineer
Henry Schein One Canada
Surrey, BC
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 14 hours ago
M
Lead AI Solutions Engineer
McKesson
Mississauga, ON
- Full-time
The US Oncology Network is seeking a Lead AI Solutions Engineer (Forward Deployed Engineering) to drive the identification, design, prototyping, and validation of AI-enabled solutions that…
Added 14 hours ago
HS
Senior Java Software Engineer
Henry Schein One Canada
Surrey, BC
- $130,000 to $142,000 CAD / year
- Full-time
We are looking for a Senior Software Engineer to join our True North team and help build and evolve Dentrix Ascend for the US market.
Added 15 hours ago
S
Platform Architect - AI Platform
SIMPRO
Montreal, QC
- Full-time
The Platform Engineer designs, builds, and maintains the Simpro platform infrastructure to ensure scalability, reliability, and performance. The Platform Engineers will automate the…

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job