Find work in Canada.

357,355 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 51 mins ago
G
AI Engineer
Guidepoint
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Guidepoint seeks an experienced AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub serves as the base of our Data/AI/ML team, dedicated to building a…
Added 7 hours ago
SL
Engineering Manager
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Waterloo King
- Full-time
You're accountable for how work gets done - sprint execution, code quality, team health, and delivery commitments. You'll lead the squad, working closely with Product Directors to drive…
Added 11 hours ago
ES
Lead AI Engineer
EPAM Systems
Canada
- Full-time
We are looking for a Lead Software Engineer (7+ years of experience) to join a high-caliber product team building a next-generation AI-powered financial assistant platform. In this role,…
Added 13 hours ago
GF
Founding Engineer
Glass Factory
Montreal, QC
- Full-time
Being a Founding Engineer at Glass Factory means building the technical foundation of the company. You will own meaningful product surfaces end-to-end, from idea to production. This role…
Added 14 hours ago
X
Data Platform Engineer
Xanadu
Toronto, ON
- Full-time
As a Data Platform Engineer, you will take Xanadu’s existing data pipelines and transform them into a cohesive data platform. Working alongside hardware researchers, data scientists, and…
Added 14 hours ago
X
Senior Cryogenic Engineer
Xanadu
Toronto, ON
- Full-time
Xanadu is looking for a Cryogenic Engineer to lead designing, developing, and building Xanadu’s next generation cryostats as well as contribute to the build-out of our facility-level…
Added 14 hours ago
X
Layout and Design Engineer - SNSPDs (Superconducting Nanowire Single Photon Detectors)
Xanadu
Toronto, ON
- Full-time
…complex multiplexed multi-pixel detector arrays. You will also lead mask design for fabrication process optimization, bridging the gap between simulation and experiment by designing…
Added 17 hours ago
LD
Staff Data Engineer
Loblaw Digital
Toronto, ON
- Full-time
You will lead complex design initiatives, improve performance and reliability across critical pipelines, raise the bar on code quality, and mentor engineers across teams. You will also work…
Added 17 hours ago
M
Software Engineer II
Marqeta
Remote, Canada
- Full-time
- Remote
As Marqeta's Software Engineer II, you will deliver resilient and sustainable software projects from design to implementation and rollout. You will execute on defined projects to achieve…
Added 19 hours ago
SC
Senior Analytics Engineer
Securian Canada
Toronto, ON
- $100,000 to $130,000 CAD / year
- Full-time
Implement automated testing, validation, reconciliation, and data quality controls across analytical workflows.
Added 19 hours ago
SC
Senior Analytics Engineer
Securian Canada
Waterloo, ON
- $100,000 to $130,000 CAD / year
- Full-time
Implement automated testing, validation, reconciliation, and data quality controls across analytical workflows.
Added 22 hours ago
TC
Quality Engineer
Tata Consultancy Services
Canada
- Full-time
We are seeking a Test Lead to provide end-to-end test leadership across enterprise technology initiatives. This role coordinates onshore and offshore testing teams, establishes effective…
Added 23 hours ago
W
Technical Consultant II, Environmental Scientist
Worley
Edmonton, AB · Calgary, AB
- Full-time
As an Intermediate Environmental Scientist, Engineer in Training, or Technologist, you will play a key role in delivering contaminated site assessment, remediation, reclamation, and…
Added 23 hours ago
ET
Senior Analog Design Engineer
ESS Technology, Inc.
Kelowna, BC
- Full-time
ESS is global leader in Audio semiconductor and has some of the world's best audio DACs, ADCs, and CODECs. Our expertise, along with a commitment to producing the very best with a…
Added 1 day ago
ES
Delivery Manager / Senior Delivery Manager for Financial Services
EPAM Systems
Toronto, ON
- Full-time
We are seeking a Delivery Manager / Senior Delivery Manager to lead project delivery for our clients in the financial services sector, overseeing multiple Scrum teams and ensuring…
Added 1 day ago
ES
Solution Architect
EPAM Systems
Canada
- Full-time
Lead implementation teams by reviewing code, establishing best practices, and mentoring developers to deliver high-quality solutions
Added 1 day ago
ES
Senior Product Manager | Applied AI
EPAM Systems
Canada
- Full-time
…of AI as a product manager - using it across the lifecycle and shaping AI-powered features - not the ability to build, train or tune machine-learning models as an ML engineer or data…
Added 1 day ago
ES
Compute Platform SRE Lead
EPAM Systems
Canada
- Full-time
We are seeking a skilled Compute Platform SRE Lead to support EPAM's Compute Managed Services project. The role focuses on KTLO (Keep the Lights On) activities, ensuring 24x7 monitoring,…
Added 1 day ago
L
Principal AI/ML Engineer
lululemon
Vancouver, BC
- Full-time
The Enterprise Data & AI organization is a strategic and operational driver of growth for lululemon, owning and building the data and AI platforms and services that enable the enterprise to…
Added 1 day ago
C
Manager AI Engineering-CA
CN
Quebec, QC
- Full-time
Collaborate with data engineers, platform teams, and business partners to ensure AI solutions are aligned with enterprise architecture, data quality, and operational requirements
Added 2 days ago
ES
Senior Business Analyst
EPAM Systems
Toronto, ON
- Full-time
First Derivative is driven by people, data, and technology, unlocking the value of insight, hindsight, and foresight to drive organizations forward. Counting many of the world's leading…
Added 2 days ago
S
Technical Specifications Coordinator
SYSTRA
Montreal, QC
- Full-time
Reporting to the workstream Design Director and working in close collaboration with discipline leads, system engineering teams, civil infrastructure, rail systems, procurement, and project…
Added 2 days ago
P
Senior Associate -Cyber Security Forward Deployed(Bilingual FR/EN)
PwC
Calgary, AB · Vancouver, BC · Ottawa, ON · Toronto, ON
- Full-time
You will be both part of and/or leading the planning and execution of a variety of opportunities including AI to Defend and/or cloud and application security initiatives for our clients.…
Added 2 days ago
Senior High Voltage Design Engineer, Substations
IREN
Vancouver, BC
Reporting to the Vice President of Engineering, the Senior High Voltage Design Engineer acts as Owner's Engineer for the design of the high and medium voltage substations that connect our…
Added 2 days ago
A
QA/QC Apecialist
Actalent
Burnaby, BC
- $35 to $45 CAD / hour
- Contract
Maintain meticulous documentation and data integrity for all quality activities, inspections, and approvals within the ERP system.

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job