Find work in Canada.

344,582 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 8 mins ago
WT
Data Engineer
Wissen Technology
Montreal, QC
- Full-time
We are looking for a Data Engineer with strong backend engineering fundamentals and hands‑on experience building scalable, high‑performance data pipelines. The ideal candidate comes from a…
Added 8 mins ago
VT
AI Platform Developer
Volgo Technologies
Toronto, ON
- Contract
We are looking for a hands-on engineer who can build and deploy production-grade Agentic AI and multi-agent systems using Google ADK and MCP, while developing scalable AI platform…
Added 8 mins ago
V
Python Software Engineer
Varonis
Vancouver, BC · Greater Vancouver, BC
- Full-time
Senior Software Engineer – Secure AI Platform (Vancouver, On-Site)
Added 10 mins ago
Senior Data Engineer
Scotiabank
Toronto, ON
As a Senior Data Engineer within the Data & AI Technology team, you will play a critical leadership role in designing, building, and scaling enterprise grade data platforms. You will…
Added 25 mins ago
Staff Data Engineer
ExaCare AI
Toronto, Ontario
We’re looking for a Staff Data Engineer who thrives in an environment with strong ownership and can drive complex data initiatives from concept to production. You’ll build the pipelines,…
Added 37 mins ago
SL
Data Engineer
Staffingine LLC
Toronto, ON
- Contract
We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks, Azure database technologies, Oracle, and Python. The ideal candidate should have experience…
Added 37 mins ago
W
Expression of Interest for Engineering Graduate - University of Calgary
Worley
Vancouver, BC
- Full-time
Exposure to industry tools, systems, or software relevant to your discipline (e.g., design, analysis, project controls, data, or planning tools).
Added 37 mins ago
LT
Data Engineer & Data Designer
Lorven Technologies Inc.
Toronto, ON
- Full-time
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration.
Added 52 mins ago
W
Expression of Interest for Engineering Graduate - University of Calgary
Worley
AB · Edmonton, AB
- Full-time
Exposure to industry tools, systems, or software relevant to your discipline (e.g., design, analysis, project controls, data, or planning tools).
Added 52 mins ago
W
Expression of Interest for Engineering Graduate - University of Calgary
Worley
Calgary, AB
- Full-time
Exposure to industry tools, systems, or software relevant to your discipline (e.g., design, analysis, project controls, data, or planning tools).
Added 52 mins ago
F
Technical Consultant (Data & AI)
Fastloop
Vancouver, BC
- Full-time
You aren’t just a “Data Engineer” or a “Software Engineer”; you are the “connective tissue” of modern intelligence. You will be responsible for the programmatic development of Agentic…
Added 53 mins ago
W
Process Engineer
Worley
Vancouver, BC
- Full-time
We are currently recruiting for a Process Engineer. Our team includes world class experts and dynamic go-getters. This is a full-time position based in Vancouver, British Columbia.
Added 53 mins ago
H
AI Solutions Architect
Hays
Toronto, ON
- Contract
…significant digital transformation initiatives across enterprise data, AI, banking integration, risk, finance, treasury, and AML…
Added 53 mins ago
SS
Adobe Site Reliability Engineer (SRE) – CDN & Web Performance
Staffmax Staffing & Recruiting
Toronto, ON · Greater Toronto Area, Canada
- Full-time
We are seeking a highly skilled and proactive Adobe Site Reliability Engineer (SRE) specializing in CDN and Web Performance to join our client's dynamic team.
Added 53 mins ago
A
Forward Deployed Engineer – AI, Data Engineering & MLOps / Toronto, ON (Onsite) - FTE
AceStack
Toronto, ON
- Full-time
Job Title: Forward Deployed Engineer – AI, Data Engineering & MLOps
Added 55 mins ago
Staff Software Engineer
Lantern
Vancouver, BC
Lantern is seeking a Staff Software Engineer to join our expanding product engineering pods. This is a strategic and highly visible role focused on driving your team’s architectural…
Added 55 mins ago
DC
Intermediate/Senior Noise Engineer
Dillon Consulting Limited
Calgary, AB · Edmonton, AB
- Full-time
We are currently seeking a Intermediate/Senior Noise Engineer to join our Atmospheric Services team. Our team specializes in in the atmospheric and acoustic solutions that safeguard both…
Added 55 mins ago
DC
Intermediate/Senior Air Quality Engineer
Dillon Consulting Limited
Calgary, AB · Edmonton, AB
- Full-time
We are currently seeking a Intermediate/Senior Air Quality Engineer to join our Atmospheric Services team. Our team specializes in in the atmospheric and acoustic solutions that safeguard…
Added 1 hour ago
EI
Intermediate / Senior Groundwater Modeller
Egis in Canada
Mississauga, ON
- $90,000 to $140,000 CAD / year
- Full-time
Proficient in data analysis, statistical analysis, data summary, and report preparation.
Added 1 hour ago
S
Analytics Engineer - Consultant or Senior Consultant
Slalom
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Analytics Engineer - Consultant or Senior Consultant - Vacant Role
Added 1 hour ago
H
Data Quality Engineer
Hays
Toronto, ON
- Contract
A leading organization is seeking a highly skilled and experienced Senior Quality Engineer to join its Enterprise Technology and Data team.
Added 1 hour ago
L
Staff Software Engineer
Lantern
Vancouver, BC
- Full-time
Lantern is seeking a Staff Software Engineer to join our expanding product engineering pods. This is a strategic and highly visible role focused on driving your team’s architectural…
Added 1 hour ago
M
Lead Full Stack Software Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
As a Lead Full Stack Software Engineer, you will provide technical leadership across the software development lifecycle, partnering with product owners, architects, and engineering teams to…
Added 1 hour ago
M
Back-End Software Engineer
Manulife
Toronto, ON
- Full-time
As a Back-end Software Engineer within Group Functions Technology, you will be a key member building technology which supports our global operations. The ideal candidate has a curious mind,…
Added 1 hour ago
SG
Electrical Engineer & Project Manager, BESS
Socomec Group
Brampton, ON
- Full-time
Analyze data/interpret available power system studies, propose and co-ordinate complementary studies, conduct site audits to define and develop successful business solutions.

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job