Find work in Canada.

A simpler way to find your next job.

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 2 mins ago
SD
Pharmacist, Hourly Part Time Day Greenlight Requisition
Shoppers Drug Mart
Woodbridge, ON
- Part-time
Proven ability to drive and build the business, lead by example and support enterprise programs
Added 2 mins ago
W
Food & Consumables Team Lead
Walmart
Campbell River, BC
- Full-time
5. Review completed schedules with People Lead.
Added 2 mins ago
W
(CAN) GM Lead Department Manager
Walmart
Surrey, BC
- Full-time
Added 2 mins ago
AG
Freelance Creative (Copy, Design, Art & Creative Direction)
Adelphi Group
Calgary, AB · Toronto, ON
- $60 to $90 CAD / hour
Creative Directors who can lead teams, shape strategy-driven ideas, present confidently to stakeholders, and keep work sharp from brief to launch.
Added 2 mins ago
W
(CAN) Stocking 3 Team Lead
Walmart
Red Deer, AB
- Full-time
5. Review completed schedules with People Lead.
Added 2 mins ago
W
Front End Checkout Team Associate
Walmart
Ottawa, ON
- Part-time
7.Refers appropriate service and transactional items to a Customer Service Manager or Front End Team Lead.
Added 2 mins ago
SC
Retail Operations Supervisor
Staples Canada
Edmonton, AB
- Full-time
As a Retail Operations Supervisor, you will play a pivotal role in driving sales and operational excellence. You will lead by example, providing engaging customer service that consistently…
Added 4 mins ago
PH
Home child care provider
Private Household
Stratford, ON
- From $18.68 CAD / hour
- Full-time
- On-site
Added 9 mins ago
AD
Early childhood educator (ece) - level 2
ABC DAYCARE AND PRESCHOOL LTD.
Claresholm, AB
- From $20 CAD / hour
- Full-time
- On-site
Lead activities by telling or reading stories, teaching songs and taking children to local points of interest
Added 17 mins ago
CM
Manager, Insolvency
Crowe MacKay LLP
Vancouver, BC
- Full-time
Lead a portfolio of insolvency and restructuring engagements
Added 17 mins ago
CS
Executive Director
Chinooks Soccer Club
Calgary, AB
- Part-time
Chinooks FC is hiring an Executive Director to lead a defined organizational reset.
Added 20 mins ago
FR
Child care provider - private home
FOROOZAN RAHMANI DIDAR
North York, ON
- From $22 CAD / hour
- Full-time
- On-site
Added 27 mins ago
PH
Child caregiver - private home
Private Household
Chestermere, AB
- From $21 CAD / hour
- Full-time
- On-site
Added 32 mins ago
TC
Temporary Retail Customer Service Coordinator Full Time Winners - Dorval Crossing Oakville
TJX Companies
Oakville, ON
- Full-time
We’re looking for a Retail Store Coordinator to join our team in a welcoming environment. In this role, you’ll lead and inspire to deliver outstanding customer experiences. If you thrive in…
Added 38 mins ago
AA
Child caregiver - private home
Asad Ali Nasser
Markham, ON
- From $21 CAD / hour
- Full-time
- On-site
Added 42 mins ago
EA
Nanny
Esther Amselem
Cote-Saint-Luc, QC
- From $19 CAD / hour
- Full-time
- Contract
- On-site
Added 43 mins ago
YJ
Nanny
YILIN JIANG
North York, ON
- From $20.85 CAD / hour
- Full-time
- On-site
Added 43 mins ago
JY
Nanny
JIACHEN YUAN, ZITONG WEI
Stouffville, ON
- From $20.85 CAD / hour
- Full-time
- On-site
Added 45 mins ago
IM
Early childhood educator (ECE)
INSPIRATIONS MONTESSORI SCHOOL
Burnaby, BC
- $26 to $27 CAD / hour
- Full-time
- On-site
Lead activities by telling or reading stories, teaching songs and taking children to local points of interest
Added 45 mins ago
CM
Early childhood educator (ECE)
CAMBIE MONTESSORI CHILDREN CENTRE
Vancouver, BC
- $26 to $27 CAD / hour
- Full-time
- On-site
Lead activities by telling or reading stories, teaching songs and taking children to local points of interest
Added 45 mins ago
IM
Infants' daycare worker
Inspiration Montessori School
Richmond, BC
- $29 to $30 CAD / hour
- Full-time
- On-site
Lead activities by telling or reading stories, teaching songs and taking children to local points of interest
Added 46 mins ago
IM
Early childhood educator (ECE)
Inspiration Montessori School
Richmond, BC
- $26 to $27 CAD / hour
- Full-time
- On-site
Lead activities by telling or reading stories, teaching songs and taking children to local points of interest
Added 47 mins ago
DE
SYSTEMS INTEGRATOR (AV)
Design Electronics
Niagara Falls, ON
- Full-time
Comparable Job Titles: Lead Installation Technician, Senior Installer, Lead AV Technician, or Senior Systems Technician.
Added 47 mins ago
TC
Family Support Worker, Temp Full Time
Taproot Community Support Services
Cold Lake, AB
- Full-time
Our 800-plus employee-owners live by five shared values: we are stronger together, we lead with optimism, we embrace challenges, we respect every voice, and we go above and beyond. Guided…
Added 47 mins ago
LS
Casual Educational Assistants - Luseland District School - #4073404
Living Sky School Division No. 202
Luseland, SK
- Full-time
…committed and collaborative individual who believes they can lead their team to meet the needs of all students in an environment where all feel accepted, cared for and safe. This person…

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job