Find work in Canada.

532,712 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 11 mins ago
OT
Restaurant Assistant Manager
One Therapy Network
Victoria, BC
- Full-time
Support the Manager in balancing food quality, speed of service, guest satisfaction, and cost control.
Added 11 mins ago
CG
Regional Operations Controller
Compass Group Canada
Mississauga, ON
- Full-time
Cost accounting knowledge, analytical capabilities and experience, project leadership skills
Added 11 mins ago
OT
Restaurant Assistant Manager
One Therapy Network
Kamloops, BC
- Full-time
Support the Manager in balancing food quality, speed of service, guest satisfaction, and cost control.
Added 11 mins ago
S
Meat - Manager Meat
Sobeys
Kamloops, BC
- Full-time
…sales forecasting, variance analysis and correction, and labour cost…
Added 11 mins ago
TN
Senior Account Manager
TCL North America
Toronto, ON
- $100,000 to $140,000 CAD / year
- Full-time
Manage assigned budgets while consistently seeking revenue and cost optimization
Added 11 mins ago
RH
Senior Accountant
Robert Half
Abbotsford, BC
- $80,000 to $95,000 CAD / year
- Full-time
…financial reporting, balance sheet reconciliations, inventory and cost accounting, and process improvement. They will be detail-oriented, analytical, and comfortable working in a hands-on…
Added 11 mins ago
TP
Manager, Real Estate Operations
Toronto Pearson International Airport
Toronto, ON
- Full-time
…will lead lease compliance, property operations, operating cost and recovery-rate management, tenant project oversight, and the resolution of contractual and operational issues. As a key…
Added 11 mins ago
AL
Accounting Manager
Accountants-BC Ltd.
Vancouver, BC
- Full-time
Develop and maintain financial models and cost analyses to assess operating performance, staffing plans and proposed business investments.
Added 27 mins ago
KD
Premier·ère analyste financier·ère | Senior Financial Analyst
Keurig Dr Pepper
Montreal, QC
- Full-time
Added 41 mins ago
B
Analyst, Engineering Program Management
Bombardier
Dorval, QC
- Full-time
Added 41 mins ago
CC
Project Accountant
Corebuild Construction Ltd.
Toronto, ON · North York, ON
- Full-time
The Project Accountant plays a critical role in supporting the financial health of our construction projects from initiation through completion.
Added 41 mins ago
SR
Assistant Project Manager
SmartCentres REIT
Vaughan, ON
- Full-time
Review and update schedule, cost forecasts and cash flow requirements with the superintendent biweekly and with the VP of construction monthly;
Added 41 mins ago
W
Scheduler
Webuild
Toronto, ON
- Full-time
Assigns resources (cost, labour, equipment, and materials) to activities and develops cash flow reports and resource histograms.
Added 41 mins ago
W
Director of Financial Reporting
Winchesters
Toronto, ON
- $180,000 to $195,000 CAD / year
- Full-time
Responsible for team annual activities such as property budgets, final operating cost recovery adjustments, annual property taxes, and property audits
Added 41 mins ago
OT
Restaurant Assistant Manager
One Therapy Network
Langford, BC
- Full-time
Support the Manager in balancing food quality, speed of service, guest satisfaction, and cost control.
Added 41 mins ago
A
Compensation Specialist
Altis
Toronto, ON
- Full-time
…hiring manager. And rest assured, all our services are free of cost for…
Added 41 mins ago
S
Corporate Senior Financial AnalystBusiness Planning, Finance
Sanya’k̓ula
Burnaby, BC
- Full-time
…operational reviews, implementation of services and progress on cost savings/revenue generation…
Added 41 mins ago
P
Finance Director
Perennial
Toronto, ON
- Full-time
Develop insights on profitability levers, cost optimization, and revenue growth
Added 41 mins ago
TP
Specialist, Supplier Relationship Management
Toronto Pearson International Airport
Toronto, ON
- Full-time
Added 41 mins ago
TI
Administrative Manager (Controller)
ThreePDS Inc.
Terrebonne, QC
- $95,000 to $110,000 CAD / year
- Full-time
…accounting and administrative activities, including production and cost accounting, financial analysis, accounts payable and receivable, monthly reporting, budgeting, forecasting, inventory…
Added 41 mins ago
EP
Accounting Manager
Elby Professional Recruitment
Mississauga, ON
- $90,000 to $105,000 CAD / year
- Full-time
Are you a senior accountant or accounting manager who thrives where financial strategy meets physical production? Do you enjoy getting beneath the surface of inventory flows, operational…
Added 41 mins ago
C
Senior Property Manager
CBRE
Toronto, ON
- Full-time
…Project Management (program management, project management, cost consulting); Real Estate Investments (investment management, development). Please visit our website at…
Added 41 mins ago
WF
Controller & Strategic Finance Lead
Western Forest Products
Campbell River, BC
- $110,000 to $155,000 CAD / year
- Full-time
Prepare and review weekly cost, revenue, inventory turns, EBITDA and KPI reporting and assist with key metric commentary for the General Manager;
Added 43 mins ago
CE
Entry Level Supervisor
CEC Entertainment
Edmonton, AB · TRUE
- Full-time
Understands cost control procedures, financial accounting, inventory levels and labor management
Added 56 mins ago
MD
Office & Admin Specialist Sr
Minnesota Direct Care and Treatment
Saint-Paul, NB · St.-Paul, NB
- Full-time
Low-cost medical, dental, vision, and prescription drug plans

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 27, 2027
Posting language: English
Posted: Oct 29, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates, fact-reconciliation checks, and citation-integrity checks to prevent inaccurate research reports from reaching production. Develop golden-set and regression testing, then integrate validated approaches into the production pipeline with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy, self-direction, and a willingness to learn quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB
Model Risk

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Deployment
CI
Model Risk
LangGraph
DuckDB
Financial Intelligence
Quantitative Analysis
Institutional Investors
Research Services

Report this job