Find work in Canada.

343,710 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 3 mins ago
SC
Department Purchasing and Contracts Advisor, Utilities
Strathcona County
Sherwood Park, AB
- Full-time
Ability to work with technology that supports contract management and familiarity with Oracle, Adobe Sign, and Microsoft products such as SharePoint is an asset
Added 3 mins ago
A
Chef principal(e), Publicité numérique chez les détaillants – Nutrition (Montréal)
Abbott
Montreal, QC
- Full-time
Added 3 mins ago
EE
Acoustic Engineer (Canada)
Ehvert Engineering a Salas O'Brien company
Remote, Canada
- Full-time
- Remote
Lead acoustical engineering, noise, and vibration control activities for mission-critical data centre projects.
Added 3 mins ago
H
Software Business Development Lead
Hatch
Remote, Canada
- $65,000 to $80,000 CAD / year
- Full-time
- Remote
…we're looking for our first Business Development & Discovery Lead. You'll own outreach end to end: finding the right people, starting real conversations, and booking qualified…
Added 3 mins ago
SS
Senior Sales Executive – SYSPRO ERP
Solen Software Group
Remote, Canada
- $140,000 to $160,000 CAD / year
- Full-time
- Remote
…selling to executives who are making one of the most significant technology decisions their company will…
Added 3 mins ago
TS
Manager, Estimating
The Sutherland Group of Companies
Remote, Canada
- Full-time
- Remote
Lead, mentor, and develop the estimating team while ensuring the delivery of accurate, competitive, and timely bid submissions.
Added 3 mins ago
Project Controls Specialist
BWXT
Peterborough, ON
Support and sometimes lead the continuous improvement of departmental governance, procedures, tools, and best practices.
Added 3 mins ago
Senior Project Manager
BWXT
Peterborough, ON
…satisfactory contract execution. The Senior Project Manager will lead projects with influence, and execute control over budgets, schedules, and non-technical communication. As a Senior…
Added 3 mins ago
Manager, Supply Chain Contract Excellence
Celestica International LP
Toronto, ON
…manufacturing workflows. In this role, you will act as a tactical lead for specific process improvement initiatives, focusing on best in class contracting processes, eliminating process…
Added 3 mins ago
Technical Architect Contracts (Computer Services Officer 4)
The Government of Nova Scotia
Halifax, NS
We don’t just implement technology; we modernize outdated systems and reimagine processes. Our agile, data-driven approach ensures that digital services are both efficient and adaptable to…
Added 3 mins ago
MF
Specialist, Food Safety & Commercialization - M&M Food Market
M&M Food Market Ltd/Les Aliments M&M Lte
Mississauga, ON
- Full-time
Lead product reformulations, line extensions, packaging updates, and quality improvements.
Added 3 mins ago
BI
Controls Designer
BOS Innovations
London, ON
- Full-time
…character and competence. Our purpose is not only to deliver great technology, but also to develop great people - fostering collaboration, continuous learning, and professional…
Added 3 mins ago
E
Maintenance Shift Lead
EPCOR
Regina, SK
- Full-time
We are hiring a full-time permanent Maintenance Shift Lead position working out of Regina, SK.
Added 3 mins ago
Senior Product Designer, Rider
Lyft
Toronto, ON
We’re looking for a bold, imaginative Senior Product Designer to lead our most exploratory work and shape the evolution of the Lyft Rider experience. As part of our Rider team, you'll…
Added 3 mins ago
M
RQ11697 - Change Management Consultant - Senior
Maarut
Toronto, ON
- Contract
business processes and technology solutions to drive adoption
Added 3 mins ago
Network Construction Project Manager, Technical Program Management
IREN
Vancouver, BC
Manage the physical delivery of fibre, optics, DAC cables, patch leads, and structured cabling materials - coordinating with Procurement on lead times
Added 3 mins ago
Performance & Delivery Manager - Industrial Operations
Alstom
Toronto, ON
…portfolio in the industry. Every day, more than 80 000 colleagues lead the way to greener and smarter mobility worldwide, connecting cities as we reduce carbon and replace…
Added 3 mins ago
Competency Specialist
Alstom
Toronto, ON
…portfolio in the industry. Every day, more than 80 000 colleagues lead the way to greener and smarter mobility worldwide, connecting cities as we reduce carbon and replace…
Added 3 mins ago
Special Process Expert
Alstom
Toronto, ON
…portfolio in the industry. Every day, more than 80 000 colleagues lead the way to greener and smarter mobility worldwide, connecting cities as we reduce carbon and replace…
Added 15 mins ago
G
Business Development Manager
Grantek
Burlington, ON
- Full-time
Implement effective lead generation tactics, including market research, networking, and outreach.
Added 15 mins ago
AI
Senior CDN & Edge Reliability Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Participate in the shared on-call rotation as the platform’s subject-matter escalation, and lead incident management for customer-facing events.
Added 15 mins ago
W
Process Engineer
Worley
Vancouver, BC
- Full-time
Chemetics Inc. (Worley Group) is a diversified technology company that provides design and engineering solutions to the chloralkaline, sodium chlorate, chlorine dioxide, and sulphuric acid…
Added 15 mins ago
W
Lead Electrical Engineer, Power Distribution
Worley
Oakville, ON
- Full-time
We are currently recruiting for a Lead Electrical Engineer to support one of our major projects in Ontario. Our team includes world class experts and dynamic go-getters. This is a full-time…
Added 15 mins ago
W
Lead Electrical Engineer, Power Distribution
Worley
Markham, ON
- Full-time
We are currently recruiting for a Lead Electrical Engineer to support one of our major projects in Ontario. Our team includes world class experts and dynamic go-getters. This is a full-time…
Added 15 mins ago
TD
ISA Certified Arborist
The Davey Tree Expert Company
London, ON
- Full-time
…invest in our employees by offering industry-leading training, technology and benefits that lead to a rewarding and safe work experience at all levels. Wherever you want to grow your…

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job