Find work in Canada.

341,228 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 1 min ago
I
QA Automation Engineer - ETL/Database
Infoya
Toronto, ON
- $100,000 to $115,000 CAD / year
- Full-time
About the Job: Infoya is looking for an experienced Senior Automation Engineer with strong expertise in test automation , database testing, ETL validation, and data pipeline testing. The…
Added 1 min ago
E
Senior QE + AI Engineer
enableIT
Toronto, ON
- $75 to $80 CAD / hour
- Contract
We are seeking a Senior QE + AI Engineer with around 8 years of experience in Quality Engineering, Test Automation, or Software Engineering. The role focuses on building AI-powered…
Added 1 min ago
I
QA Automation Engineer - Database & ETL Testing
Infoya
Toronto, ON
- $100,000 to $115,000 CAD / year
- Full-time
About the Job: Infoya is looking for an experienced Senior Automation Engineer with strong expertise in test automation , database testing, ETL validation, and data pipeline testing. The…
Added 1 min ago
IS
Project Manager (Data)
Iris Software Inc.
Toronto, ON
- Contract
Iris's direct client, one of the Top 5 Bank in Canada, is looking to hire a Kubernetes Engineer for a long term opportunity at Remote.
Added 1 min ago
W
Principal, Energy and Carbon Solutions
WalterFedy
Hamilton, ON
- Full-time
…optimization, decarbonization pathways, commissioning, energy analytics and related energy and carbon…
Added 1 min ago
PI
MLOps Engineer
Planitar Inc.
Waterloo, ON
- $120,000 to $150,000 CAD / year
- Full-time
Planitar's Advanced Research Group builds the AI that turns 360° scans into floor plans. We are hiring our first MLOps Engineer to build the infrastructure that trains, evaluates, deploys…
Added 2 mins ago
P
MLOps Engineer
Planitar
Waterloo, ON
- Full-time
Planitar's Advanced Research Group builds the AI that turns 360° scans into floor plans. We are hiring our first MLOps Engineer to build the infrastructure that trains, evaluates, deploys…
Added 17 mins ago
HA
Engineer In Training
Hazen and Sawyer
Calgary, AB
- Full-time
Hazen Canada is seeking an Engineer in Training with a passion for water to join our Calgary, Alberta office.
Added 29 mins ago
C
Transportation EIT
CIMA+
Calgary, AB
- Full-time
…what’s expected of us to meet the challenges of tomorrow and engineer a better…
Added 29 mins ago
TC
Adobe Site Reliability Engineer
Tata Consultancy Services
Toronto, ON
- $100,000 to $130,000 CAD / year
- Full-time
…third-party integration on the page – Search, Consent Management, Analytics, Personalization and AI services and many more to…
Added 29 mins ago
RE
Technical Project Manager
Randstad Enterprise
Montreal, QC
- Contract
…RAG-enabled knowledge experiences. The role does not require an AI engineer. It requires a thoughtful practitioner who can apply knowledge principles in an evolving AI environment,…
Added 29 mins ago
D
Data Product Engineer
DataPattern
Toronto, ON
- Contract
We are seeking an experienced Data Product Engineer to design and deliver governed data models, continuous data lineage frameworks, reconciliation controls, and audit trail infrastructure…
Added 31 mins ago
I
QA Automation Engineer - ETL/Database
INFOYA
Toronto, ON
- $100,000 to $115,000 CAD / year
- Full-time
experienced Senior Automation Engineer with strong expertise
Added 2 hours ago
1
Applied AI Engineer - Evaluation & Reliability
15Rock
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own
Added 2 hours ago
AI
Site Reliability Engineer – Azure Operations, Databricks Support & Incident Response
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
As an Intermediate Site Reliability Engineer, you will support and continuously improve enterprise Azure and Databricks platforms. The role focuses on production reliability, monitoring,…
Added 2 hours ago
P
Growth Engineer Intern
Parameter
Engineer, BC
- Volunteer
2+ years of full-time experience as an engineer, ideally in growth, product engineering, or at an early-stage startup
Added 3 hours ago
T
Staff Software Engineer, ML Infra & Distributed Systems
Tubi
Toronto, ON
- Full-time
As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference…
Added 3 hours ago
A
Principal Engineer - Open Source Data Platform (ODP)
Acceldata
Kitchener, ON
- Full-time
…power today’s most critical technologies, including AI, LLMs, Analytics, and…
Added 3 hours ago
HT
Applications Engineer
Husky Technologies
Bolton, ON
- Full-time
Apply a data-driven, first-principles approach, leveraging scientific modeling, experimentation, and advanced analytics to understand, predict, and optimize complex physical phenomena.
Added 4 hours ago
CQ
AI Engineer
Canada Quant Labs
Victoria, BC · Greater Victoria Metropolitan Area
- Full-time
The short version - Canada Quant Labs is hiring an AI Engineer to own pieces of our train → quantize → deploy pipeline. You'll ship open-weight checkpoints (like our Hy3, GLM-5.2, and…
Added 5 hours ago
KI
Technical Marketing Engineer
Klara Inc
Hamilton, ON
- Full-time
Added 5 hours ago
MS
Founding Product Designer
Mangrove Systems
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Watch clients and implementation engineers use the platform - for example, sitting with an implementation engineer standing up a new client and noting where they leave the UI for a…
Added 5 hours ago
P
Senior Mobile Engineer
Pentasia
Toronto, ON
- $140,000 to $180,000 CAD / year
- Full-time
…digital entertainment space is seeking a Senior React Native Engineer to help build and scale its mobile platform for sports and casino…
Added 5 hours ago
MA
Senior AI Engineer
Meeru AI Inc
Remote, Canada
- Other
- Remote
We are looking for a Senior AI Engineer to build the AI and intelligence layer - and help uphold the discipline that keeps it honest. Our output sits adjacent to externally reported…
Added 6 hours ago
A
Continuous Improvement Engineer
Actalent
Vancouver, BC
- $50,000 to $62,400 CAD / year
- Full-time
The Continuous Improvement Engineer will support operational improvement initiatives within a manufacturing environment. This role will spend significant time on the production floor…

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job