Find work in Canada.

A simpler way to find your next job.

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 20 mins ago
I
AI Platform Engineer
Infoya
Toronto, ON
- Full-time
About the Job: We’re looking for a hands-on AI Platform Engineer to build and operate production-ready LLM agent systems and anomaly detection tools. You’ll own solutions from design…
Added 20 mins ago
HT
Applications Engineer
Husky Technologies
Bolton, ON
- Full-time
Apply a data-driven, first-principles approach, leveraging scientific modeling, experimentation, and advanced analytics to understand, predict, and optimize complex physical phenomena.
Added 20 mins ago
NG
Process Engineer / Process Improver
NSG Group
Collingwood, ON
- Full-time
The Process Engineer is a key technical leader responsible for the optimization, standardization, and continuous improvement of manufacturing processes of a high-performance, 24/7…
Added 20 mins ago
MT
Cloud Engineer
MSR Technology Group
Toronto, ON
- Contract
Expertise in Azure Monitor, Log Analytics, Application Insights, KQL, and Terraform.
Added 37 mins ago
E
Early Career RF Specialist (RAN Optimization)
Ericsson
Toronto, ON
- Full-time
…network analysis, pre-sales support, Ericsson's cutting-edge analytics solutions, and a strong foundation in customer-focus and quality service delivery, with mentorship and support from…
Added 51 mins ago
AI
Cloud Security Engineer – Azure, Aws & Gcp
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
…environments including implementing zero-trust architectures, advanced analytics with Microsoft Defender, and RBAC and IAM for secure access management, along with comprehensive logging and…
Added 51 mins ago
V
Lead Software Engineer
Virtusa
Toronto, ON
- Full-time
Job Summary: The IMS Production Support L3 Engineer is responsible for ensuring the stability, availability, and performance of applications across AMS, Cloudera, and on-premises…
Added 51 mins ago
UC
AI Developer
UniSysTech Consulting
Toronto, ON · Greater Toronto and Hamilton Area, ON
- Other
…is the primary priority for this role. We are looking for an engineer who excels at utilizing modern AI frameworks, LLMs, and intelligent automation to solve complex back-end…
Added 52 mins ago
M
Senior CyberArk Security Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
We are looking for an experienced Senior CyberArk Security Engineer to join our global Privileged Access Management (PAM) Engineering team and help strengthen the security, automation,…
Added 1 hour ago
SS
Continuous Improvement Process Engineer
Samuel, Son & Co.
Markham, ON
- Full-time
Added 1 hour ago
AS
Design Engineering Manager, Integrated Automation & Control Solution
Arrow Speed Controls
Richmond, BC
- Full-time
…date, we are a trusted partner across the heavy industries. We engineer and assemble speed control equipment for a wide range of electric motor applications. In addition to VFD's, we also…
Added 1 hour ago
MK
ERP Integration & Transformation Lead
Moose Knuckles Canada
Montreal, QC · Greater Montreal Metropolitan Area
- Full-time
Reverse-engineer and document systems and data where documentation is thin and the original implementer is no longer involved.
Added 1 hour ago
Y
Databricks DevOps & Self-Service Platform Engineer
Yochana
Toronto, ON
- Full-time
Position Name – Databricks DevOps & Self-Service Platform Engineer
Added 1 hour ago
A
Gen AI Engineer (Python,RAG, LangChain, LangSmith)
Apptad
Montreal, QC
- Full-time
The Role: GEN AI Engineer (Python,RAG, LangChain, LangSmith)
Added 1 hour ago
SF
Senior AI Engineer
Safe Fleet
Coquitlam, BC
- Full-time
We are looking for a hands-on Senior AI Engineer to build the platform that makes that possible - the shared services, agent framework, standards and tooling that allow every engineer on…
Added 1 hour ago
H
Senior Machine Learning Engineer
Hays
Toronto, ON
- Contract
Added 1 hour ago
M
Kubernetes Engineer (Container security and GKE focus)
Mehbooba
ON · Ontario, Canada
- Contract
Critical thinker with strong research and analytics skills.
Added 1 hour ago
Y
Databricks DataOps / SRE Engineer
Yochana
Toronto, ON
- Full-time
Position Name – Databricks DataOps / SRE Engineer
Added 1 hour ago
2I
Data Scientist/Data Engineer
2iSolutions Inc.
Toronto, ON
- Contract
Added 1 hour ago
Y
Azure Observability & Monitoring Engineer
Yochana
Toronto, ON
- Full-time
Position Name – Azure Observability & Monitoring Engineer
Added 1 hour ago
MT
DevOps Engineer
MSR Technology Group
Toronto, ON
- Contract
Added 1 hour ago
V
Cloud Engineer
VySystems
Toronto, ON
- Contract
Expertise in Azure Monitor, Log Analytics, Application Insights, KQL, and Terraform.
Added 1 hour ago
E
Early Career RF Specialist (RAN Optimization)
Ericsson
Toronto, ON
- Full-time
…network analysis, pre-sales support, Ericsson's cutting-edge analytics solutions, and a strong foundation in customer-focus and quality service delivery, with mentorship and support from…
Added 1 hour ago
AI
Databricks DataOps / SRE Engineer
Avanciers Inc.
Toronto, ON
- $50 to $55 CAD / hour
- Contract
Avanciers Incorporated is hiring a Databricks DataOps / SRE Engineer for one of our clients.
Added 1 hour ago
MT
Data Engineer
MSR Technology Group
Toronto, ON
- Contract

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 27, 2027
Posting language: English
Posted: Oct 29, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates, fact-reconciliation checks, and citation-integrity checks to prevent inaccurate research reports from reaching production. Develop golden-set and regression testing, then integrate validated approaches into the production pipeline with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy, self-direction, and a willingness to learn quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB
Model Risk

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Deployment
CI
Model Risk
LangGraph
DuckDB
Financial Intelligence
Quantitative Analysis
Institutional Investors
Research Services

Report this job