Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 1 month ago
1
Applied AI Engineer - Evaluation & Reliability
15Rock
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own
Added 1 month ago
A
Principal Engineer - Open Source Data Platform (ODP)
Acceldata
Kitchener, ON
- Full-time
We are seeking a Principal Engineer with at least 14 years of experience to serve as a technical visionary and thought leader for Acceldata's Open Data Platform (ODP). In this role, you…
Added 1 month ago
K
Senior Software Engineer – DevTest / QA Automation
Kaseya
Toronto, ON
- Full-time
Kaseya is seeking a Senior Software Engineer – DevTest / QA Automation to design, build, and maintain robust automated testing capabilities across enterprise software platforms.
Added 1 month ago
MA
Senior AI Engineer
Meeru AI Inc
Remote, Canada
- Other
- Remote
We are looking for a Senior AI Engineer to build the AI and intelligence layer - and help uphold the discipline that keeps it honest. Our output sits adjacent to externally reported…
Added 1 month ago
RT
Senior Data Architect
Ripotek Technologies Inc.
Calgary, AB
- Full-time
As a Senior Data Architect, you'll lead the design and implementation of modern data platforms for enterprise clients across Energy, Financial Services, and Public Sector. You'll work…
Added 1 month ago
RT
Azure Solutions Consultant
Ripotek Technologies Inc.
Calgary, AB
- Full-time
Pursue Microsoft certifications (Azure Data Engineer, Solutions Architect)
Added 1 month ago
AM
Senior Firmware Engineer
Advanced Micro Devices, Inc
Markham, ON
- Full-time
We are looking for an experienced and passionate Firmware Engineer to join the NBIO team and drive HW/FW co-development for IP sub-systems. In this role, you will collaborate with hardware,…
Added 1 month ago
CT
Senior Network & Security Engineer
Charter Telecom
Burnaby, BC · Vancouver, British Columbia
- Full-time
JNCIP-ENT and/or JNCIP-SP certification is required
Added 1 month ago
CT
Senior Network & Security Engineer
Charter Telecom
Calgary, AB
- Full-time
JNCIP-ENT and/or JNCIP-SP certification is required
Added 1 month ago
B
Intern, Developer (Winter 2027)
Bombardier
Mississauga, ON
- $17.95 to $31 CAD / hour
- Volunteer
Engineer backend automation scripts and data integration pipelines with Python and SQL, leveraging operational data to drive real-time insights and transformation on the shop floor.
Added 1 month ago
Senior Product Cybersecurity Engineer - Platform Security
L3Harris Technologies
Montreal, QC
Job Schedule: Day Shift
Added 1 month ago
CT
Senior Network & Security Engineer
Charter Telecom
Victoria, BC
- Full-time
JNCIP-ENT and/or JNCIP-SP certification is required
Added 1 month ago
4I
Senior Embedded Systems Electronics Engineer
4FMV Inc
Montreal, QC · Greater Montreal Metropolitan Area
- $118,000 to $132,000 CAD / year
- Full-time
Location: Montreal, QC (hybrid: 3 days in office, 2 days remote)
Added 1 month ago
M
Lead AI Solutions Engineer
McKesson
Mississauga, ON
- Full-time
Flex & Connect work model with a requirement to be in the office two (2) days per week.
Added 1 month ago
ES
Senior Site Reliability Engineer – AEM
Epsilon Solutions Ltd.
Toronto, ON
- Full-time
Senior Site Reliability Engineer – Adobe Experience Manager (AEM), CDN and Edge Delivery
Added 1 month ago
GM
Senior Software Developer - Virtualization and SIL Integration
General Motors
Markham, ON
- Full-time
…of Virtualization and Software-in-the-Loop (SIL) Integration Engineer to support our Test Environment Agile Release Train (SIL…
Added 1 month ago
L
Senior Yocto Developer Toronto
Litmus
Remote, Canada
- Full-time
- Remote
We are looking for a highly skilled and passionate Senior Yocto & Linux Software Engineer to join our engineering team in Toronto. In this role, you will be responsible for developing,…
Added 1 month ago
T
Senior AI Engineer (GCP/Vertex AI) Contract
TekRek
Canada
- Contract
This is a senior, hands-on AI/ML engineering contract on a lean delivery team that builds mainly on Google’s AI stack. The team has no business analysts and no separate UAT phase. Engineers…
Added 1 month ago
NS
Senior Site Reliability Engineer (SRE) – CDN & Web Performance
N2P Systems
Toronto, ON
- Full-time
We are seeking a Senior Site Reliability Engineer (SRE) to help build and operate a modern, public-facing enterprise web platform delivered through Adobe Experience Manager (AEM) Edge…
Added 1 month ago
SI
Senior Cryptographic Protocol Engineer
SuperQubit Inc.
Markham, ON
- Full-time
Job Title: Senior Cryptographic Protocol Engineer
Added 1 month ago
P&
Stage - Hiver 2027 - Développement Logiciel Avancé, Méthodes Numériques / Internship - Winter 2027 - Advanced Software Development, Numerical Methods
Pratt & Whitney
Longueuil, QC
- Full-time
Maîtrise de Python et, idéalement, d'un langage compilé tel que C ou Fortran
Added 1 month ago
RI
Senior Full Stack Engineer - Java /
Rose International
Mississauga, ON
- Full-time
Must Have Skills/Attributes: Angular, Artificial Intelligence (AI), Banking/Financial, Java, Kafka, Kubernetes, Microservices, Spring Boot
Added 1 month ago
PF
Full Stack Engineer
PEOPLE FORCE CONSULTING INC
Quebec, QC
- Contract
This position is a hybrid position with onsite presence at our client’s Montreal office , 3 days per week · Il s’agit d’un poste hybride nécessitant une présence sur site au bureau du client à Montréal, 3 jours par semaine
Added 1 month ago
H
Senior Data Engineer
HCLTech
Toronto, ON
- $90,000 to $120,000 CAD / year
- Full-time
We are seeking a hands-on Senior Data Engineer to lead the development, support, and continuous improvement of our Azure-based data platform. This role combines data engineering, platform…
Added 1 month ago
ZC
Automation Engineer
Zurich Canada
Toronto, ON
- Full-time
Zurich Canada is currently looking for an Entry-Level Automation Engineer to join our technology team. This is an exciting opportunity for an early-career technology professional who is…

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 7, 2027
Posting language: English
Posted: Oct 9, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply on LinkedIn About employer

More about this job

Responsibilities

Build deterministic evaluation gates that block reports with defects, and develop checks for fact consistency, citation validity, and source integrity. Create golden-set and regression testing harnesses, then harden validated approaches for production with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python skills and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy or the ability to learn it quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Hardening
Continuous Integration
LangGraph
DuckDB
Model Risk
Evaluation Infrastructure
Financial Intelligence
Quantitative Analysis
Institutional Investors
Source Verification

Report this job

Work requirements

Jobs in Canada