Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 14 days ago
AC
Data Engineer
Amphenol Communications Solutions
Markham, ON
- Full-time
The engineer will own implementation quality and operational reliability for assigned data platform components, pipelines, and integrations. Strong SQL and Python programming, automated…
Added 14 days ago
AI
GCP Data Engineer
Aptino, Inc.
Canada
- Contract
We are looking for an experienced GCP Data Engineer with strong hands-on expertise in Google BigQuery, SQL, and data warehousing. Experience with dbt and telecommunications data, including…
Added 14 days ago
MP
Senior Data Engineer
Michael Page
Winnipeg, MB
- $85,000 to $90,000 CAD / year
- Full-time
This Data Engineer role focuses on designing, building, and supporting scalable data pipelines and cloud-based data solutions while ensuring data quality, security, and operational…
Added 14 days ago
E
DevOps Engineer
Equinix
Toronto, ON
- Full-time
We are looking for an experienced Staff Engineer to join a team responsible for maintaining and evolving our Kubernetes-based infrastructure across both on-premises and AWS environments.…
Added 14 days ago
H
Junior Cyber Incident Response Analyst
Hootsuite
Ottawa, ON
- Full-time
1 - 2 years of experience in a security analyst, SOC analyst, incident response analyst, security engineer, or system administrator or similar role
Added 14 days ago
ZS
Monitoring Tool Automation Engineer
Zodiac Solutions, Inc
Toronto, ON
- Full-time
Extensive hands-on experience in developing automation scripts using Python and PowerShell.
Added 14 days ago
MT
DevOps and Security Engineer
Martello Technologies
Ottawa, ON · Greater Ottawa Metropolitan Area
- Full-time
This is an Ottawa based hybrid role and you must reside in Ottawa at the time of hire
Added 14 days ago
MT
Site Reliability Engineer
MSR Technology Group
Toronto, ON
- Contract
Develop Python and shell scripts for operational automation, pipeline recovery, and monitoring.
Added 14 days ago
L
Regular Technical Support Engineer
Luxoft
Toronto, ON
- Contract
Added 14 days ago
E
Solutions Engineer
EXFO
Montreal, QC · Greater Montreal Metropolitan Area
- Full-time
Développer, maintenir et améliorer des services et outils back-end en Python, TypeScript/Node.js et Go.
Added 14 days ago
E
Solutions Engineer
EXFO
Montreal, QC · Greater Montreal Metropolitan Area
- Full-time
Développer, maintenir et améliorer des services et outils back-end en Python, TypeScript/Node.js et Go.
Added 14 days ago
H
Senior WMS Implementation Engineer
Hays
Canada
- $95 to $100 CAD / hour
- Contract
Proficient in Python for data science and GenAI application development
Added 14 days ago
W
Software Engineer I
Wayfair
Toronto, ON
- $120,000 to $130,000 CAD / year
- Full-time
This is a Toronto based opportunity with a 3 day in office expectation (Tuesday - Thursday) with 2 days remote (Monday and Friday)
Added 14 days ago
C
AI Security Research Engineer
Centraprise
Toronto, ON
- $50 to $60 CAD / hour
- Contract
Technical Security Research Engineer to research, prototype, evaluate, and operationalize emerging cybersecurity capabilities. This is a hands-on role for someone who can move from a…
Added 14 days ago
1
Applied AI Engineer - Evaluation & Reliability
15Rock
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own
Added 14 days ago
ET
Senior AI/ML Engineer
Envision Technology Solutions
Canada
- Contract
The Senior AI/ML Platform Engineer will build, productionize, and operate AI/ML solutions on Azure Databricks platform.
Added 14 days ago
ET
AVP, Lead Software AI Engineer
Encore Technical Solutions Inc.
Toronto, ON
- Full-time
Design, develop and maintain production services and user interfaces in Python and TypeScript.
Added 14 days ago
L
Applied AI Engineer
Luxoft
Canada
- Full-time
…into 2028. Our stack: Ruby on Rails, Node.js/TypeScript and Python services, PostgreSQL, Snowflake and AWS. We're looking for an applied AI engineer to build AI with real, measurable…
Added 14 days ago
FS
AI Engineer
Futran Solutions
Mississauga, ON
- Full-time
Design, build, and deploy Python-based AI/LLM applications using FastAPI/Flask.
Added 14 days ago
G
Senior AI Engineer
Guidepoint
Toronto, ON
- Full-time
We are looking for a hands-on Senior AI Engineer to take working prototypes into production and shape the architecture as the product grows. You will have broad ownership across agent…
Added 14 days ago
H
Junior Cyber Incident Response Analyst
Hootsuite
Vancouver, BC
- Full-time
1 - 2 years of experience in a security analyst, SOC analyst, incident response analyst, security engineer, or system administrator or similar role
Added 14 days ago
T
System Engineer
TEEMA
Vancouver, BC
- $70,000 to $85,000 CAD / year
- Full-time
Systems Engineer – IT & DevOps (Intermediate)
Added 14 days ago
HN
Mechatronics Engineer | Robotics & Automation
Harvey Nash
Vancouver, BC
- Full-time
The team is scaling quickly and looking for a Mechatronics Engineer who enjoys solving multidisciplinary problems across robotics, automation, hardware, sensors, testing and software.
Added 14 days ago
N
Software Engineer 2 - Kubernetes Backend and Platform Engineering
Nutanix
Vancouver, BC
- $103,000 to $155,000 CAD / year
- Full-time
As an Engineer on the NKP AI Platform team, you will be a key technical leader responsible for architecting, building, and scaling the infrastructure that allows enterprises to train,…
Added 14 days ago
A
Spécialiste principal(e) en IA appliquée/ Senior AI Engineer
AUDELA
Montreal, QC
- Full-time
Mode de travail : Hybride, au moins 3 jours par semaine au bureau

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 27, 2027
Posting language: English
Posted: Oct 29, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply on LinkedIn About employer

More about this job

Responsibilities

Build deterministic evaluation gates, fact-reconciliation checks, and citation-integrity checks to prevent inaccurate research reports from reaching production. Develop golden-set and regression testing, then integrate validated approaches into the production pipeline with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy, self-direction, and a willingness to learn quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB
Model Risk

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Deployment
CI
Model Risk
LangGraph
DuckDB
Financial Intelligence
Quantitative Analysis
Institutional Investors
Research Services

Report this job

Work requirements

Jobs in Canada