Find work in Canada.

535,926 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 16 mins ago
EN
Principal Wireless SW Engineer
Extreme Networks
Toronto, ON
- Full-time
The Principal Wireless Software Engineer is a senior technical leader responsible for resolving the most complex and business-critical customer issues escalated through the Global Technical…
Added 1 hour ago
B
Software Engineer - Model Performance Systems
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor…
Added 1 hour ago
B
Software Engineer - Model Performance Systems
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor…
Added 1 hour ago
MS
Senior Engineer II, Proxy
Menlo Security Inc.
Canada
- Full-time
We're hiring a senior engineer to join the team that owns the ingress proxy service. The proxy is the primary path into the product for most users. As AI adoption grows, our customers want…
Added 2 hours ago
C
Application Programmer
Collabera
Mississauga, ON
- $70 to $80 USD / hour
- Full-time
We are seeking an experienced Senior Forward Deployed Engineer (FDE) with strong expertise in Java, Python, backend/full-stack development, and solution architecture. The ideal candidate…
Added 2 hours ago
GC
Geotechnical Engineer or Engineer-in-Training
Glencore Canada
Elkford, BC
- $91,300 to $126,800 CAD / year
- Full-time
Reporting to the Geotechnical Senior Engineering Supervisor, the Geotechnical Engineer or Engineer-in-Training (EIT) is responsible for pit and spoil slope stability.
Added 3 hours ago
W
Mechanical Engineer Level I
Worley
Calgary, AB · Edmonton, AB
- Full-time
We are currently seeking a Senior Metallurgical Engineer to join our Canada West Engineering team in either Calgary, Alberta or Edmonton, Alberta. This role is a senior technical authority…
Added 3 hours ago
S
Senior Opto-Mechanical Design Engineer
Sanmina
Ottawa, ON
- Full-time
The Senior Opto-Mechanical Design Engineer, as part of the larger product solutions development team, provides mechanical design support of product development, NPI, and manufacturing of a…
Added 3 hours ago
W
Senior Structural Engineer
WalterFedy
Calgary, AB
- Full-time
Are you a seasoned structural engineer ready to take on complex challenges and lead impactful projects across our building sectors? We’re looking for a Senior Structural Engineer to join…
Added 3 hours ago
Senior Software Engineer - Networking
Tigera
Vancouver, BC
Added 4 hours ago
W
Mechanical Engineer Level II
Worley
Vancouver, BC
- Full-time
Worley is currently looking to fill an Intermediate Mechanical Engineer / Project Manager position to provide mechanical engineering and project management services within the Mechanical…
Added 4 hours ago
SF
Senior Site Reliability Engineer
Safe Fleet
Coquitlam, BC
- Full-time
The Senior Site Reliability Engineer owns reliability, resilience and operational health across SafeFleet’s cloud-native product ecosystem. This is a hands-on engineering role with…
Added 4 hours ago
W
Software Engineer - C++ / Python / Android / Java L1
Wipro
Ottawa, ON
- Full-time
…vehicle technologies. Career progression may include Software Engineer, Senior Software Engineer, Technical Lead, and Software Architect roles, based on performance and…
Added 4 hours ago
X
Senior Software Engineer
Xsolla
Canada
- Full-time
For the Senior Software Engineer, we will conduct a background check that may include the following.
Added 4 hours ago
UC
AI Developer
UniSysTech Consulting
Toronto, ON · Greater Toronto and Hamilton Area, ON
- Other
We are seeking an experienced AI Developer (Mid to Senior Level) to lead the design, development, and deployment of enterprise-grade Artificial Intelligence and Machine Learning solutions.…
Added 4 hours ago
Q
Verification Engineer (Engineer–Senior Level)
Qualcomm
Toronto, ON
- Full-time
…create a smarter, connected future for all. As a Qualcomm ASIC Engineer, you will define, model, design (digital and/or analog), optimize, verify, validate, implement, and document IP…
Added 4 hours ago
M
Senior CyberArk Security Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
We are looking for an experienced Senior CyberArk Security Engineer to join our global Privileged Access Management (PAM) Engineering team and help strengthen the security, automation,…
Added 4 hours ago
A
Gen AI Engineer (Python,RAG, LangChain, LangSmith)
Apptad
Montreal, QC
- Full-time
We are looking for a Senior AI/ML Engineer with expertise in Retrieval-Augmented Generation (RAG), vector databases, multimodal AI, and prompt engineering. The candidate will be responsible…
Added 4 hours ago
IC
Software Engineer in Test
IT Connex
Toronto, ON · Greater Toronto Area, Canada
- Contract
Added 4 hours ago
SF
Senior AI Engineer
Safe Fleet
Coquitlam, BC
- Full-time
We are looking for a hands-on Senior AI Engineer to build the platform that makes that possible - the shared services, agent framework, standards and tooling that allow every engineer on…
Added 4 hours ago
LM
Senior Software Engineer - Product Lead - ISS Team
Lockheed Martin
Ottawa, ON
- $102,750 to $134,750 USD / year
- Full-time
he Senior Software Engineer is a technical leader and subject matter expert who combines hands-on software development with team leadership and mentorship. In this role, the successful…
Added 4 hours ago
SI
Conseiller(ère) principal(e) en gestion des actifs / Senior Advisor, Asset Management & Operational Efficiency
Systemex Industries Conseils
Montreal, QC
- Full-time
We are looking for a Senior Advisor, Asset Management & Operational Efficiency to join our team and play a key strategic and technical leadership role in the delivery of complex industrial…
Added 4 hours ago
G
Geotechnical Engineer or Engineer-in-Training
Glencore
Elkford, BC
- $91,300 to $126,800 CAD / year
- Full-time
Reporting to the Geotechnical Senior Engineering Supervisor, the Geotechnical Engineer or Engineer-in-Training (EIT) is responsible for pit and spoil slope stability.
Added 4 hours ago
SC
Senior Manager – Systems Requirements
SYSTRA Canada
Toronto, ON
- Full-time
The Senior Manager, Systems Engineering Management (Requirements) is responsible for leading requirements management activities across the GO Expansion program and ensuring effective…
Added 4 hours ago
EV
Geotechnical Engineer or Engineer-in-Training
Elk Valley Resources
Elkford, BC
- $91,300 to $126,800 CAD / year
- Full-time
Reporting to the Geotechnical Senior Engineering Supervisor, the Geotechnical Engineer or Engineer-in-Training (EIT) is responsible for pit and spoil slope stability.

15Rock

Applied AI Engineer - Evaluation & Reliability

Toronto, ON, Canada
Greater Toronto Area, Canada, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Apr 27, 2027
Posting language: English
Posted: Oct 29, 2026

Original job description

Applied AI Engineer - Evaluation & ReliabilityThe problem you'd own

15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line - by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live source.

We build that research with a multi-agent pipeline on large language models. LLMs write well and count badly: left alone, they produce clean prose that contradicts the table three paragraphs up. Our answer isn't "prompt harder." It's to route every number through deterministic computation and gate every report behind checks that pass or fail - never a model grading its own work. You'd build that layer.

What you'll build

Deterministic evaluation gates that block a report when a defect is present - measured against thresholds set before the run, not a gut feel.
A fact-reconciliation layer that verifies a figure agrees with itself everywhere it appears.
Citation-integrity checks: every reference resolves, every quote is real, every source is live.
Golden-set and regression harnesses that catch quality drift before it ships.
The path from research to production: hardening a validated approach into the pipeline, behind CI, with the traces to prove it works.

What we're looking for

You've shipped LLM systems to production - not demos - where being wrong had a cost.
You've built the evaluations that kept them honest: you think in precision and recall, and you define "good" before you measure it.
Strong Python; you can own backend services and data pipelines yourself.
You reason about the numbers, not just the tokens - enough quantitative or financial literacy to know when a figure is wrong, or the appetite to learn it fast.
Self-directing. You'd rather write a one-page memo than wait for a ticket.

Bonus: model-risk or evaluation-infrastructure work in a regulated setting; LangGraph, DuckDB, CI you owned; a finance or quantitative background.

This role is not

Prompt engineering, a pure research seat, or a place where "the model said so" is an answer.

How we work

A small, senior team with direct access to the founder and research lead. Async by default - we meet on blockers, not to read status aloud. We run on hypotheses and measurable outcomes.

Details

Downtown Toronto, on-site / hybrid. Must be authorized to work in Canada. Early-stage financial intelligence firm, recognized by the Globe and Mail Changemaker Award and selected for Google for Startups.

To Apply: send a short note and something you've built where correctness mattered to Careers@15Rock.com . Tell us about a check you built that caught something a person would have missed.

15Rock is an equal-opportunity employer.

Apply About employer

More about this job

Responsibilities

Build deterministic evaluation gates, fact-reconciliation checks, and citation-integrity checks to prevent inaccurate research reports from reaching production. Develop golden-set and regression testing, then integrate validated approaches into the production pipeline with CI and traceable evidence.

Requirements

Candidates should have shipped production LLM systems where errors carried real costs and built evaluations using defined quality measures such as precision and recall. Strong Python and the ability to own backend services and data pipelines are required, along with quantitative or financial literacy, self-direction, and a willingness to learn quickly.

Skills

Python
LLM Production Systems
Evaluation Design
Precision and Recall
Deterministic Computation
Fact Reconciliation
Citation Integrity
Regression Testing
Backend Services
Data Pipelines
Quantitative Analysis
Financial Literacy
CI
LangGraph
DuckDB
Model Risk

Visa sponsorship

Not detected in the job text

Keywords

Applied AI
Large Language Models
Multi-Agent Pipeline
Python
Deterministic Computation
Evaluation Gates
Precision
Recall
Fact Reconciliation
Citation Integrity
Golden Sets
Regression Testing
Backend Services
Data Pipelines
Production Deployment
CI
Model Risk
LangGraph
DuckDB
Financial Intelligence
Quantitative Analysis
Institutional Investors
Research Services

Report this job