Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 3 days ago
M
Stagiaire en affaires médicales / Medical Affairs Intern
MSD
Kirkland, QC
- Full-time
…Clinical Oncology, Clinical Research, Clinical Support, Data Analytics, Database Management, Data Entry, Data Visualization, Disease Processes, Document Management, Evidence-Based Medicine,…
Added 3 days ago
M
Stagiaire en affaires médicales / Medical Affairs Intern
MSD
Toronto, ON · Kirkland, QC
- Full-time
Analytical Problem Solving, Analytical Problem Solving, Calendar Management, Clinical Research, Data Analytics, Database Management, Data Entry, Data Visualization, Document Management,…
Added 3 days ago
C
Apps Support Intmd Analyst - Officer
Citi
Mississauga, ON
- Full-time
Added 3 days ago
FC
Senior Workday Functional Specialist
Fanshawe College
London, ON
- Full-time
Added 3 days ago
II
Analyste de Recherche/Research Analyst, Channel Performance
Ipsos in Canada
Montreal, QC
- Full-time
Added 3 days ago
MC
Senior Sales Representative - KYC Solutions
Moody's Corporation
Toronto, ON
- Full-time
Familiarity with AI, automation, analytics, and data-driven workflow transformation is preferred
Added 3 days ago
T
Manufacturing System Engineer
Trioworld
Ajax, ON
- $95,000 to $130,000 CAD / year
- Full-time
Added 3 days ago
MC
Senior Small Business Advisor
Meridian Credit Union
Barrie, ON
- $68,800 to $100,000 CAD / year
- Full-time
Added 3 days ago
C
Product Owner
Croesus
Montreal, QC · Laval, QC
- Full-time
Added 3 days ago
WG
Supply Chain Business Partner
Wesdome Gold Mines
Toronto, ON
- $103,500 to $117,000 CAD / year
- Full-time
Added 3 days ago
M
AI Scientist Intern - (Internship, Masters or Phd)
Mistral
Montreal, QC
- Internship
Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes…
Added 3 days ago
B
Senior Coding, ML & Security Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Applicants must have completed their degrees and must not currently be enrolled in a degree program
Added 3 days ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Montreal, QC
- Full-time
Added 3 days ago
SC
AI Engineer
Smart Circle International
Richmond Hill, ON
- $85,000 to $100,000 CAD / year
- Full-time
…solutions across the organization, including AI agents for our analytics and customer success teams. You’ll work closely with delivery, data, and engineering teams to develop AI-enabled…
Added 3 days ago
VP, Customer Support, Community, and Knowledge
D2L
Toronto, ON · Kitchener, ON
You will bring a highly analytics mindset to D2L and be an authoritative subject matter expert on all areas of Customer Support.
Added 3 days ago
Chief Information Officer/Director, Digital Services
The City of Red Deer
Red Deer, AB
…accessible organizational data, supporting effective integration, analytics and informed decision-making across the…
Added 3 days ago
MS
Clinical Scientist (On Site)
Myant Shared Service Corp.
Mississauga, ON
- Full-time
Added 3 days ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Toronto, ON
- Full-time
Added 3 days ago
V
Production Support
Virtusa
Toronto, ON
- Full-time
Added 3 days ago
GW
AI and Data Engineer
George Weston Limited
Toronto, ON
- Full-time
Added 3 days ago
LD
Engineering Manager, Agentic AI & Machine Learning
Loblaw Digital
Toronto, ON
- Full-time
…commerce. From intelligent campaign creation and conversational analytics to forecasting, recommendations, and optimization, we're building AI systems that deliver meaningful business…
Added 3 days ago
R
Senior Data Analyst, New Products
Remitly
Burnaby, BC
- Full-time
These products extend Remitly beyond cross-border transfers into everyday money management, which brings new fraud risks
Added 3 days ago
WM
Coordinator, Production & Content Media Operation
Warner Music Group
Toronto, ON · CAN - Toronto
- Full-time
Added 3 days ago
PR
Manager, Replenishment Planning
Pernod Ricard
Windsor, ON
- Full-time
Lead strategic process-improvement, analytics, automation, and planning-system initiatives from design through adoption.
Added 3 days ago
C
Quantum Machine Learning Research Scientist
CIBC
Toronto, ON
- Full-time
You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit

Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Nov 6, 2026

Original job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced coding, machine learning or cybersecurity professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

At least 8 years of relevant professional experience in coding, machine learning or cybersecurity.
A completed master’s degree or higher. Candidates with a completed bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
Applicants must have completed their degrees and must not currently be enrolled in a degree program.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

Project details

Task-based project expected to run for the next weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required before moving to tasking.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume. Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

Apply on LinkedIn About employer

More about this job

Responsibilities

Identify difficult, meaningful problems in coding, machine learning, or cybersecurity and convert them into clearly defined tasks solvable from scratch in a Linux terminal. Design and test benchmark challenges against leading AI models to expose their limitations and ensure the tasks are sufficiently difficult.

Requirements

Applicants need at least eight years of relevant professional experience, a completed master’s degree or higher, and at least one academic or professional publication; candidates with a completed bachelor’s degree, at least ten years of experience, and a publication may also qualify. Applicants must not currently be enrolled in a degree program, must be comfortable using a Linux terminal, and must reside in one of the listed eligible countries.

Skills

Coding
Machine Learning
Cybersecurity
Task Design
AI Benchmarking
Linux Terminal
Problem Solving
Challenge Development
Technical Writing
Model Evaluation
Academic Publishing

Visa sponsorship

Not detected in the job text

Keywords

AI Benchmarking
Artificial Intelligence
AI Agents
Coding
Machine Learning
Cybersecurity
Linux Terminal
Task-Based Project
Benchmark Tasks
Challenge Design
Problem Solving
Model Evaluation
Technical Assessment
Academic Publication
Professional Publication

Report this job

Work requirements

Jobs in Canada