Jobs in Canada

Email me new jobs Save this search

Added 1 day ago
A
Director, Stations
AECOM
Mississauga, ON
- Full-time
Added 1 day ago
W
(CAN) Customer Service Manager
Walmart
Regina, SK
- Part-time
Added 1 day ago
NS
Sr. Account Manager, Public Relations
North Strategic
Toronto, ON
- $80,000 to $90,000 CAD / year
- Contract
Added 1 day ago
WG
Supply Chain Business Partner
Wesdome Gold Mines
Toronto, ON
- $103,500 to $117,000 CAD / year
- Full-time
Develop and communicate market intelligence (labour, fuel, consumables, OEM trends).
Added 1 day ago
B
Senior Coding, ML & Security Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Added 1 day ago
B
Senior Systems & Hardware Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Added 1 day ago
FV
Founder, Data Centre Buildout
Forum Ventures
Canada
- Full-time
You may have worked at an electrical manufacturer, EPC, utility, data center developer or heavy-haul carrier and felt the equipment and power bottleneck firsthand.
Added 1 day ago
R-
Specialist, CRM & Lifecycle Marketing
RCL - Reitmans Canada Ltd/Ltée
Montreal, QC
- Full-time
The use of Artificial Intelligence may be used for candidate screening purposes.
Added 1 day ago
R-
Senior Merchandise Buyer – Accessories
RCL - Reitmans Canada Ltd/Ltée
Montreal, QC
- Full-time
The use of Artificial Intelligence may be used for candidate screening purposes.
Added 1 day ago
R-
Store Manager - Corner Brook Plaza
RCL - Reitmans Canada Ltd/Ltée
Corner Brook, NL
- Full-time
The use of Artificial Intelligence may be used for candidate screening purposes.
Added 1 day ago
S
Floral - Manager Floral
Sobeys
Campbell River, BC
- Full-time
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
NF
Department Manager Full Time Day
No Frills
Campbell River, BC
- Full-time
…position. This posting is for an existing vacancy. The Company uses artificial intelligence for the purpose of screening, assessing and/or selecting applicants for this position. /…
Added 1 day ago
SC
Floral - Manager Floral
Safeway Canada
Campbell River, BC
- Full-time
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
S
Front Store - Consultant Home Health Care
Sobeys
Summerside, PE
- Internship
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
PM
Commercial Operations Sr Executive
Philip Morris International
Toronto, ON
- Full-time
Added 1 day ago
R-
Store Manager - Southgate Centre
RCL - Reitmans Canada Ltd/Ltée
AB · Edmonton, AB
- Full-time
The use of Artificial Intelligence may be used for candidate screening purposes.
Added 1 day ago
R-
Senior Merchandise Buyer – Outerwear & Accessories
RCL - Reitmans Canada Ltd/Ltée
Montreal, QC
- Full-time
The use of Artificial Intelligence may be used for candidate screening purposes.
Added 1 day ago
LD
Senior Manager, Continuous Improvement, Ecomm Operations
Loblaw Digital
Toronto, ON
- Full-time
Added 1 day ago
SC
Front End - Clerk All Purpose Grid A SW
Safeway Canada
BC · West Vancouver, BC
- Full-time
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
PC
Co-op Student - Process Engineering - January 2027 (12 Month Term)
Parkland Corporation
Burnaby, BC
- Other
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our…
Added 1 day ago
S
Pharmacist Long Term Care - FT
Sobeys
Saint John, NB
- Full-time
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
SC
In Store Bakery - Baker Helper
Safeway Canada
BC · West Vancouver, BC
- Full-time
We may use Artificial Intelligence (AI) tools to support efficiencies in the candidate screening, assessment, and recruitment processes. These AI tools do not make hiring decisions on…
Added 1 day ago
SC
AI Engineer
Smart Circle International
Richmond Hill, ON
- $85,000 to $100,000 CAD / year
- Full-time
Added 1 day ago
VP, Customer Support, Community, and Knowledge
D2L
Toronto, ON · Kitchener, ON
You have experience implementing Artificial Intelligence into key workflows and processes to increase the customer experience and efficiency of overall Support o
Added 1 day ago
Business Development Representative II (Public Sector)
Dayforce
Canada

Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Nov 6, 2026

Original job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced coding, machine learning or cybersecurity professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

At least 8 years of relevant professional experience in coding, machine learning or cybersecurity.
A completed master’s degree or higher. Candidates with a completed bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
Applicants must have completed their degrees and must not currently be enrolled in a degree program.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

Project details

Task-based project expected to run for the next weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required before moving to tasking.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume. Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

Apply About employer

More about this job

Responsibilities

Identify difficult, meaningful problems in coding, machine learning, or cybersecurity and convert them into clearly defined tasks solvable from scratch in a Linux terminal. Design and test benchmark challenges against leading AI models to expose their limitations and ensure the tasks are sufficiently difficult.

Requirements

Applicants need at least eight years of relevant professional experience, a completed master’s degree or higher, and at least one academic or professional publication; candidates with a completed bachelor’s degree, at least ten years of experience, and a publication may also qualify. Applicants must not currently be enrolled in a degree program, must be comfortable using a Linux terminal, and must reside in one of the listed eligible countries.

Skills

Coding
Machine Learning
Cybersecurity
Task Design
AI Benchmarking
Linux Terminal
Problem Solving
Challenge Development
Technical Writing
Model Evaluation
Academic Publishing

Visa sponsorship

Not detected in the job text

Keywords

AI Benchmarking
Artificial Intelligence
AI Agents
Coding
Machine Learning
Cybersecurity
Linux Terminal
Task-Based Project
Benchmark Tasks
Challenge Design
Problem Solving
Model Evaluation
Technical Assessment
Academic Publication
Professional Publication

Report this job