Find work in Canada.

615,764 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 10 mins ago
NS
Sr. Account Manager, Public Relations
North Strategic
Toronto, ON
- $80,000 to $90,000 CAD / year
- Contract
As a Senior Account Manager, you will be working as part of a dynamic account team in a fast-paced agency environment, developing and delivering strategic, creative programs for consumer…
Added 10 mins ago
B
Senior Coding, ML & Security Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Added 10 mins ago
B
Senior Systems & Hardware Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Added 10 mins ago
H
Agent(e) bilingue au centre de services TI | Français québécois et anglais
HCLTech
Canada
- Full-time
We are seeking a Senior Java/AWS Developer with strong hands-on experience building and supporting scalable enterprise applications. The ideal candidate will have solid expertise in Java,…
Added 10 mins ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Montreal, QC
- Full-time
We are looking for a Senior IT Infrastructure Administrator, DevOps to join our Cloud Infrastructure team and help build the next generation of Confluence’s cloud environment.
Added 10 mins ago
SH
Therapy Assistant - MacKenzie Health Hospital
SE Health
Richmond Hill, ON
- Contract
…our work. As a social enterprise, we support research into Senior’s Health and…
Added 10 mins ago
VP, Customer Support, Community, and Knowledge
D2L
Toronto, ON · Kitchener, ON
Added 10 mins ago
Pharmacy Assistant, L1 - Night Shift
CareRx
Oakville, ON
At CareRx, we are shaping the future of senior care through pharmacy services that make a real difference. As Canada’s trusted leader in specialty pharmacy services for long-term care,…
Added 10 mins ago
Pharmacy Assistant, L2
CareRx
Oakville, ON
At CareRx, we are shaping the future of senior care through pharmacy services that make a real difference. As Canada’s trusted leader in specialty pharmacy services for long-term care,…
Added 10 mins ago
Chief Information Officer/Director, Digital Services
The City of Red Deer
Red Deer, AB
As the City's senior technology advisor, the CIO will work closely with executive leadership, departments and Council, as required, to navigate complex technology decisions, balance…
Added 10 mins ago
FA
Leasing Team Lead, Oshawa
Forum Asset Management
ON · As Listed/Assigned, Ontario
- Full-time
Forum Asset Management is a North American investor, developer, and asset manager with a 30+ year track record of delivering long-term value through real estate, private equity, and…
Added 10 mins ago
EG
Senior Manager, Partnerships
Emterra Group
Oakville, ON
- Full-time
The Senior Manager, Partnerships is a strategic commercial leader responsible for managing and growing relationships with high-value clients within the circular economy and recycling…
Added 10 mins ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Toronto, ON
- Full-time
We are looking for a Senior IT Infrastructure Administrator, DevOps to join our Cloud Infrastructure team and help build the next generation of Confluence’s cloud environment.
Added 10 mins ago
NS
Account Manager (PR)
North Strategic
Toronto, ON
- Full-time
Lead campaigns from the front: Lead PR campaigns from big idea to flawless execution, acting as project lead alongside senior leaders to deliver standout work that exceeds client objectives
Added 25 mins ago
R
Senior Data Analyst, New Products
Remitly
Burnaby, BC
- Full-time
The Senior Data Analyst, Fraud (New Products) will be part of Remitly's Identity & Trust Analytics Team, reporting to the Senior Manager, Fraud Program and Analytics. As a senior individual…
Added 25 mins ago
WM
Coordinator, Production & Content Media Operation
Warner Music Group
Toronto, ON · CAN - Toronto
- Full-time
Reports To: Senior Manager Production & Content Media
Added 25 mins ago
PR
Manager, Replenishment Planning
Pernod Ricard
Windsor, ON
- Full-time
Frame decisions for S&OE, S&OP, and senior supply forums, clearly articulating scenarios, recommendations, trade-offs, financial exposure, and required actions.
Added 25 mins ago
C
Quantum Machine Learning Research Scientist
CIBC
Toronto, ON
- Full-time
Communication & Translation – Clearly articulate complex quantum concepts and research findings to a broad audience, including senior leadership, enabling informed decision-making.
Added 25 mins ago
B
Senior Manager, Business Transformation
BMO
Toronto, ON · FCP
- Full-time
Makes recommendations to senior leaders on strategy and new initiatives, based on an in-depth understanding of the business/group.
Added 25 mins ago
B
Digital Product Manager
BMO
Toronto, ON · BMOPLACE
- Full-time
Clear written and verbal communication, including status reporting and escalating risks to senior stakeholders.
Added 25 mins ago
E
Senior Financial Planning Analyst
ecobee
Toronto, ON
- Full-time
Our finance team is looking for a Senior Financial Analyst reporting to the Manager FP&A to join the team. You are an experienced finance professional who works independently and builds…
Added 40 mins ago
A-
Senior Project Manager
AMA - Alberta Motor Association
Edmonton, AB · Administration Centre
- Full-time
Exceptional communication with senior stakeholders.
Added 40 mins ago
M
Senior Manager, Operational Resilience
Manulife
Toronto, ON · Waterloo, ON · Montreal, QC · Halifax, NS
- Full-time
Reporting into the Director, Operational Resilience, the Senior Manager, Operational Resilience is a key member of the global Operational Risk & Resilience Management (ORRM) 2nd line of…
Added 40 mins ago
IE
Directeur(trice) principal, Solutions aux patients, Canada /Senior Director Patient Solutions, Canada
Inizio Engage
Toronto, ON · Ottawa, ON · Mississauga, ON · Dorval, QC · Montreal, QC · Quebec, QC · Laval, QC
- Full-time
Added 40 mins ago
Technical Product Manager
Charger Logistics Inc
Brampton, ON
5+ years of experience in product management, senior business analysis, or technology-driven process improvement.

Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Nov 6, 2026

Original job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced coding, machine learning or cybersecurity professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

At least 8 years of relevant professional experience in coding, machine learning or cybersecurity.
A completed master’s degree or higher. Candidates with a completed bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
Applicants must have completed their degrees and must not currently be enrolled in a degree program.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

Project details

Task-based project expected to run for the next weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required before moving to tasking.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume. Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

Apply About employer

More about this job

Responsibilities

Identify difficult, meaningful problems in coding, machine learning, or cybersecurity and convert them into clearly defined tasks solvable from scratch in a Linux terminal. Design and test benchmark challenges against leading AI models to expose their limitations and ensure the tasks are sufficiently difficult.

Requirements

Applicants need at least eight years of relevant professional experience, a completed master’s degree or higher, and at least one academic or professional publication; candidates with a completed bachelor’s degree, at least ten years of experience, and a publication may also qualify. Applicants must not currently be enrolled in a degree program, must be comfortable using a Linux terminal, and must reside in one of the listed eligible countries.

Skills

Coding
Machine Learning
Cybersecurity
Task Design
AI Benchmarking
Linux Terminal
Problem Solving
Challenge Development
Technical Writing
Model Evaluation
Academic Publishing

Visa sponsorship

Not detected in the job text

Keywords

AI Benchmarking
Artificial Intelligence
AI Agents
Coding
Machine Learning
Cybersecurity
Linux Terminal
Task-Based Project
Benchmark Tasks
Challenge Design
Problem Solving
Model Evaluation
Technical Assessment
Academic Publication
Professional Publication

Report this job