Find work in Canada.

622,537 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 1 day ago
V
Director, Strategic Insights
Vancity
Vancouver, BC
- Full-time
As the Director, Strategic Insights, you will lead the Strategic Insights team within the Analytics Centre of Excellence and oversee how the organization engages with analytics to support…
Added 1 day ago
MC
Senior Small Business Advisor
Meridian Credit Union
Barrie, ON
- $68,800 to $100,000 CAD / year
- Full-time
A significant portion of time will be dedicated to new acquisition activities and the Senior Small Business Advisor will spend 30%-50% of their time outside the branch.
Added 1 day ago
R
Manager, Business Development (Telework/Hybrid)
Radio-Canada
Montreal, QC
- Part-time
Oversee the design and activation of strategic sales tools that leverage market intelligence and advanced analytics (Power BI, ThinkTV).
Added 1 day ago
B
Senior Coding, ML & Security Experts - AI Benchmarking
Braintrust
Canada
- Full-time
Added 1 day ago
B
Technical Services Superintendent
Baffinland
NU · Broughton Island, NU
- Full-time
Mentor and provide performance feedback to team members and in particular to senior professionals.
Added 1 day ago
GO
Senior Analyst/Project Manager
Government of Nunavut
Iqaluit, NU
- Full-time
Reporting to the Director, Nunavut Bureau of Statistics (NBS), the Senior Analyst/Project Manager (Manager) will help the NBS, as well as other Government of Nunavut departments, to provide…
Added 1 day ago
LD
Senior Manager, Continuous Improvement, Ecomm Operations
Loblaw Digital
Toronto, ON
- Full-time
As the Senior Manager, Continuous Improvement, you will be responsible to identify, quantify, and drive measurable improvements for in store fulfillment productivity and labour efficiency…
Added 1 day ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Montreal, QC
- Full-time
At Confluence, we're building the future of investment data through innovation, collaboration and continuous improvement. As AI reshapes the financial services industry, we're embracing new…
Added 1 day ago
T
Vice President Human Resources-manufacturing
Technifite
Innisfil, ON
- Full-time
The successful candidate will serve as a trusted business partner to senior leadership, driving organizational effectiveness, workforce strategy, leadership development, culture, talent…
Added 1 day ago
VP, Customer Support, Community, and Knowledge
D2L
Toronto, ON · Kitchener, ON
Synthesize large amounts of operational data, metrics, KPIs and customer feedback to make operational decisions and support leaders to be more efficient.
Added 1 day ago
Chief Information Officer/Director, Digital Services
The City of Red Deer
Red Deer, AB
Enterprise Data Architecture and Integration: Advance the technical foundations that enable secure, connected and accessible organizational data, supporting effective integration, analytics…
Added 1 day ago
SA
Senior IT Infrastructure Administrator, DevOps
Style Analytics
Toronto, ON
- Full-time
At Confluence, we're building the future of investment data through innovation, collaboration and continuous improvement. As AI reshapes the financial services industry, we're embracing new…
Added 1 day ago
IG
Manager of Commercial Assurance
Insight Global
Calgary, AB
- Full-time
Experience with Power BI, SQL, ACL, IDEA, or similar data analytics tools
Added 1 day ago
R
Senior Data Analyst, New Products
Remitly
Burnaby, BC
- Full-time
The Senior Data Analyst, Fraud (New Products) will be part of Remitly's Identity & Trust Analytics Team, reporting to the Senior Manager, Fraud Program and Analytics. As a senior individual…
Added 1 day ago
WM
Coordinator, Production & Content Media Operation
Warner Music Group
Toronto, ON · CAN - Toronto
- Full-time
Reports To: Senior Manager Production & Content Media
Added 1 day ago
PR
Manager, Replenishment Planning
Pernod Ricard
Windsor, ON
- Full-time
Lead data-quality reviews and recommend parameter or policy changes based on performance, risk, and business impact.
Added 1 day ago
Senior DevOps Engineer - EA Sports Technology
Electronic Arts
Vancouver, BC
Experience porting large applications from a physical data center into a public cloud environment.
Added 1 day ago
T
Analyst, Margin Accounts Group (4583)
TD
Toronto, ON
- Full-time
Provide clear status updates and risk commentary, escalating decisions and complex matters to senior team members as appropriate.
Added 1 day ago
C
Quantum Machine Learning Research Scientist
CIBC
Toronto, ON
- Full-time
…play a key individual contributor role within CIBC’s Advanced Analytics and AI team, driving the development and application of quantum computing capabilities across the bank. You will lead…
Added 1 day ago
B
Senior Manager, Business Transformation
BMO
Toronto, ON · FCP
- Full-time
Defines business requirements for analytics & reporting to ensure data insights inform business decision making.
Added 1 day ago
B
Digital Product Manager
BMO
Toronto, ON · BMOPLACE
- Full-time
Comfort using data and analytics to measure outcomes and inform prioritization.
Added 1 day ago
E
Senior Financial Planning Analyst
ecobee
Toronto, ON
- Full-time
Our finance team is looking for a Senior Financial Analyst reporting to the Manager FP&A to join the team. You are an experienced finance professional who works independently and builds…
Added 1 day ago
M
Senior Manager, Operational Resilience
Manulife
Toronto, ON · Waterloo, ON · Montreal, QC · Halifax, NS
- Full-time
Reporting into the Director, Operational Resilience, the Senior Manager, Operational Resilience is a key member of the global Operational Risk & Resilience Management (ORRM) 2nd line of…
Added 1 day ago
Technical Product Manager
Charger Logistics Inc
Brampton, ON
Partner with business stakeholders to investigate operational challenges, identify root causes, and recommend practical, data-driven solutions.
Added 1 day ago
PC
IT Product Intern - Data and Analytics - May 2027 (4-Month Term)
Parkland Corporation
Calgary, AB
- Full-time
The Data Product Intern will support the Data Products and Analytics team in defining, delivering, and improving trusted data products that address real business needs. Working alongside…

Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Nov 6, 2026

Original job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced coding, machine learning or cybersecurity professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

At least 8 years of relevant professional experience in coding, machine learning or cybersecurity.
A completed master’s degree or higher. Candidates with a completed bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
Applicants must have completed their degrees and must not currently be enrolled in a degree program.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

Project details

Task-based project expected to run for the next weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required before moving to tasking.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume. Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

Apply About employer

More about this job

Responsibilities

Identify difficult, meaningful problems in coding, machine learning, or cybersecurity and convert them into clearly defined tasks solvable from scratch in a Linux terminal. Design and test benchmark challenges against leading AI models to expose their limitations and ensure the tasks are sufficiently difficult.

Requirements

Applicants need at least eight years of relevant professional experience, a completed master’s degree or higher, and at least one academic or professional publication; candidates with a completed bachelor’s degree, at least ten years of experience, and a publication may also qualify. Applicants must not currently be enrolled in a degree program, must be comfortable using a Linux terminal, and must reside in one of the listed eligible countries.

Skills

Coding
Machine Learning
Cybersecurity
Task Design
AI Benchmarking
Linux Terminal
Problem Solving
Challenge Development
Technical Writing
Model Evaluation
Academic Publishing

Visa sponsorship

Not detected in the job text

Keywords

AI Benchmarking
Artificial Intelligence
AI Agents
Coding
Machine Learning
Cybersecurity
Linux Terminal
Task-Based Project
Benchmark Tasks
Challenge Design
Problem Solving
Model Evaluation
Technical Assessment
Academic Publication
Professional Publication

Report this job