Find work in Canada.

615,764 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 6 mins ago
AR
Reservations Agent
Algonquin Resort
Banff, AB
- Full-time
The duties and responsibilities for the Reservations Agent include, but are not limited to the following:
Added 20 mins ago
B
Senior Coding, ML & Security Experts - AI Benchmarking
Braintrust
Canada
- Full-time
…field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux…
Added 20 mins ago
B
Senior Systems & Hardware Experts - AI Benchmarking
Braintrust
Canada
- Full-time
…field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux…
Added 21 mins ago
H
Agent(e) bilingue au centre de services TI | Français québécois et anglais
HCLTech
Canada
- Full-time
Added 21 mins ago
KI
Human Resources Advisor
Kruger Inc.
Corner Brook, NL
- Full-time
Aptitude to function as a Change Agent, to foster creativity and idea generation.
Added 21 mins ago
FA
Leasing Team Lead, Ottawa
Forum Asset Management
Ottawa, ON
- Full-time
Forum Asset Management is seeking a Leasing Team Lead to be the lead leasing agent for Ottawa. The role leases a building book personally and supervises the Ottawa leasing team, so it has…
Added 21 mins ago
FA
Leasing Team Lead, Waterloo
Forum Asset Management
Waterloo, ON
- Full-time
Forum Asset Management is seeking a Leasing Team Lead to be the lead leasing agent for Waterloo, our largest student market. The role leases a building book personally and supervises the…
Added 21 mins ago
GW
AI and Data Engineer
George Weston Limited
Toronto, ON
- Full-time
Strong understanding of agentic AI architectures, multi-agent systems, prompt engineering, workflow orchestration, and AI application evaluation frameworks
Added 21 mins ago
LD
Engineering Manager, Agentic AI & Machine Learning
Loblaw Digital
Toronto, ON
- Full-time
Drive Agentic AI innovation: Lead the architecture and development of AI-powered applications incorporating LLMs, agent orchestration, tool calling, retrieval, and intelligent workflows.
Added 36 mins ago
MU
Security Services Agent - Campus Safety and Security Services
MacEwan University
AB · Edmonton, AB
- Full-time
MacEwan University is seeking at least one Security Services Agent for a part-time, casual opportunity with our Campus Safety and Security Services department.
Added 51 mins ago
ID
Call Centre Agent - Work at Home
Inspire Direct Marketing
Remote, Canada
- $20 to $24 CAD / hour
- Full-time
- Remote
Added 51 mins ago
Operations Manager, Scotia iTRADE - Toronto, ON
Scotiabank
Toronto, ON
Design quality control practices to routinely review processed transactions and agent decision making.
Added 51 mins ago
Supply Planner
Nestle Operational Services Worldwide SA
Montreal, QC
Act as a change agent, you will lead or support process improvements, system enhancements, and continuous improvement initiatives, while ensuring compliance with Nestlé and Nespresso…
Added 51 mins ago
RD
Senior MLOps & Cloud Engineer (AWS / SageMaker)
Randstad Digital
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Emerging AI Frameworks: Practical experience with AgentOps / LLMOps / AIOps, Generative AI, retrieval-augmented generation (RAG), vector search, or AI Agent implementations.
Added 51 mins ago
AI
SQL Database Administrator
Apptoza Inc.
Vancouver, BC
- Full-time
Administer installation, configuration, upgrades, patching, migrations, cloning, refreshes, SQL Agent jobs, storage and capacity.
Added 51 mins ago
K
FULLSTACK ENGINEER
Kablamo
Toronto, ON
- Full-time
Leverage AI coding workflows and agent-driven development environments (such as Cursor or Claude Code) to ship code rapidly without sacrificing standards.
Added 51 mins ago
FG
Site Reliability Engineer | Release Management & Automation Specialist
FDM Group
Toronto, ON
- Contract
Design, develop, and support technical solutions that automate agent deployments and release orchestration.
Added 1 hour ago
SE
Service Agent
SMS Equipment Inc.
Val-d'Or, QC
- Full-time
Added 1 hour ago
RB
Full Stack Engineer
Royal Bank of Canada
Vancouver, BC
- Full-time
AI and LLM development: Experience building autonomous AI agent systems, with working knowledge of LLMs (transformers, tokenization, embeddings), prompt engineering, fine-tuning, RAG, and…
Added 1 hour ago
RB
Director, Strategy
Royal Bank of Canada
Toronto, ON
- Full-time
Lead rapid POC development cycles with authority to "fail fast / scale fast," designing multi-agent interactions across vendor agents, enterprise agents, and native/internal agents to…
Added 1 hour ago
E
Security Manager / gestionnaire de la sécurité
EllisDon
Ottawa, ON · Gatineau, QC · ON · Ontario Projects
- Full-time
Added 1 hour ago
P
Operations and Procurement Senior Associate
PwC
Victoria, BC · Vancouver, BC
- Full-time
Added 1 hour ago
P
Senior Associate, Salesforce Business Analyst
PwC
Toronto, ON · Ottawa, ON · Vancouver, BC · Calgary, AB
- Full-time
Added 1 hour ago
R
Director, Strategy
RBC
Toronto, ON
- Full-time
Lead rapid POC development cycles with authority to "fail fast / scale fast," designing multi-agent interactions across vendor agents, enterprise agents, and native/internal agents to…
Added 1 hour ago
D
Advisory Agent, Member and Client Experience
Desjardins
Sainte-Anne-des-Monts, QC · Caisse populaire Desjardins de La Haute-Gaspésie
- Full-time
As a member and client experience advisory agent, you help give members and clients a better experience, and ensure that they are satisfied. This includes making sure they feel welcome,…

Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Nov 6, 2026

Original job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced coding, machine learning or cybersecurity professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

At least 8 years of relevant professional experience in coding, machine learning or cybersecurity.
A completed master’s degree or higher. Candidates with a completed bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
Applicants must have completed their degrees and must not currently be enrolled in a degree program.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

Project details

Task-based project expected to run for the next weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required before moving to tasking.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume. Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

Apply About employer

More about this job

Responsibilities

Identify difficult, meaningful problems in coding, machine learning, or cybersecurity and convert them into clearly defined tasks solvable from scratch in a Linux terminal. Design and test benchmark challenges against leading AI models to expose their limitations and ensure the tasks are sufficiently difficult.

Requirements

Applicants need at least eight years of relevant professional experience, a completed master’s degree or higher, and at least one academic or professional publication; candidates with a completed bachelor’s degree, at least ten years of experience, and a publication may also qualify. Applicants must not currently be enrolled in a degree program, must be comfortable using a Linux terminal, and must reside in one of the listed eligible countries.

Skills

Coding
Machine Learning
Cybersecurity
Task Design
AI Benchmarking
Linux Terminal
Problem Solving
Challenge Development
Technical Writing
Model Evaluation
Academic Publishing

Visa sponsorship

Not detected in the job text

Keywords

AI Benchmarking
Artificial Intelligence
AI Agents
Coding
Machine Learning
Cybersecurity
Linux Terminal
Task-Based Project
Benchmark Tasks
Challenge Design
Problem Solving
Model Evaluation
Technical Assessment
Academic Publication
Professional Publication

Report this job