Find work in Canada.

327,931 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added just now
Senior Director, Global Communication
Intelcom
Montreal, QC · Service Centre (Montreal)
Full-time
Added just now
Assistant Manager, Supply Chain Finance, Trade Finance Operations (12-Month Contract) - Toronto
Scotiabank
Toronto, ON
…and escalate any concerns and complaints to the Manager and Senior Manager in order to propose workable solutionUnderstand how the Bank’s risk appetite…
Added just now
EH&S Advisor
GFL Environmental Inc.
Toronto, ON
Full-time
Other duties as prescribed by the Senior Manager
Added just now
Senior Consultant- Commercial Digital Banking PO
Infosys
Canada
Added just now
Test Manager - Quality Assurance | North America | Canada | Europe | Remote
Escape Velocity Entertainment Inc
Remote, Canada
Full-time · Remote
Advocate for quality as the senior QA representative within project leadership, balancing technical standards with production constraints.
Added just now
Senior Manager, Sales Enablement & Operations
Aviso Wealth
Remote, Canada
$110,000 to $135,000 CAD / year
Full-time · Remote
We’re looking for a Senior Manager, Sales Enablement & Operations to join our Strategic Partnerships and Priority Clients team. Reporting to the VP, Strategic Partnerships and Priority…
Added just now
CA-Senior Manager
Apple
Canada
As a Senior Manager, you’re responsible for creating a positive environment of customer interactions that effectively drive achievement of performance goals and business priorities. You…
Added just now
Operations Coordinator
Mattamy Homes
Canada
Full-time
Added just now
Sales Executive (Retail)
INFOYA
Toronto, ON
$150,000 to $225,000 CAD / year
Full-time
Act as a senior contact for client executives and manage complex stakeholder environments
Added just now
Associate/Full Professor-Academic Geriatrician, Division Head & Peter Cipriano Chair, Senior Health
University of Toronto
Toronto, ON
Added 15 mins ago
Director of Strategic Partnerships
Via
Vancouver, BC
Act as a trusted advisor and consultant to partners at the most senior levels, translating their ideas and community needs into revenue opportunities and driving decisions that shape…
Added 15 mins ago
Senior Director, Patent Analysis & Reverse Engineering
J.S. Held LLC
Ottawa, ON
Full-time
We are seeking a highly motivated individual to join our expanding team as a Senior Director in our Patent Analysis and Reverse Engineering division. This role combines strategic leadership…
Added 15 mins ago
Senior Product Manager - Commercial & Contract Management, Construction & Engineering
IFS
Ottawa, ON
Full-time
We are looking for an experienced Senior Product Manager, Commercial & Contract Management to lead the strategy and evolution of IFS capabilities covering:
Added 30 mins ago
Human Resources Generalist
Haivision
Montreal, QC
Temporary
…members of the HR team on a variety of HR tasks. Reporting to the Senior Director of Human Resources and working closely with the Vice President of Finance, the HR Generalist will be…
Added 30 mins ago
Senior Manager, Sales Enablement & Operations
Aviso
Toronto, ON
$110,000 to $135,000 CAD / year
Full-time
We're looking for a Senior Manager, Sales Enablement & Operations to join our Strategic Partnerships and Priority Clients team. Reporting to the VP, Strategic Partnerships and Priority…
Added 30 mins ago
Security Generalist & Senior Security Generalist
Department of National Defence/Ministère de la Défense nationale
Saguenay, QC
$73,798 to $87,108 CAD / year
Full-time
The Department of National Defence (DND) is currently seeking Security Generalists and Senior Security Generalists in Bagotville, Quebec.
Added 30 mins ago
Capture Manager Domestic Market
Lockheed Martin
Victoria, BC
Full-time
Presenting to senior leadership organizations (able to get a clear message across)
Added 30 mins ago
Mining Consultant
Minax Inc.
Sudbury, ON · Greater Sudbury, ON
Full-time
…demand is now outrunning our capacity, and we are adding a senior pair of hands: an experienced mining engineer who can own client work end to end, guide our junior engineers, and help us…
Added 30 mins ago
Senior People Business Partner
Meridia Recruitment Solutions, a KBRS Company
NS · Nova Scotia, Canada
Full-time
PepsiCo's Human Resources leaders provide leadership and management support to their respective business partners. This Senior People Business Partner role supports PepsiCo's Field Sales…
Added 30 mins ago
Systems Engineer - Underwater Warfare Systems (UWW)
Lockheed Martin
Montreal, QC
Full-time
Collaborating on Underwater Warfare system design activities with senior systems engineering and other engineering staff, including supporting technical reviews
Added 30 mins ago
Sr. Full Stack Developer (.NET, C#, Angular)
Insight Global
Toronto, ON
$110,000 to $134,000 CAD / year
Full-time
Insight Global is seeking a Sr. Full Stack Developer (.NET, C#, Angular) for a top healthcare technology client to help build and launch a new administration platform supporting its U.S.…
Added 30 mins ago
Technicien de paie/Technicienne de paie
Nouveau Monde Graphite | NYSE: NMG + TSX: NOU
Montreal, QC
Full-time
Reporting to the Senior Manager, Compensation and Systems, the Payroll Technician will be responsible for the full semi-monthly payroll cycle and ensuring compliance with all applicable…
Added 30 mins ago
Medical Laboratory Technologist - Molecular Genetics Library
London Health Sciences Centre (LHSC)
London, ON
$38.8 to $52.91 CAD / hour
Full-time
…the Molecular Diagnostics Program in coordination with the Senior Medical Laboratory Technologists. MLTs in the Molecular Genetics laboratory are part of a dynamic, engaging and…
Added 30 mins ago
Associate Director, Canada Lease Pricing
Stellantis Financial Services US
Toronto, ON
Full-time
…internal system configuration. This individual will Partner with senior management to develop strategies to grow our analytical responsibilities and enhance our production efficiency, while…
Added 30 mins ago
Senior Pension Consultant
Venor
Halifax, NS
Full-time
Venor is proud to partner with the Halifax Regional Municipality Pension Plan (HRM Pension Plan) in their search for a Senior Pension Consultant to join their Plan Member Services team.

Closed listing

RBC

Staff Data Scientist, AI Evaluations Platform

Toronto, ON, Canada
Montreal, QC, Canada

Job type: Full-time
Closing date: Oct 5, 2026
Posting language: English
Posted: Sep 21, 2026

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Similar jobs hiring now

Added 1 hour ago
Senior Data Scientist | Informatica CDGC, Data Marketplace, Data Governance, Metadata Management, SQL, Azure, Databricks, Power BI
CCI- Computer Consultants International, Inc. · Toronto, ON, Canada
Added 7 hours ago
Senior Data Scientist
Teckhorizon Inc · Toronto, ON, Canada
Added 10 hours ago
Data Scientist - Senior - RQ11583
S M Software Solutions Inc · Toronto, ON, Canada
Added 14 hours ago
Data Scientist II (Credit Risk and Product)
TD · Toronto, ON, Canada

Search current openings

Original job description

Archived listing. The details below describe a past opening.

Job Description

What is the opportunity?

RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data Scientist, AI Evaluations, you will be a senior technical leader in the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation protocols, quality benchmarks, and measurement frameworks that help AI systems move from experimentation to production with evidence and control, while providing technical guidance and mentorship to other data scientists on the team.

What will you do?

Design and drive advanced model and agent evaluation methodologies, including evaluation datasets, rubrics, LLM-as-judge methods, deterministic scorers, human evaluation, and measurement frameworks, providing technical guidance to junior team members.
Define evaluation science standards that translate model risk, responsible AI, product quality, safety, and business expectations into measurable criteria, repeatable methods, and clear evidence.
Own the end-to-end lifecycle for evaluation datasets and scorecards, including sourcing, curation, validation, quality checks, versioning, lineage, reuse, and ongoing improvement.
Design scalable evaluation approaches for generative AI and agentic systems, including task-level, workflow-level, trajectory-level, and runtime evaluation methods.
Partner with AI research, platform engineering, product, risk, governance, and business teams to embed evaluations into build, release, certification, monitoring, and recertification workflows.
Establish human evaluation and review protocols that produce reliable labels, reviewer guidance, adjudication processes, quality controls, and audit-ready evidence.
Measure and improve scorer accuracy, calibration, robustness, failure-mode coverage, and explainability across automated and human evaluation approaches.
Provide clear technical leadership, executive-ready communication, and mentorship to junior data scientists to help RBC scale trusted AI with speed, rigor, and control.
In this role, you will communicate and interact frequently with RBC partners and/or employees located across Canada and/or worldwide

What do you need to succeed?

Must Have

8+ years of experience in data science, applied machine learning, AI evaluation, ML quality, or a related technical field, including experience providing technical leadership and mentorship within a team.
Strong experience designing evaluation frameworks for ML, generative AI, or agentic AI systems, including metrics, datasets, benchmarks, rubrics, and quality measurement.
Practical experience with LLM evaluation methods such as LLM-as-judge, deterministic scoring, human evaluation, hallucination assessment, factuality assessment, safety evaluation, or model quality benchmarking.
Strong technical foundation in data science, statistics, machine learning, experimentation, data curation, Python, SQL, and modern AI/ML development practices.
Proven ability to translate governance, model risk, responsible AI, and business requirements into measurable controls, repeatable evaluation processes, and decision-ready evidence.
Strong communication and stakeholder management skills, with the ability to influence senior leaders across research, engineering, product, governance, risk, and business teams.

Nice to Have

Experience evaluating agentic AI systems, tool-calling workflows, multi-step reasoning, runtime traces, trajectory scoring, or workflow-level performance.
Experience in financial services, regulated AI, model risk management, responsible AI, enterprise governance, or audit-ready evidence processes.
Familiarity with tools and platforms such as MLflow, Langfuse, LangSmith, OpenTelemetry, Grafana, CI/CD pipelines, or comparable evaluation and observability tooling.
Publications, patents, open-source contributions, or industry work related to AI evaluation, ML quality, AI safety, applied research, or responsible AI.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work.

#TECHPJ

Job Skills

Big Data Analytics, Critical Thinking, Decision Making, Industry Knowledge, Machine Learning (ML), Results-Oriented, Software Engineering, Software Product Design

Additional Job Details

Address:

RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTO

City:

Toronto

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2026-07-13

Application Deadline:

2026-10-05

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.

About employer

More about this job

Responsibilities

You will lead the design and implementation of evaluation frameworks for AI models and agents to ensure quality, safety, and performance. This involves collaborating with cross-functional teams to embed these evaluations into the end-to-end AI development lifecycle.

Requirements

Candidates must have over 8 years of experience in data science or applied machine learning with a strong technical foundation in AI evaluation methodologies. Proven ability to translate governance and risk requirements into measurable controls and provide technical leadership is essential.

Skills

Data Science
Machine Learning
AI Evaluation
LLM Evaluation
Python
SQL
Statistics
Data Curation
Model Risk Management
Responsible AI
Stakeholder Management
Technical Leadership
Generative AI
Agentic AI
Experimentation
Governance

Benefits

Bonuses
Flexible benefits
Competitive compensation
Stock options

Visa sponsorship

Not detected in the job text

Keywords

Data Science
Machine Learning
AI Evaluation
Generative AI
Agentic AI
LLM-as-judge
Python
SQL
MLflow
Langfuse
LangSmith
OpenTelemetry
Grafana
CI/CD
Model Risk Management
Responsible AI
Governance
Data Curation
Statistics
Benchmarking
Human Evaluation
Hallucination Assessment
Factuality Assessment
Financial Services
Technical Leadership
Stakeholder Management
Experimentation
Observability
Model Quality
AI Safety

Report this job