Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 1 month ago
Quality Program Specialist
The Canada Life Assurance Company
ON
Based on audit findings, support ongoing continuous improvement by recommending changes to training and resource materials, quality program standards, and office procedures
Added 1 month ago
AE
AE - Sr Brand Ambassador (Sr Sales Associate)
American Eagle Outfitters
Regina, SK
- Part-time
You share the brand love! You're eager to introduce the AEO loyalty program and additional brand channels to guests.
Added 1 month ago
Licensed Practical Nurse
Winnipeg Regional Health Authority
Carman, MB
The Licensed Practical Nurse (LPN) applies the nursing process to support clients/residents/patients in achieving and maintaining their optimum level of health within a people‐centered care…
Added 1 month ago
JH
New Product Introduction Program Manager
Jetson Home
North Vancouver, BC
- $165,000 to $205,000 CAD / year
We’re looking for a New Product Introduction (NPI) Program Manager to lead the successful launch of new products across Jetson’s platform. This role sits at the center of Product,…
Added 1 month ago
S
assistant (e) gérant (e) de magasin - Blainville, Qc
Starbucks
Saint-Eustache, QC · Blainville, QC
- $52,600 to $63,050 CAD / year
…eligible partners in this role may participate in our bonus program, designed to recognize contributions and impact in addition to annual bean stock…
Added 1 month ago
E
Dietary Aide - Casual - Tendercare
Extendicare
Toronto, ON · Assist - Tendercare LTC (McNicoll Ave)
- Part-time
Successful completion and/or enrollment in a Food Service Worker Program meeting the requirements of the Ontario Long-Term Care Homes Act required. If enrolled, you must complete the…
Added 1 month ago
Financial Service Representative
Money Mart
London, ON
…or through our mobile app, we focus on delivering practical support, clear information, and service that helps people and business owners move forward with…
Added 1 month ago
Technician Ventilation
Evolution Mining Limited
Red Lake, ON
At Evolution, we support, develop and reward everyone who chooses to be a part of our bright future.
Added 1 month ago
Associate Technical Services Engineer II
MongoDB
Toronto, ON
This role is based in Toronto and follows a hybrid working model, with a minimum expectation of three days per week in the office
Added 1 month ago
SE
Used Parts & Salvage Analyst
SMS Equipment Inc.
Acheson, AB
- Full-time
SMS Equipment is looking for a Used Parts & Salvage Analyst to support our Remanufacturing operation in Acheson, AB. Reporting to the Parts Supervisor, Remanufacturing, this role is…
Added 1 month ago
EH
Management Trainee
Enterprise Holdings
Okotoks, AB
- Full-time
Must have 6 months cumulative experience or involvement in any of the following: · Must have a valid Canadian Class 5 driver's license with no more than two moving violations and/or at fault accidents within the last three years
Added 1 month ago
LD
Photo Lab Specialist
London Drugs Limited
Campbell River, BC
- $18.25 to $21.58 CAD / hour
- Other
Employee Family Assistance Program (Free confidential counseling and support)
Added 1 month ago
NS
Family Medicine - Barrington - Barrington Community Health Clinic
Nova Scotia Healthcare System
Yarmouth Indian Reserve No. 33, NS · Yarmouth, Nova Scotia
- Full-time
participate in quality improvement, practice evaluation, and other activities that support the delivery of safe, effective, patient-centered care
Added 1 month ago
NS
Family Medicine - Barrington Passage - Dr Kenny Yee Family Practice
Nova Scotia Healthcare System
Barrington Passage, NS
- Part-time
participate in quality improvement, practice evaluation, and other activities that support the delivery of safe, effective, patient-centered care
Added 1 month ago
NS
Family Medicine - Shelburne - Inpatient Care
Nova Scotia Healthcare System
Shelburne, NS
- Full-time
Join a family physician network team providing service to their in-patient program at Roseway Hospital.
Added 1 month ago
XC
Technicien(ne) en soutien aux produits // Product Support Technician
XNRGY Climate Systems
Longueuil, QC
- Full-time
Agir comme principal support technique pour les enjeux de fabrication et de service liés à la conception des produits.
Added 1 month ago
WT
Senior Associate, Treasury Cash & Settlements
Wealthsimple Technologies
Remote, Canada
- $69,000 to $87,000 CAD / year
- Full-time
- Remote
Support treasury operations during high-volume periods
Added 1 month ago
DC
Civil Engineering Graduate/Asset Management Analyst
Dillon Consulting Limited
Fredericton, NB · Saint John, NB · Moncton, NB
- Full-time
Support GIS and asset management software teams (e.g., Cityworks, Maximo, Lucity, Cartegraph) with data entry, validation, and system updates.
Added 1 month ago
DC
Civil Engineering Graduate/Asset Management Analyst
Dillon Consulting Limited
Toronto, ON · Hamilton, ON · Kingston, ON · Oakville, ON · North York, ON
- Full-time
Support GIS and asset management software teams (e.g., Cityworks, Maximo, Lucity, Cartegraph) with data entry, validation, and system updates.
Added 1 month ago
DC
Civil Engineering Graduate/Asset Management Analyst
Dillon Consulting Limited
Winnipeg, MB
- Full-time
Support GIS and asset management software teams (e.g., Cityworks, Maximo, Lucity, Cartegraph) with data entry, validation, and system updates.
Added 1 month ago
RB
Small Business Markets Recruitment & Networking Session- November 2026
Royal Bank of Canada
Toronto, ON
- Full-time
Completion of the Associate Account Manager training program, or have previous experience as a small business owner, or in similar field
Added 1 month ago
O&
Senior Cook, Events - Oliver & Bonacini
Oliver & Bonacini
Toronto, ON
- Full-time
Access to our Employee Assistance Program for confidential support
Added 1 month ago
MC
Sales Intern - On Premise
Molson Coors
Toronto, ON
- Internship
…Canadian Commercial team in Toronto within our Early Talent Program. Our Early Talent Program is Molson Coors’ undergraduate summer internship program, where students are exposed to the…
Added 1 month ago
CB
Full Time Production Associate
Cornerstone Building Brands
St. Thomas, ON
- Full-time
Willing to train, but must have a great attitude, strong work ethic, and reliable · Must be available to work two week shift rotation schedule (day shift- 6AM- 3:30PM; afternoon shift- 3:45PM-1:15 AM)
Added 1 month ago
R
Staff Data Scientist, AI Evaluations Platform
RBC
Montreal, QC
- Full-time
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

RBC

Staff Data Scientist, AI Evaluations Platform

Montreal, QC, Canada

Full-time

This date has passed. Check with the employer before applying.

Apply on rbc.wd3.myworkdayjobs.com About employer

Applications open in a new tab.

Job details

Job type: Full-time
Listed closing date: Oct 31, 2026
Posting language: English
Posted: Oct 9, 2026

Original job description

Job Description

What is the opportunity?

RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data Scientist, AI Evaluations, you will be a senior technical leader in the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation protocols, quality benchmarks, and measurement frameworks that help AI systems move from experimentation to production with evidence and control, while providing technical guidance and mentorship to other data scientists on the team.

What will you do?

Design and drive advanced model and agent evaluation methodologies, including evaluation datasets, rubrics, LLM-as-judge methods, deterministic scorers, human evaluation, and measurement frameworks, providing technical guidance to junior team members.
Define evaluation science standards that translate model risk, responsible AI, product quality, safety, and business expectations into measurable criteria, repeatable methods, and clear evidence.
Own the end-to-end lifecycle for evaluation datasets and scorecards, including sourcing, curation, validation, quality checks, versioning, lineage, reuse, and ongoing improvement.
Design scalable evaluation approaches for generative AI and agentic systems, including task-level, workflow-level, trajectory-level, and runtime evaluation methods.
Partner with AI research, platform engineering, product, risk, governance, and business teams to embed evaluations into build, release, certification, monitoring, and recertification workflows.
Establish human evaluation and review protocols that produce reliable labels, reviewer guidance, adjudication processes, quality controls, and audit-ready evidence.
Measure and improve scorer accuracy, calibration, robustness, failure-mode coverage, and explainability across automated and human evaluation approaches.
Provide clear technical leadership, executive-ready communication, and mentorship to junior data scientists to help RBC scale trusted AI with speed, rigor, and control.
In this role, you will communicate and interact frequently with RBC partners and/or employees located across Canada and/or worldwide

What do you need to succeed?

Must Have

8+ years of experience in data science, applied machine learning, AI evaluation, ML quality, or a related technical field, including experience providing technical leadership and mentorship within a team.
Strong experience designing evaluation frameworks for ML, generative AI, or agentic AI systems, including metrics, datasets, benchmarks, rubrics, and quality measurement.
Practical experience with LLM evaluation methods such as LLM-as-judge, deterministic scoring, human evaluation, hallucination assessment, factuality assessment, safety evaluation, or model quality benchmarking.
Strong technical foundation in data science, statistics, machine learning, experimentation, data curation, Python, SQL, and modern AI/ML development practices.
Proven ability to translate governance, model risk, responsible AI, and business requirements into measurable controls, repeatable evaluation processes, and decision-ready evidence.
Strong communication and stakeholder management skills, with the ability to influence senior leaders across research, engineering, product, governance, risk, and business teams.

Nice to Have

Experience evaluating agentic AI systems, tool-calling workflows, multi-step reasoning, runtime traces, trajectory scoring, or workflow-level performance.
Experience in financial services, regulated AI, model risk management, responsible AI, enterprise governance, or audit-ready evidence processes.
Familiarity with tools and platforms such as MLflow, Langfuse, LangSmith, OpenTelemetry, Grafana, CI/CD pipelines, or comparable evaluation and observability tooling.
Publications, patents, open-source contributions, or industry work related to AI evaluation, ML quality, AI safety, applied research, or responsible AI.
Ph.D. or Master’s degree in a quantitative or technical field, such as Applied Mathematics, Engineering, Computer Science or a related computational discipline.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work.

#TECHPJ

Job Skills

Big Data Analytics, Critical Thinking, Decision Making, Industry Knowledge, Machine Learning (ML), Results-Oriented, Software Engineering, Software Product Design

Additional Job Details

Address:

6666 RUE ST URBAIN, FLOOR 3:MONTRÉAL

City:

Montréal

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2026-10-09

Application Deadline:

2026-10-31

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.

Apply on rbc.wd3.myworkdayjobs.com About employer

More about this job

Responsibilities

You will lead the design and implementation of advanced evaluation methodologies for AI models and agents to ensure quality, safety, and performance. This role involves collaborating with cross-functional teams to embed these evaluation frameworks into the end-to-end AI development lifecycle.

Requirements

Candidates must have 8+ years of experience in data science or applied machine learning with a strong foundation in AI evaluation frameworks. A postgraduate degree in a quantitative field is preferred, along with proven ability to translate governance and business requirements into measurable technical controls.

Skills

Data Science
Machine Learning
AI Evaluation
LLM Evaluation
Python
SQL
Statistics
Model Risk Management
Generative AI
Agentic AI
Data Curation
Stakeholder Management
Technical Leadership
Responsible AI
Experimentation

Benefits

Bonuses
Flexible benefits
Competitive compensation
Stock
Training program

Visa sponsorship

Not detected in the job text

Keywords

Data Science
Machine Learning
AI Evaluation
Generative AI
Agentic AI
LLM-as-judge
Python
SQL
Model Risk Management
Responsible AI
MLflow
Langfuse
LangSmith
OpenTelemetry
Grafana
CI/CD
Data Curation
Statistics
Benchmarking
Governance
Observability
Technical Leadership
Financial Services
Model Quality
Factuality Assessment
Hallucination Assessment
Trajectory Scoring
Workflow-level Performance
Applied Mathematics
Computer Science

Report this job

Work requirements

Jobs in Canada