Find work in Canada.

349,819 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 26 mins ago
ES
Data Technology Consultant - Data & AI Modernization
EPAM Systems
Canada
- Full-time
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities.…
Added 26 mins ago
MC
Principal Banking Cloud Architect | Client Partner | Technology Consulting (35568)
Myticas Consulting
Toronto, ON
- Full-time
Lead executive discussions surrounding cloud transformation, platform engineering, enterprise architecture, AI, data modernization, cybersecurity, and application modernization.
Added 26 mins ago
MC
Solutions Architect – AWS Node.js Digital Banking (35654)
Myticas Consulting
Toronto, ON
- Contract
…for someone who can bridge solution architecture and software engineering. The successful candidate will work closely with developers, technical leads, product stakeholders, and platform…
Added 26 mins ago
MC
Technical Consultant III (35732)
Myticas Consulting
Toronto, ON
- Full-time
This is a hands-on senior technical leadership role combining software engineering, solution design, product configuration, APIs and integrations, data, deployment, troubleshooting,…
Added 26 mins ago
MC
Manager – Banking Cloud & Platform Engineering (35857)
Myticas Consulting
Toronto, ON
- Full-time
Manager – Banking Cloud & Platform Engineering
Added 26 mins ago
SK
Associate Director, Platform Engineering
Sokoni Kwetu
London, ON
- Full-time
…highly interdisciplinary teams where biology, computation, and engineering come together to solve complex problems that have not been solved before. Our state-of-the-art wet and dry labs in…
Added 26 mins ago
MC
Google Cloud Data & Software Solutions Manager (35087)
Myticas Consulting
Toronto, ON
- Full-time
Provide deep technical leadership across Google Cloud Platform (GCP) solutions, architecture, and delivery engagements
Added 26 mins ago
R
VP of Marketing Operations
Revun
Vaughan, ON
- Internship
Revun is a technology company developing a connected software platform for property operations and service-based businesses.
Added 3 hours ago
L
Principal Engineer - Retail Systems
lululemon
Vancouver, BC
- Full-time
You will collaborate closely with architects, product leaders, engineering teams, business stakeholders, and senior technology leaders to translate business strategy into durable technical…
Added 4 hours ago
MS
Senior Software Quality Engineer
Myant Shared Service Corp.
Mississauga, ON
- Full-time
This is not a traditional manual QA or script-maintenance role. We are looking for an engineering-minded quality leader who thinks systematically about correctness, regression prevention,…
Added 5 hours ago
ES
Senior Full-Stack Java Developer
EPAM Systems
Canada
- Full-time
Join EPAM's engineering team as a Senior Full-Stack Java Developer and take ownership of maintaining and modernizing a portfolio of enterprise-grade Gateway applications. You'll work in a…
Added 5 hours ago
M
Critical Environment Technician
Microsoft
Toronto, ON
- Full-time
…including Bing, Office 365, Xbox, OneDrive, and the Microsoft Azure platform. As a group, CO+I is focused on the personal and professional development of all employees and offers training…
Added 6 hours ago
S
Senior Transport Economist
SYSTRA
Montreal, QC
- Full-time
SYSTRA Canada is part of the SYSTRA group, an international consulting and engineering group, a world leader in the design of transport infrastructures. SYSTRA Canada is an engineering and…
Added 6 hours ago
ES
Senior Business Analyst
EPAM Systems
Toronto, ON
- Full-time
As an EPAM Systems, Inc. (NYSE: EPAM) company, a leading global provider of digital platform engineering and development services, we deliver advanced financial services solutions by…
Added 6 hours ago
SM
RQ11475 - Software Developer - CRM - Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Software Developer – CRM with strong hands-on experience in Microsoft Dynamics 365, Power Platform, Azure, and Dataverse, along with proven Technical Lead…
Added 6 hours ago
SM
RQ11475 - Software Developer - CRM - Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Software Developer – CRM with strong hands-on experience in Microsoft Dynamics 365, Power Platform, Azure, and Dataverse, along with proven Technical Lead…
Added 7 hours ago
WG
Mill Operations Supervisor
Wesdome Gold Mines Ltd
Wawa, ON
- $111,350 to $144,100 CAD / year
- Full-time
…Company’s primary goal is to responsibly leverage its operating platform and high-quality brownfield and greenfield exploration pipeline to build a growing value-driven gold…
Added 7 hours ago
B
Staff Software Engineer - Full-Stack, Solution Architecture
Blazesoft
Concord, ON
- Full-time
We are building an AI-centric engineering platform where brands operate as self-reliant, B2B-style customers. You will own product features end-to-end across the full stack - leveraging AI…
Added 9 hours ago
R
Senior Principal DSX Data Scientist
Roche
Mississauga, ON · Canada Pharma Campus
- Full-time
You serve as a senior technical advisor to platform owners, programming and statistical leadership, and governance teams on complex topics involving infrastructure, automation, and…
Added 10 hours ago
R
Director Data Center Engineering
RBC
Toronto, ON
- Full-time
The role is for Global Data Center engineering lead managing a high performing team of senior engineers responsible for all the networking technology running in the RBC’s global data…
Added 10 hours ago
W
Sr. Software Development Engineer / Principal, Software Development Engineer
Workday
Vancouver, BC · Canada, BC, Vancouver
- Full-time
As either a Senior Software Development Engineer or a Principal Software Development Engineer on the AI Model Serving team, you will be a technical leader who helps shape the vision and…
Added 11 hours ago
C
Sr. Consultant, Solution Design and Strategy-Payments
CIBC
Toronto, ON
- Full-time
Enterprise Wires Modernization (EWM) is a multi-year program that will implement a new modernized wire payment platform in several phases and workstreams. As Solution Consultant for EWM,…
Added 12 hours ago
Software Development Manager, Rendering Foundations
Amazon
Vancouver, BC
- Deliver the developer experience around the authoring model, including IDE and build integrations, linting, documentation, migration tooling, and a compatibility policy that keeps authors…
Added 12 hours ago
ES
Senior Java Engineer
EPAM Systems
Toronto, ON
- Full-time
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities.…
Added 12 hours ago
IH
Senior Platform Database RUN Engineer
InVita Healthcare Technologies
ON · Ontario, Canada
- Full-time
Job Title: Senior Platform Database RUN Engineer

RBC

Staff Data Scientist, AI Evaluations Platform

Montreal, QC, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Oct 31, 2026
Posting language: English
Posted: Oct 9, 2026

Original job description

Job Description

What is the opportunity?

RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data Scientist, AI Evaluations, you will be a senior technical leader in the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation protocols, quality benchmarks, and measurement frameworks that help AI systems move from experimentation to production with evidence and control, while providing technical guidance and mentorship to other data scientists on the team.

What will you do?

Design and drive advanced model and agent evaluation methodologies, including evaluation datasets, rubrics, LLM-as-judge methods, deterministic scorers, human evaluation, and measurement frameworks, providing technical guidance to junior team members.
Define evaluation science standards that translate model risk, responsible AI, product quality, safety, and business expectations into measurable criteria, repeatable methods, and clear evidence.
Own the end-to-end lifecycle for evaluation datasets and scorecards, including sourcing, curation, validation, quality checks, versioning, lineage, reuse, and ongoing improvement.
Design scalable evaluation approaches for generative AI and agentic systems, including task-level, workflow-level, trajectory-level, and runtime evaluation methods.
Partner with AI research, platform engineering, product, risk, governance, and business teams to embed evaluations into build, release, certification, monitoring, and recertification workflows.
Establish human evaluation and review protocols that produce reliable labels, reviewer guidance, adjudication processes, quality controls, and audit-ready evidence.
Measure and improve scorer accuracy, calibration, robustness, failure-mode coverage, and explainability across automated and human evaluation approaches.
Provide clear technical leadership, executive-ready communication, and mentorship to junior data scientists to help RBC scale trusted AI with speed, rigor, and control.
In this role, you will communicate and interact frequently with RBC partners and/or employees located across Canada and/or worldwide

What do you need to succeed?

Must Have

8+ years of experience in data science, applied machine learning, AI evaluation, ML quality, or a related technical field, including experience providing technical leadership and mentorship within a team.
Strong experience designing evaluation frameworks for ML, generative AI, or agentic AI systems, including metrics, datasets, benchmarks, rubrics, and quality measurement.
Practical experience with LLM evaluation methods such as LLM-as-judge, deterministic scoring, human evaluation, hallucination assessment, factuality assessment, safety evaluation, or model quality benchmarking.
Strong technical foundation in data science, statistics, machine learning, experimentation, data curation, Python, SQL, and modern AI/ML development practices.
Proven ability to translate governance, model risk, responsible AI, and business requirements into measurable controls, repeatable evaluation processes, and decision-ready evidence.
Strong communication and stakeholder management skills, with the ability to influence senior leaders across research, engineering, product, governance, risk, and business teams.

Nice to Have

Experience evaluating agentic AI systems, tool-calling workflows, multi-step reasoning, runtime traces, trajectory scoring, or workflow-level performance.
Experience in financial services, regulated AI, model risk management, responsible AI, enterprise governance, or audit-ready evidence processes.
Familiarity with tools and platforms such as MLflow, Langfuse, LangSmith, OpenTelemetry, Grafana, CI/CD pipelines, or comparable evaluation and observability tooling.
Publications, patents, open-source contributions, or industry work related to AI evaluation, ML quality, AI safety, applied research, or responsible AI.
Ph.D. or Master’s degree in a quantitative or technical field, such as Applied Mathematics, Engineering, Computer Science or a related computational discipline.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work.

#TECHPJ

Job Skills

Big Data Analytics, Critical Thinking, Decision Making, Industry Knowledge, Machine Learning (ML), Results-Oriented, Software Engineering, Software Product Design

Additional Job Details

Address:

6666 RUE ST URBAIN, FLOOR 3:MONTRÉAL

City:

Montréal

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2026-10-09

Application Deadline:

2026-10-31

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.

Apply About employer

More about this job

Responsibilities

You will lead the design and implementation of advanced evaluation methodologies for AI models and agents to ensure quality, safety, and performance. This role involves collaborating with cross-functional teams to embed these evaluation frameworks into the end-to-end AI development lifecycle.

Requirements

Candidates must have 8+ years of experience in data science or applied machine learning with a strong foundation in AI evaluation frameworks. A postgraduate degree in a quantitative field is preferred, along with proven ability to translate governance and business requirements into measurable technical controls.

Skills

Data Science
Machine Learning
AI Evaluation
LLM Evaluation
Python
SQL
Statistics
Model Risk Management
Generative AI
Agentic AI
Data Curation
Stakeholder Management
Technical Leadership
Responsible AI
Experimentation

Benefits

Bonuses
Flexible benefits
Competitive compensation
Stock
Training program

Visa sponsorship

Not detected in the job text

Keywords

Data Science
Machine Learning
AI Evaluation
Generative AI
Agentic AI
LLM-as-judge
Python
SQL
Model Risk Management
Responsible AI
MLflow
Langfuse
LangSmith
OpenTelemetry
Grafana
CI/CD
Data Curation
Statistics
Benchmarking
Governance
Observability
Technical Leadership
Financial Services
Model Quality
Factuality Assessment
Hallucination Assessment
Trajectory Scoring
Workflow-level Performance
Applied Mathematics
Computer Science

Report this job