Find work in Canada.

486,266 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 58 mins ago
R
Senior Automation Specialist
REWORKIO
Remote, Canada
- $50,000 to $100,000 USD / year
- Full-time
- Remote
REWORKIO is the all-in-one platform for professionals and businesses to build, prove, and grow powered by AI . We connect businesses heavily reliant on manual processes with verified AI and…
Added 1 hour ago
MC
Solutions Architect – AWS Node.js Digital Banking (35654)
Myticas Consulting
Toronto, ON
- Contract
…with developers, technical leads, product stakeholders, and platform teams to design and deliver scalable, resilient cloud-native…
Added 1 hour ago
MC
Manager – Banking Cloud & Platform Engineering (35857)
Myticas Consulting
Toronto, ON
- Full-time
This role is ideal for someone who combines banking industry knowledge, cloud/platform engineering expertise, consulting experience, and strong program leadership skills. The successful…
Added 2 hours ago
SS
Gestionnaire mondial du centre de services/Manager Service Desk
SITA Switzerland Sarl
Montreal, QC
- Full-time
…standards through ServiceNow, trusted service and configuration data, common escalation paths, modern support capabilities and measurable customer…
Added 3 hours ago
X
Tech Lead - Fullstack
Xsolla
Canada
- Full-time
We are looking for a Senior Software Engineer (Full-Stack) who is architecturally strong, quality-driven, and highly collaborative to join our Engineering team. The best candidate will be…
Added 3 hours ago
MA
Sales Development Representative
Mosaic AI
Toronto, ON
- Full-time
Mosaic AI is the only enterprise AI platform built for technical support in highly configurable, multi-product companies. We unify the customer, product, and support context scattered…
Added 3 hours ago
TA
Senior Machine Learning Engineer (GCP)
Tiger Analytics
Canada
- Full-time
…Learning Engineer with hands-on experience in Google Cloud Platform (GCP) and Vertex AI to design, build, and deploy scalable ML solutions. You will play a key role in operationalizing…
Added 20 hours ago
K
Assistant Store Manager - West Edmonton Mall
Knix
AB · Edmonton, AB
- $55,000 to $60,000 CAD / year
- Full-time
Health - Health benefits program that starts on your first day, and access to a mental health & wellness platform that offers therapy and coaching sessions
Added 21 hours ago
Director, Performance Marketing
Brex
Vancouver, BC
Brex is the intelligent finance platform that enables companies to spend smarter and move faster in more than 200 markets. By combining global corporate cards and banking with intuitive…
Added 1 day ago
TL
CTO (Chief Technology Officer)
Total Life, Inc.
Remote, Canada
- Full-time
- Remote
Integrate marketing technology. You will connect the platform to our growth engine, including attribution, CRM, messaging, conversion funnels and paid acquisition data, so that marketing…
Added 1 day ago
E
Principal Software Engineer
EngRadar
Kitamaat 2, BC
- Full-time
This is a senior, hands-on role for an engineer who wants influence beyond a single product team. You’ll work in a highly connected environment, on a small team that supports a large…
Added 1 day ago
SM
RQ00762 – Systems Analyst – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Systems Analyst with 5–8 years of experience in systems analysis, functional consulting, or a similar IT-focused role. The ideal candidate will have hands-on…
Added 1 day ago
SM
RQ11657 – Software Developer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Software Developer / Technical Lead with extensive experience in enterprise application development, Microsoft Dynamics 365, Power Platform, Azure, Dataverse, Java,…
Added 1 day ago
SM
RQ11658 – Software Developer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Software Developer with strong technical leadership and hands-on experience in enterprise application development, Microsoft Dynamics 365, Power Platform, Azure,…
Added 1 day ago
RB
Senior Security Specialist - Cloud Red Team(Global Security)
Royal Bank of Canada
Toronto, ON
- Full-time
Work as part of the team assessing and improving the security of our public cloud environments (Amazon Web Services, Microsoft Azure, and Google Cloud Platform).
Added 1 day ago
Senior HR Business Partner
Behavox
Montreal, QC
From managing enterprise risk and compliance to maximizing revenue and value, our data operating platform presents a widespread opportunity to build multilingual, AI/ML-based solutions that…
Added 1 day ago
Senior HR Business Partner
Behavox
Toronto, ON
From managing enterprise risk and compliance to maximizing revenue and value, our data operating platform presents a widespread opportunity to build multilingual, AI/ML-based solutions that…
Added 1 day ago
N
Senior Product Manager
nesto
Montreal, QC
- Full-time
We're looking for a Senior Product Manager to lead 0→1 product development on one of nesto's most strategic bets. In this role, you'll own the vision, roadmap, and execution for a new…
Added 1 day ago
NB
Senior AI Data Scientist
National Bank of Canada
Montreal, QC
- Full-time
A career as a Senior AI Data scientist in the
Added 1 day ago
Senior Data Engineer, Data Platform & Operations
Talent Acquisition Team at Westland Insurance. Text reply only.
Surrey, BC
We're searching for a Senior Data Engineer, Data Platform & Operations. Are you searching for new possibilities?
Added 1 day ago
ST
Senior Data Engineer
Sensor Tower
Remote, Canada
- Full-time
- Remote
As Sensor Tower continues to grow as a global company, we are looking for a Senior Data Engineer to build amazing products together. We have a wonderful team of more than a hundred…
Added 1 day ago
K
Senior Customer Success Manager, Enterprise
Klue
Remote, Canada
- $90,000 to $130,000 CAD / year
- Full-time
- Remote
As a Senior Customer Success Manager, Enterprise at Klue, you own the full customer relationship, from onboarding through renewal and expansion. You're the connective tissue: keeping every…
Added 1 day ago
A
Sr. Manager, CRM Functional Lead / Architect
Avanade
Ottawa, ON
- Full-time
The CRM Functional Lead / Architect is a senior, client-facing leader who translates complex business needs into scalable Microsoft Dynamics 365 Customer Engagement and Power Platform…
Added 1 day ago
A
Senior AEM Architect
Accenture
Calgary, AB · Ottawa, ON · Toronto, ON · Montreal, QC
- Full-time
We are looking for a highly effective Senior AEM Architect to join our team. This person will utilize best practices and methodologies to design and implement the best solution for our…
Added 1 day ago
SM
RQ11657 – Software Developer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
We are seeking a Senior Software Developer / Technical Lead with extensive experience in enterprise application development, Microsoft Dynamics 365, Power Platform, Azure, Dataverse, Java,…

Royal Bank of Canada

Staff Data Scientist, AI Evaluations Platform

Montreal, QC, H2S 3H1, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Oct 31, 2026
Posting language: English
Posted: Oct 9, 2026

Original job description

Job Description

What is the opportunity?

RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data Scientist, AI Evaluations, you will be a senior technical leader in the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation protocols, quality benchmarks, and measurement frameworks that help AI systems move from experimentation to production with evidence and control, while providing technical guidance and mentorship to other data scientists on the team.

What will you do?

Design and drive advanced model and agent evaluation methodologies, including evaluation datasets, rubrics, LLM-as-judge methods, deterministic scorers, human evaluation, and measurement frameworks, providing technical guidance to junior team members.
Define evaluation science standards that translate model risk, responsible AI, product quality, safety, and business expectations into measurable criteria, repeatable methods, and clear evidence.
Own the end-to-end lifecycle for evaluation datasets and scorecards, including sourcing, curation, validation, quality checks, versioning, lineage, reuse, and ongoing improvement.
Design scalable evaluation approaches for generative AI and agentic systems, including task-level, workflow-level, trajectory-level, and runtime evaluation methods.
Partner with AI research, platform engineering, product, risk, governance, and business teams to embed evaluations into build, release, certification, monitoring, and recertification workflows.
Establish human evaluation and review protocols that produce reliable labels, reviewer guidance, adjudication processes, quality controls, and audit-ready evidence.
Measure and improve scorer accuracy, calibration, robustness, failure-mode coverage, and explainability across automated and human evaluation approaches.
Provide clear technical leadership, executive-ready communication, and mentorship to junior data scientists to help RBC scale trusted AI with speed, rigor, and control.
In this role, you will communicate and interact frequently with RBC partners and/or employees located across Canada and/or worldwide

What do you need to succeed?

Must Have

8+ years of experience in data science, applied machine learning, AI evaluation, ML quality, or a related technical field, including experience providing technical leadership and mentorship within a team.
Strong experience designing evaluation frameworks for ML, generative AI, or agentic AI systems, including metrics, datasets, benchmarks, rubrics, and quality measurement.
Practical experience with LLM evaluation methods such as LLM-as-judge, deterministic scoring, human evaluation, hallucination assessment, factuality assessment, safety evaluation, or model quality benchmarking.
Strong technical foundation in data science, statistics, machine learning, experimentation, data curation, Python, SQL, and modern AI/ML development practices.
Proven ability to translate governance, model risk, responsible AI, and business requirements into measurable controls, repeatable evaluation processes, and decision-ready evidence.
Strong communication and stakeholder management skills, with the ability to influence senior leaders across research, engineering, product, governance, risk, and business teams.

Nice to Have

Experience evaluating agentic AI systems, tool-calling workflows, multi-step reasoning, runtime traces, trajectory scoring, or workflow-level performance.
Experience in financial services, regulated AI, model risk management, responsible AI, enterprise governance, or audit-ready evidence processes.
Familiarity with tools and platforms such as MLflow, Langfuse, LangSmith, OpenTelemetry, Grafana, CI/CD pipelines, or comparable evaluation and observability tooling.
Publications, patents, open-source contributions, or industry work related to AI evaluation, ML quality, AI safety, applied research, or responsible AI.
Ph.D. or Master’s degree in a quantitative or technical field, such as Applied Mathematics, Engineering, Computer Science or a related computational discipline.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work.

#TECHPJ

Job Skills

Big Data Analytics, Critical Thinking, Decision Making, Industry Knowledge, Machine Learning (ML), Results-Oriented, Software Engineering, Software Product Design

Additional Job Details

Address:

6666 RUE ST URBAIN, FLOOR 3:MONTRÉAL

City:

Montréal

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2026-10-09

Application Deadline:

2026-10-31

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.

Apply About employer

More about this job

Responsibilities

You will lead the design and implementation of advanced evaluation frameworks for AI models and agents to ensure quality, safety, and performance. This role involves collaborating with cross-functional teams to embed these evaluation standards into the end-to-end AI lifecycle.

Requirements

Candidates must have over 8 years of experience in data science or applied machine learning with a strong foundation in AI evaluation methodologies. Proficiency in Python, SQL, and experience translating governance requirements into measurable technical controls are essential.

Skills

Data science
Machine learning
AI evaluation
LLM evaluation
Python
SQL
Statistics
Model risk management
Responsible AI
Stakeholder management
Technical leadership
Mentorship
Generative AI
Agentic AI
Data curation
Experimentation

Benefits

Comprehensive Total Rewards Program
Bonuses
Flexible benefits
Competitive compensation
Stock options
Professional development coaching

Visa sponsorship

Not detected in the job text

Keywords

Data Science
Artificial Intelligence
Machine Learning
LLM-as-judge
Generative AI
Agentic AI
Model Risk Management
Responsible AI
Python
SQL
MLflow
Langfuse
LangSmith
OpenTelemetry
Grafana
CI/CD
Data Curation
Statistics
Governance
Model Quality
Benchmarking
Human Evaluation
Technical Leadership
Financial Services
Observability
Factuality Assessment
Hallucination Assessment
Trajectory Scoring
Workflow Evaluation
Enterprise Governance

Report this job