Jobs in Canada

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 22 mins ago
MD
Transportation Liaison, Architectural Historian - State Program Administrator Principal/Coordinator
Minnesota Direct Care and Treatment
Saint-Paul, NB · St.-Paul, NB
- Full-time
Work Shift/Work Hours: Day Shift
Added 22 mins ago
M
Senior Java Full Stack Developer
Miratech
Toronto, ON
- Full-time
Working Model: This is a hybrid role requiring 2 days per week in a downtown Toronto office
Added 22 mins ago
C
Operational Support Specialist
Compucom
Markham, ON
- Full-time
The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject…
Added 52 mins ago
IT
Sales Associate
IRIS The Visual Group
Fredericton, NB
- Full-time
Don't look further, IRIS is what you are looking for!
Added 1 hour ago
NA
Post-CCT Clinical Fellow- Major Trauma and Orthopaedics
NHS Ayrshire & Arran
Saskatoon, SK
- Full-time
Added 1 hour ago
NS
Post-CCT Clinical Fellow- Major Trauma and Orthopaedics
NHS Scotland
Saskatoon, SK
- Contract
Added 1 hour ago
GO
Issues Management Analyst
Government of Yukon
Whitehorse, YT
- Full-time
Please submit your resume clearly demonstrating how you meet the qualifications below. Selections for further consideration will be based solely on the information you provide in your…
Added 1 hour ago
AC
Co-op Accountant, Assurance and Accounting
ACCA Careers
Dieppe, NB
- Temporary
For further information, and to apply, please visit our website via the “Apply” button below.
Added 1 hour ago
BU
Associate Banker
BMO U.S.
Toronto, ON
- Full-time
Collaborates with BMO partners to identify referral opportunities that further grow the customer’s relationship with BMO beyond personal banking.
Added 2 hours ago
TO
Pharmacist
The Ottawa Hospital
Ottawa, ON
- Full-time
For information purposes only - The Hospital reserves the right to change.
Added 2 hours ago
TO
Diagnostic Imaging Technologist 2 - Specialty
The Ottawa Hospital
Ottawa, ON
- Part-time
For information purposes only - The Hospital reserves the right to change.
Added 2 hours ago
TO
Registered Practical Nurse
The Ottawa Hospital
Ottawa, ON
- Part-time
Days, evening, and nights, including weekends, 12 hour shifts (07:15-19:15, 19:15-07:15)
Added 2 hours ago
TO
Registered Practical Nurse
The Ottawa Hospital
Ottawa, ON
- Part-time
Days and nights, including weekends, 12 hour shifts (07:15-19:15, 19:15-07:15)
Added 2 hours ago
TO
Pharmacist
The Ottawa Hospital
Ottawa, ON
- Full-time
For information purposes only - The Hospital reserves the right to change.
Added 2 hours ago
WA
Subject Matter Experts: ML Model Evaluation (PhD)
Weekday AI
Remote, Canada
- Full-time
- Remote
…models perform effectively and where their outputs require further…
Added 2 hours ago
GO
Major Projects Manager
Government of Yukon
Whitehorse, YT
- Full-time
…asset qualifications listed below. Note that selection for further consideration is based solely on the information you provide in your…
Added 3 hours ago
AC
Manager, ease Cloud Accounting Services
ACCA Careers
Calgary, AB
- Full-time
For further information, and to apply, please visit our website via the “Apply” button below.
Added 4 hours ago
HM
Vascular Surgery
Health Match BC
Kamloops, BC
- Part-time
…anticipated in early 2027, providing outstanding opportunities to further expand advanced endovascular and hybrid vascular procedures in a modern, purpose-built…
Added 5 hours ago
Instructor - Psychiatric Nursing
Bow Valley College
Calgary, AB
Police Information Check including a vulnerable sector
Added 5 hours ago
HM
Neurology
Health Match BC
Kamloops, BC
- Full-time
…EEG lab provides both inpatient and outpatient EEG services. Further outpatient clinic expansion is underway, with plans to add a rapid access neurology clinic as well as further supports…
Added 5 hours ago
HM
Physical Medicine and Rehabilitation
Health Match BC
Kamloops, BC
- Full-time
The successful candidate must have a strong interest in and the ability to work in all areas of physical medicine and rehabilitation practice
Added 5 hours ago
HM
Neurology
Health Match BC
Kamloops, BC
- Full-time
…EEG lab provides both inpatient and outpatient EEG services. Further outpatient clinic expansion is underway, with plans to add a rapid access neurology clinic as well as further supports…
Added 5 hours ago
HM
Physical Medicine and Rehabilitation
Health Match BC
Kamloops, BC
- Full-time
The successful candidate must have a strong interest in and the ability to work in all areas of physical medicine and rehabilitation practice
Added 5 hours ago
HM
Neurology
Health Match BC
Kamloops, BC
- Full-time
…with plans to add a rapid access neurology clinic as well as further supports for subspecialty neurology…
Added 5 hours ago
HM
Family Practitioner/General Practitioner
Health Match BC
Kamloops, BC
- Full-time

Weekday AI

Subject Matter Experts: ML Model Evaluation (PhD)

Remote, Canada

Remote

Pay : $150 / hr · Full-time

Apply on jobs.workable.com About employer

Applications open in a new tab.

Job details

Pay: Pay : $150 / hr
Job type: Full-time
Workplace: Remote
Remote eligibility: Canada listed. Check the posting for province restrictions.
Posting language: English
Posted: Nov 13, 2026

Original job description

This role is for one of Weekday’s clients

Engagement Type: Independent Contractor Work Arrangement: Fully Remote Estimated Commitment: Approximately 5 Hours Schedule: Flexible, Asynchronous Payment Frequency: Weekly, based on services rendered

Eligibility:

Applicants must be from any of these geographies : US, UK, Canada, the EU, Norway, Switzerland and Iceland.
Should have a finished / running paper in any of these topics : NeurIPS, ICML, ICLR, COLM or RLC
We are unable to support H1-B or STEM OPT candidates at this time.

Note:

Pay : $150 / hr
This requirement is super-urgent & would be awesome if you can start on the project within Friday EOD.

Role Overview

We are seeking highly qualified Subject Matter Experts with PhD-level academic or professional expertise across specialised research and professional domains to participate in a paid Machine Learning (ML) Model Evaluation project.

The project focuses on assessing the quality, accuracy, and reliability of AI-generated responses to complex research prompts and domain-specific questions. Your evaluations will help identify where current machine learning models perform effectively and where their outputs require further refinement.

This opportunity is suited to experienced researchers, academics, data analysts, technical writers, and domain specialists who can critically assess complex information, identify factual inaccuracies, and provide structured, evidence-based feedback.

Key Responsibilities

Review machine learning model outputs generated in response to a range of research-focused and domain-specific prompts.

Evaluate AI-generated responses for factual accuracy, relevance, completeness, and overall quality.

Assess the technical validity and reliability of information presented in model-generated responses.

Use a structured rating system to evaluate and score responses consistently.

Provide concise, clear, and well-reasoned written justifications supporting evaluation scores.

Identify factual errors, gaps in reasoning, irrelevant information, and areas requiring improvement.

Complete approximately five hours of independent evaluation work asynchronously.

Maintain consistency and attention to detail throughout the evaluation process.

Required Qualifications and Skills

PhD or equivalent advanced subject matter expertise in a relevant academic, technical, or professional discipline.

Strong academic or professional background in a specialised domain, with the ability to assess complex information critically.

Excellent analytical, research, and critical-thinking skills.

Ability to evaluate technical content, research findings, and domain-specific information for factual correctness and relevance.

Strong written communication skills, particularly in providing clear and structured evaluation justifications.

High attention to detail and the ability to identify subtle inaccuracies, inconsistencies, and gaps in AI-generated responses.

Ability to work independently and complete approximately five hours of asynchronous evaluation tasks.

Suitable Candidate Profiles

Professionals from the following backgrounds are encouraged to apply:

Academic researchers and university faculty
PhD scholars and doctoral-level subject matter experts
Data analysts and research analysts
Technical writers and research professionals
Domain specialists with experience evaluating technical or research-focused content

Engagement and Payment Terms

Contract Type: Independent contractor engagement.
Work Arrangement: Fully remote, with flexible working hours.
Project Duration: Approximately five hours of evaluation work.
Payment: Payments are processed weekly based on services rendered.
Project Continuity: The engagement may be extended, shortened, or concluded early depending on project requirements and individual performance.
Confidentiality: Participation will not require access to confidential or proprietary information belonging to any current or former employer, client, or academic institution.
Work Authorisation: H-1B and STEM OPT candidates cannot be supported for this opportunity.

Interview and Evaluation Expectations

During the interview process, candidates may be assessed on their review practices, critical thinking, and ability to improve the quality of their evaluations. Responses should address the following three habits:

Exchanging unfinished review notes with another reviewer.

Maintaining a separate log of opinions or assessments that have changed during the review process.

Using review notes and feedback to update personal reading lists.

Ideal Candidate Profile

The ideal candidate combines deep subject matter expertise with strong research judgement and analytical precision. They should be comfortable reviewing complex AI-generated content, distinguishing accurate information from flawed reasoning, and communicating their assessments through clear, structured feedback.

Apply on jobs.workable.com About employer

More about this job

Responsibilities

Review and evaluate AI-generated responses for factual accuracy, relevance, and technical validity using a structured rating system. Provide clear, evidence-based written justifications to identify gaps in reasoning and areas for model improvement.

Requirements

Candidates must hold a PhD or equivalent advanced subject matter expertise in a relevant academic or professional discipline. Applicants are required to have a finished or running paper in top-tier AI conferences such as NeurIPS, ICML, ICLR, COLM, or RLC.

Skills

Machine Learning
Model Evaluation
Research
Data Analysis
Technical Writing
Critical Thinking
Analytical Skills
AI Assessment
Domain Expertise
Quality Assurance

Remote locations

United States
United Kingdom
Canada
European Union
Norway
Switzerland
Iceland

Remote locations (standardized)

Canada
Iceland
Norway
Switzerland
United Kingdom
United States

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
AI Model Evaluation
PhD
NeurIPS
ICML
ICLR
COLM
RLC
Data Analysis
Research
Technical Writing
Independent Contractor
Remote Work
Artificial Intelligence
Domain Expertise
Quality Assessment
Academic Research

Report this job

Work requirements

Jobs in Canada