Jobs in Canada

25+ jobs

Save this search

Added 3 days ago
Research Assistant 2
McGill University
Montreal, QC
Full-time
…peer-reviewed publications. Based on intellectual contribution, the research assistant will be given the opportunity to be an author on any publication that will derive from the work…
Added 5 days ago
Research Assistant /Technician 2
University of British Columbia
Vancouver, BC · UBCV | Djavad Mowafaghian Centre for Brain Health (CBH)
$4,597.8 to $5,469.59 CAD / month
Full-time
Non Union Salaried - Research Assistant /Technician 2
Added 5 days ago
Research Assistant /Technician 2
The University of British Columbia
Vancouver, BC
$4,597.8 to $5,469.59 CAD / month
Full-time
Non Union Salaried - Research Assistant /Technician 2
Added 6 days ago
Research Assistant 2
McGill University
Montreal, QC
Full-time
The Department of Equity, Ethics and Policy is seeking a highly motivated Research Assistant 2 to support research on the impacts of heat exposure and health among school-aged children in…
Added 2 months ago
Canada Research Chair Tier 2 Position - Tenure Track Assistant Professor
University of Saskatchewan
Saskatoon, Saskatchewan
Full-time
The CRC Tier II will lead an innovative research program in the College of Dentistry. Evidence suggests that the oral microbiome may hold valuable information for better understanding…
Added 9 days ago
Research Assistant 2
Provincial Health Services Authority
Vancouver, BC
Full-time
…related laboratory experience and familiarity with specific research programs and methodologies of the hiring laboratory. They work under supervision and perform experiments by following…
Added 4 months ago
Research Assistant 2, Innate Lymphoid Cell and NK Cell Engineering, Crome Lab, Terry Fox Lab - BC Cancer Vancouver
Provincial Health Services Authority
Vancouver, British Columbia
Full-time
Research Assistant 2, Innate Lymphoid Cell and NK Cell Engineering, Crome Lab, Terry Fox Lab
Added 10 days ago
Research Assistant 2
McGill University
Montreal, QC
Full-time
The Research Assistant 2 will play a pivotal role in shaping and supporting the preclinical MRI and PET research platforms at the McConnell Brain Imaging Centre (BIC). This will include…
Added 11 days ago
Research Assistant 2
McGill University
MacdonaldStewart Bld
Part-time
Position Summary: Research Assistant and 3D printing facility assistant for additive manufacturing of biomaterials and waste-derived materials, support users of the 3D printing facility and…
Added 11 days ago
Research Assistant 2
McGill University
Montreal, QC
Part-time
The Department of Global and Public Health at McGill University is seeking a Research Assistant 2 to support a project evaluating the integration of a trauma-informed approach within the…
Added 12 days ago
Research Assistant
University of British Columbia
Langley (District), BC · FH | Langley Memorial Hospital (LMH)
$4,359.73 to $4,781.54 CAD / month
Part-time
Non Union Salaried - Research Assistant /Technician 1
Added 4 months ago
Psychologist Assistant, Forensic Psychiatric Kamloops Regional Clinic - Kamloops, BC
Provincial Health Services Authority
Kamloops, British Columbia
Part-time
Participate in research activities as requested by methods such as conducting literature reviews, assisting with the preparation and submission of research applications to Research Ethics…
Added 3 hours ago
Clinical Research Coordinator and Genetic Assistant
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
Full-time
Do you want to work for a world-renowned research institute that pushes the boundaries of biomedical science and health research? Right here in Montreal! At the Research Institute of the…
Added 6 hours ago
Paralegal / Legal Assistant II
HRbrain Inc.
Toronto, ON
Contract
Position Title: Paralegal / Legal Assistant II
Added 6 hours ago
Anaesthesia Assistant -Surgical Centre
Michael Garron Hospital
Toronto, ON
Full-time
The Anaesthesia Assistant provides constant assessment and evaluative monitoring of the depth of anesthesia under the direct supervision of the Anesthesiologist and with the use of medical…
Added 15 hours ago
Clinical Research Coordinator and Genetic Assistant
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
Full-time
Do you want to work for a world-renowned research institute that pushes the boundaries of biomedical science and health research? Right here in Montreal! At the Research Institute of the…
Added 15 hours ago
Service Administrative Assistant
March of Dimes Canada
Edmonton, AB
We are currently looking to fill 1 new opportunity for a Full-Time Service Administrative Assistant in Edmonton, AB.
Added 17 hours ago
Laboratory Assistant (BCGEU) - Part Time Regular (Float) - Richmond, BC
LifeLabs Medical Laboratory Services
Richmond, BC
Part-time
As a Laboratory Assistant you will be responsible for the specimen collection process, from greeting patients through to preparation of specimens for transportation. This is an important…
Added 18 hours ago
Physician Assistant (General Internal Medicine)
Michael Garron Hospital
Toronto, ON
Full-time
…first hospitals in Ontario to participate in the Physician Assistant pilot project., demonstrating our commitment to innovation and collaborative…
Added 15 days ago
Applied Data Scientist, Health AI Evaluation & Datasets
Innodata Inc.
Canada
$210,000 to $240,000 USD / year
Full-time
You will work in a tight pod with a Technical Solutions Architect, Applied Research Scientist, AI/ML Research Engineer, and Language Data Scientists. Your role is to make sure the data,…
Added 1 day ago
Executive Assistant
Marberg Staffing
Toronto, ON
$40.67 to $43.8 CAD / hour
Contract
Executive Assistant for professional college, downtown Toronto.
Added 1 day ago
Administration Assistant – Electronic Filing
TalentSphere Staffing Solutions
Toronto, ON
Full-time
Position: Administration Assistant – Electronic Filing *****6 month contract
Added 1 day ago
Laboratory Assistant - Abbotsford Regional Hospital
Provincial Health Services Authority
Abbotsford, BC
Temporary
Laboratory Assistant - Abbotsford Regional Hospital and Cancer Centre, Abbotsford British Columbia
Added 1 day ago
Laboratory Assistant - Abbotsford Regional Hospital
Provincial Health Services Authority
Abbotsford, BC
Part-time
Laboratory Assistant - Abbotsford Regional Hospital and Cancer Centre, Abbotsford British Columbia
Added 2 months ago
Anesthesia Assistant Trainee, Anesthesia Tech Services - BC Women's Hospital & Health Centre
BC Women's Hospital and Health Centre
Vancouver, BC
Full-time
Anesthesia Assistant Trainee, Anesthesia Tech Services

Innodata Inc.

Applied Data Scientist, Health AI Evaluation & Datasets

Canada

Pay: $210,000 to $240,000 USD / year
Job type: Full-time
Experience: 5+ years of data science experience, including at least 2+ years with healthcare, clinical, biomedical, payer, provider, pharma, life sciences, or comparable regulated health data.
Posting language: English
Posted: Sep 5, 2026

Apply About employer

Applications open in a new tab.

Original job description

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope Of The Role

Healthcare is one of the highest-stakes domains for generative AI. Clinical accuracy, patient safety, regulatory compliance, health equity, auditability, and workflow fit are the bar for shipping anything real. Innodata partners with foundation model labs, medical AI startups, payers, providers, pharma, and digital health companies building LLMs, multimodal systems, and AI agents for healthcare and life sciences.

As an Applied Data Scientist, Health AI Evaluation & Datasets, you own the design, measurement quality, and clinical validity of datasets used to train, fine-tune, and evaluate health-domain models. You bring clinical or biomedical fluency and data science rigor: you can read a clinical guideline, payer policy, medical literature artifact, or patient communication workflow; translate it into a measurable dataset and evaluation plan; and defend the methodology to sophisticated clinical, data science, and ML stakeholders.

You will work in a tight pod with a Technical Solutions Architect, Applied Research Scientist, AI/ML Research Engineer, and Language Data Scientists. Your role is to make sure the data, rubrics, review workflows, and measurement evidence are clinically realistic, statistically defensible, compliant, and useful for evaluation and post-training.

What You’ll Own

Translate customer goals - such as improving differential diagnosis, evaluating a clinical note summarizer, testing a RAG-based medical literature assistant, or creating preference data for patient-facing chatbots - into dataset specifications, taxonomies, rubrics, sampling plans, and acceptance criteria.
Make multimodal health AI a core focus: design training and evaluation datasets across clinical text, medical images, waveforms, structured EHR data, claims, trial data, medical literature, patient communications, payer policies, drug information, and other clinical artifacts, as well as use cases such as clinical reasoning, medical QA, note summarization, medical coding, patient communication, utilization management, and literature synthesis.
Design evaluations for retrieval-augmented and source-grounded health AI systems, including evidence citation, faithfulness, contraindication handling, guideline adherence, source freshness, and failure modes caused by incomplete, conflicting, or stale context.
Define sampling strategies, label schemas, inter-annotator agreement targets, adjudication workflows, SME review patterns, and quality thresholds in partnership with Language Data Scientists, clinicians, biomedical experts, and quality teams.
Build statistical and ML checks that make healthcare datasets trustworthy: stratified sampling across specialties and patient subgroups, bias and representation analysis, leakage detection, distribution shift checks, uncertainty estimates, reliability metrics, and subgroup performance analysis.
Partner with Applied Research Scientists and AI/ML Research Engineers to instrument datasets into evaluation and post-training pipelines, including rubric-grounded LLM-as-judge prompts, regression suites, model comparison workflows, experiment tracking, and model-improvement feedback loops.
Evaluate health AI behavior beyond surface accuracy: calibration, hallucination on safety-critical content, refusal appropriateness, robustness under ambiguity, equity across patient subgroups, and safe handoff in agentic or workflow-integrated systems. Reason concretely about clinical workflow fit: where outputs enter care delivery, what evidence a clinician or reviewer would need to trust them, when uncertainty must be surfaced, and how patient-facing, clinician-facing, payer, pharma, and operational use cases differ in risk.
Own data quality from source intake through delivery, including de-identified clinical text, medical literature, synthetic cases, structured records, client policies, and knowledge bases, with attention to PHI/PII handling, provenance, audit trails, versioning, and compliance documentation.
Stay current on the health AI landscape - regulatory developments such as FDA guidance on AI/ML-enabled medical devices and EU AI Act health provisions, benchmark releases such as MedQA, MedMCQA, and HealthBench, and emerging clinical evaluation methodology.
Support customer discovery and proposal work by scoping dataset programs, sizing annotation and SME review effort, identifying regulatory or data-access constraints, and explaining methodology choices to client clinical and ML leadership.
Contribute to Innodata internal IP: reusable health-domain taxonomies, evaluation rubrics, golden datasets, clinical review playbooks, dataset quality checks, and methodology templates.

You’ll Thrive In This Role If You Have

5+ years of data science experience, including at least 2+ years with healthcare, clinical, biomedical, payer, provider, pharma, life sciences, or comparable regulated health data.
Working knowledge of healthcare data and standards: EHR structure, clinical documentation conventions, ICD-10, CPT, SNOMED CT, LOINC, RxNorm, and at least passing familiarity with FHIR, HL7, or equivalent interoperability concepts.
Hands-on experience designing ML datasets, not just consuming them: writing annotation guidelines, sizing cohorts, setting quality thresholds, designing QA checks, and shipping data that downstream teams can train or evaluate on.
Familiarity with LLM-based health AI workflows, including prompt design, rubric-based evaluation, retrieval-augmented generation, LLM-as-judge methods, model comparison, and the limitations of automated evaluation in clinical contexts.
Strong Python and SQL; comfort with pandas, scikit-learn, statsmodels or equivalent tools; and working familiarity with modern LLM tooling such as Hugging Face, evaluation frameworks, prompt development tools, or model APIs.
Statistical literacy across sampling design, bias and fairness analysis, inter-annotator agreement metrics (Cohen or Fleiss kappa, Krippendorff alpha), confidence intervals, significance testing where appropriate, error analysis, and the ability to push back when a number is being over-interpreted.
Solid grasp of healthcare privacy, compliance, and governance: HIPAA, de-identification standards (Safe Harbor and Expert Determination), practical mechanics of working with PHI safely, auditability, access control, and documentation fit for high-stakes or regulated AI programs.
Ability to work credibly with clinicians, biomedical SMEs, research scientists, engineers, technical solutions teams, annotators, and customer stakeholders.
A bias toward clinical realism: you would rather build a smaller dataset that reflects what clinicians, reviewers, patients, or care teams actually see than a larger dataset that looks impressive on paper but fails in practice.
Degree in a relevant field such as biostatistics, epidemiology, computational biology, health informatics, computer science with a health focus, statistics, a clinical degree with quantitative training, or equivalent demonstrated experience.
Clinical credentials are not required, but candidates must be able to work credibly with clinicians, biomedical SMEs, and health AI customers; candidates with MD, RN, PharmD, MPH, PhD, or health informatics backgrounds are especially encouraged.

The expected salary range for this position is $210,000 – $240,000 USD per year, based on experience, skills, and qualifications.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.

If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov.

Apply About employer

More about this job

Responsibilities

Design and validate high-quality datasets and evaluation frameworks for health-domain AI models to ensure clinical accuracy and safety. Translate customer goals into technical specifications, rubrics, and sampling plans for multimodal health AI systems.

Requirements

Requires 5+ years of data science experience with at least 2 years in healthcare or life sciences and proficiency in Python and SQL. Candidates should have a strong grasp of healthcare data standards, privacy regulations like HIPAA, and LLM-based workflows.

Skills

Python
SQL
Pandas
Scikit-learn
LLM Evaluation
Retrieval-Augmented Generation
Statistical Sampling
Healthcare Data Standards
HIPAA Compliance
Dataset Design
Prompt Engineering
Bias Analysis
Clinical Reasoning
Medical Coding
Inter-annotator Agreement
Hugging Face

Visa sponsorship

Not detected in the job text

Keywords

Generative AI
LLM
Health AI
EHR
ICD-10
CPT
SNOMED CT
LOINC
RxNorm
FHIR
HL7
RAG
PHI
PII
MedQA
MedMCQA
HealthBench
FDA Guidance
EU AI Act
Biostatistics
Epidemiology
Computational Biology
Health Informatics
Statsmodels
Cohen's Kappa
Krippendorff's Alpha
Multimodal AI
Clinical Validity
Data Engineering
Model Calibration

Report this job