Back to results

Psychology PhD - Assessment Specialist

  • Toronto, ON, Canada

Remote

$50 to $63 CAD / hour

Apply on work.mercor.com About employer

Applications open in a new tab.

Job details

Pay
$50 to $63 CAD / hour
Workplace
Remote
Posting language
English

Original job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week

Role Responsibilities

  • Author original psychology questions that test deep conceptual understanding, not surface-level recall.
  • Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
  • Supply 1–5 academic references per question from reputable sources like peer-reviewed journals or university repositories.
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Qualifications

Must-Have

  • PhD, PsyD, or doctoral candidate in Psychology or a closely related field.
  • Master's degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of graduate-level psychological theory, research methodology, and empirical literature.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

  • Clinical licensure or research publications in psychology is a strong plus.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

More about this job

Responsibilities

The Applied Psychology Benchmark Specialist at Mercor will write original psychology questions that test deep understanding, provide answers with step-by-step solutions, and check other questions for clarity and accuracy. The work is done remotely as a contract.

Requirements

Candidates need a PhD, PsyD or doctoral candidacy in Psychology or a closely related field, with strong graduate-level knowledge of theory, research methods and empirical literature. Excellent written English is required, and clinical licensure or publications are a plus.

Skills

  • Graduate-level psychological theory
  • Research methodology
  • Empirical literature review
  • Question authoring
  • Academic writing
  • Technical writing in markdown
  • Academic referencing
  • Difficulty rating
  • Answer verification
  • Chain-of-thought reasoning
  • Critical reasoning

Categories

  • Education
  • Science & Research
  • Technology
  • Data & Analytics

Keywords

  • psychology
  • PhD
  • PsyD
  • doctoral candidate
  • psychology questions
  • benchmark
  • AI training
  • AI research
  • remote contract
  • assessment
  • peer review
  • academic writing
  • research methodology
  • chain-of-thought
  • question writing
  • data annotation

Seniority

Mid level

Languages

  • English

Fields of study

  • Psychology

Report this job

Get in touch
MovoJobs

Contact us