Psychology PhD - Assessment Specialist
- Toronto, ON, Canada
Remote
$50 to $63 CAD / hour
Applications open in a new tab.
Job details
- Pay
- $50 to $63 CAD / hour
- Workplace
- Remote
- Posting language
- English
Original job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD, PsyD, or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
More about this job
Responsibilities
The Applied Psychology Benchmark Specialist at Mercor will write challenging psychology questions that test real understanding, not memorization. They will check each question for clarity, rate its difficulty, and write step-by-step explanations with academic sources.
Requirements
Mercor needs candidates with a doctorate or doctoral candidacy in psychology or a closely related field, and a Master's can be considered for exceptional subdomain depth. They need strong graduate-level knowledge of psychological theory and research methods, and excellent written English.
Skills
- Graduate-level psychological theory
- Research methodology
- Empirical literature review
- Question and item writing
- Difficulty rating
- Chain-of-thought reasoning
- Markdown writing
- Academic referencing
- Verification and editing
- Clear written English
- Distractor design
- Problem-solving
Categories
- Education
- Science & Research
- Data & Analytics
- Technology
Keywords
- psychology
- PhD
- PsyD
- doctoral candidate
- psychology question writing
- benchmark development
- AI training data
- assessment
- item writing
- clinical psychology
- research methodology
- academic writing
- peer review
- chain-of-thought
- remote contract
- psychometrics
Languages
- English
Fields of study
- Psychology