User Research Expert - Evaluator
- Toronto, ON, Canada
Remote
$80 to $120 CAD / hour
Applications open in a new tab.
Job details
- Pay
- $80 to $120 CAD / hour
- Workplace
- Remote
- Experience
- 5+ years of relevant professional experience in User/customer research and feedback synthesis.
- Posting language
- English
Original job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to enhance AI work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
More about this job
Responsibilities
The Evaluator at Mercor will review AI-generated work products such as documents, spreadsheets and slides. They will find errors and give clear, structured written feedback to improve the AI's output.
Requirements
Candidates need 5+ years of user or customer research and feedback synthesis experience, fluent English, and high proficiency in Microsoft Office and Google Workspace, especially Slides. A Master's or higher degree is preferred.
Skills
- Microsoft Office
- Google Workspace
- Google Slides
- Microsoft PowerPoint
- Microsoft Excel
- Microsoft Word
- Google Sheets
- Google Docs
- Rubric-based evaluation
- Quality assessment
- Error identification
- Structured written feedback
- User research
- Customer research
- Feedback synthesis
- Subject-matter expertise
- Independent work
- Asynchronous work
- Attention to detail
- Accuracy review
Categories
- Technology
- Data & Analytics
- Consulting
Keywords
- User research
- Customer research
- Feedback synthesis
- AI evaluation
- AI training
- Quality evaluation
- Rubric grading
- Microsoft Office
- Google Workspace
- Google Slides
- PowerPoint
- Excel
- Word
- Contract
- Remote
- AI annotation
- Data labeling
- Content review
- Usability research
- Customer insights
Seniority
Senior
Tools
- Microsoft Office
- Google Workspace
- Google Slides
Languages
- English