Software Engineering Expert - AI/ML
- Toronto, ON, Canada
Remote
$60 to $75 CAD / hour
Applications open in a new tab.
Job details
- Pay
- $60 to $75 CAD / hour
- Workplace
- Remote
- Experience
- 3+ years of experience in software engineering or data science & analytics.
- Working hours
- 15–20 hours/week
- Posting language
- English
Original job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Software & Data Science Expert
Type: Contract
Compensation: $60–$75/hour
Location: Remote
Commitment: 15–20 hours/week
Role Responsibilities
- Author tasks to test AI reasoning over technical documentation.
- Evaluate AI ability to follow precise instructions and produce accurate outputs.
- Develop objective evaluation rubrics for task assessment.
- Collaborate with AI research teams to ensure task relevance and accuracy.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 3+ years of experience in software engineering or data science & analytics.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
More about this job
Responsibilities
The Software & Data Science Expert at Mercor will write tasks that test how well AI reasons over technical documents. They will also score AI outputs with clear rubrics and work independently to meet deadlines.
Requirements
Candidates need at least 3 years of software engineering or data science and analytics experience. Mercor also asks for a 20–30 minute application with an AI interview based on the resume.
Skills
- Technical documentation analysis
- Evaluation rubric development
- Task authoring
- Instruction-following assessment
- AI output evaluation
- Software engineering
- Data science
- Data analytics
- Asynchronous work
- Independent work
- Deadline management
- Collaboration with research teams
Categories
- Technology
- Software
- Data & Analytics
Keywords
- AI evaluation
- AI training data
- LLM evaluation
- data science
- software engineering
- machine learning
- technical documentation
- evaluation rubrics
- remote contract
- AI research
- data analytics
- Python
- AI tutor
- RLHF
- prompt engineering
- contract
- remote
- freelance
Seniority
Mid level
Languages
- English