Architecture Expert - Task Author
- Toronto, ON, Canada
Remote
$50 CAD / hour
Applications open in a new tab.
Job details
- Pay
- $50 CAD / hour
- Workplace
- Remote
- Working hours
- 15–20 hours/week
- Posting language
- English
Original job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Architecture Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Commitment: 15–20 hours/week
Role Responsibilities
- Evaluate AI models on visual document understanding in the Architecture domain.
- Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
- Review and improve the accuracy of AI-generated content to ensure alignment with domain principles.
- Collaborate with subject matter experts to enhance dataset consistency and coverage.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- Expertise in the Architecture domain.
- Experience in authoring complex tasks with objective rubrics.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
More about this job
Responsibilities
The Architecture Expert at Mercor will evaluate AI models on architectural visual documents and author complex tasks with clear ground-truth outputs. They also review AI-generated architecture content for accuracy and work with subject matter experts to keep datasets consistent.
Requirements
Candidates need expertise in the architecture domain and experience authoring complex tasks with objective rubrics. Mercor asks applicants to upload a resume and complete an AI interview.
Skills
- Architecture domain expertise
- Visual document understanding
- Task authoring
- Objective rubric design
- Ground-truth annotation
- AI model evaluation
- Quality review
- Dataset consistency
- Asynchronous independent work
- Subject matter collaboration
Categories
- Technology
- Data & Analytics
- Engineering
Keywords
- architecture
- AI model evaluation
- visual document understanding
- task authoring
- rubrics
- ground truth
- dataset annotation
- AI training data
- subject matter expert
- remote contract
- architectural design
- building design
- AI evaluation
- data quality
- contract