Media & Information AI Training Specialist - Task Creation & Model Evaluation
- Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
About Rise Data Labs
Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including journalism, editorial, and video/film production. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.
Job Overview
As a Media & Information AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for journalism, editorial, and video/film production work. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable media tasks and rubrics based on your own professional experience, then grade AI-generated deliverables against them.
What You'll Do
At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in media, journalism, and video production.
Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including journalism, editorial, and video/film production. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.
Job Overview
As a Media & Information AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for journalism, editorial, and video/film production work. This role goes beyond traditional annotation and labeling - you'll author realistic, economically valuable media tasks and rubrics based on your own professional experience, then grade AI-generated deliverables against them.
What You'll Do
- Create realistic work scenarios based on your own professional experience - e.g., drafting or editing an article, fact-checking and sourcing, writing a script or shot list, reviewing a rough cut or storyboard
- Supply the kinds of reference materials you'd normally work from (source documents, style guides, scripts, production notes)
- Write detailed rubrics specifying exactly what a correct, publication-ready or production-ready deliverable requires - accurate sourcing, correct style/format, sound editorial or production judgment
- Grade AI-generated deliverables (often written pieces, scripts, or production documents) against your rubric
- Join calibration sessions with other experts to ensure consistent scoring across the benchmark
- Prior hands-on experience as a Journalist, Editor, Writer, Producer, Director, or Video Editor
- Comfort reviewing detailed written or production work product against professional standards
- Prior experience with AI model training, evaluation, or benchmark development is a plus
At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in media, journalism, and video production.
More about this job
Responsibilities
Create realistic media and information work scenarios, provide relevant reference materials, and develop detailed rubrics defining publication-ready or production-ready work. Evaluate AI-generated deliverables against those rubrics and participate in expert calibration sessions to support consistent benchmark scoring.
Requirements
Candidates should have hands-on experience as a journalist, editor, writer, producer, director, or video editor, and be comfortable assessing detailed written or production work against professional standards. Experience with AI model training, evaluation, or benchmark development is a plus.
Skills
- Journalism
- Editing
- Writing
- Fact-Checking
- Source Verification
- Scriptwriting
- Video Production
- Editorial Judgment
- Rubric Development
- AI Model Evaluation
- Data Annotation
- Quality Assurance
- Benchmark Development
- Professional Standards
- Calibration and Scoring
Benefits
- Professional Development Opportunities
- Flexible Working Environment
Visa sponsorship
Not detected in the job text
Categories
- Creative & Media
- Technology
- Data & Analytics
Keywords
- Artificial Intelligence
- AI Training
- Data Annotation
- Machine Learning
- Journalism
- Editorial
- Video Production
- Film Production
- Task Creation
- Model Evaluation
- Benchmark Development
- Human Annotation
- Validation
- Quality Assurance
- Work Scenarios
- Reference Materials
- Source Documents
- Style Guides
- Production Notes
- Rubric Development
- Fact-Checking
- Sourcing
- Scriptwriting
- Shot Lists
- Storyboards
- Rough Cuts
- Calibration Sessions
- Editorial Judgment
- Publication-Ready Deliverables
- Production-Ready Deliverables