AI Training Specialists - Coding, Systems, Machine Learning, Security & Hardware
- Canada
Applications open in a new tab.
Job details
- Experience
- Approximately 6–7+ years of relevant professional experience, depending on the specialization.
- Posting language
- English
- Posted
Original job description
Help push the limits of today's most advanced AI models.
Are you an experienced technical professional who enjoys solving complex problems and challenging the capabilities of AI systems?
We are looking for specialists in software engineering, systems, machine learning, cybersecurity, hardware, and related technical fields to contribute to an expert-level AI benchmarking project.
About the project:
Today's AI agents can perform many technical tasks, but they still struggle with complex, real-world problems. In this project, you'll use your expertise to design challenging tasks that AI agents must solve in a Linux terminal.
Your work will involve:
- Designing original, technically challenging problems based on real-world scenarios.
- Developing automated verifiers to determine whether an AI agent's final result is correct.
- Anticipating edge cases and ensuring tasks have clear specifications and reliable evaluation criteria.
This is not a traditional data annotation project. You'll apply your technical knowledge to evaluate the capabilities and limitations of advanced AI systems.
Areas of expertise
We welcome candidates with experience in one or more of the following areas:
- Software engineering and coding
- Systems engineering and Linux environments
- Machine learning and artificial intelligence
- Cybersecurity and information security
- Hardware engineering
- Related technical disciplines
Requirements
- Bachelor's degree or higher from a top-500 university.
- Approximately 6–7+ years of relevant professional experience, depending on the specialization.
- Strong analytical, technical problem-solving, and critical-thinking skills.
- Practical expertise in your field, ideally including programming, scripting, Linux, automation, testing, or software verification.
- Ability to design challenging, clearly specified problems and define reliable criteria for evaluating solutions.
- Residence in an eligible country.
Compensation and commitment
- Competitive, project-based compensation based on expertise, assessment results, and project requirements.
- Higher compensation may be available for particularly strong submissions and specialized expertise.
- The project is ongoing, with an expected duration of at least seven weeks.
How to apply
Interested candidates should email their CV to aiprojects@mlginternational.com with the subject line:
TBench – [Your Area of Expertise]
We look forward to hearing from you!
More about this job
Responsibilities
Design original, technically challenging problems based on real-world scenarios for AI agents to solve in a Linux terminal. Develop automated verifiers, anticipate edge cases, and establish clear specifications and reliable evaluation criteria.
Requirements
Requires a bachelor's degree or higher from a top-500 university and approximately 6–7 or more years of relevant professional experience, depending on specialization. Candidates should have strong analytical and technical problem-solving skills, practical expertise in a relevant technical field, and the ability to design well-specified problems with reliable evaluation criteria.
Skills
- Software Engineering
- Coding
- Systems Engineering
- Linux
- Machine Learning
- Artificial Intelligence
- Cybersecurity
- Information Security
- Hardware Engineering
- Programming
- Scripting
- Automation
- Testing
- Software Verification
- Problem Design
- Analytical Problem-Solving
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
- Data & Analytics
- Security & Safety
Keywords
- AI Benchmarking
- AI Agents
- Software Engineering
- Coding
- Systems Engineering
- Linux
- Machine Learning
- Artificial Intelligence
- Cybersecurity
- Information Security
- Hardware Engineering
- Programming
- Scripting
- Automation
- Testing
- Software Verification
- Automated Verifiers
- Edge Cases
- Evaluation Criteria
- Technical Problem-Solving
- Real-World Scenarios
- Expert-Level Tasks