AI Risk Management Specialist
- London, ON, Canada
- CA - ON VIRTUAL, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
Responsibilities:
- Maintains the organization's AI risk taxonomy and assessment methodology, covering safety, fairness, reliability, explainability, robustness, and harmful output risks
- Develops risk evaluation rubrics for AI-specific risk dimensions (e.g., bias testing protocols, fairness metrics, explainability requirements by use case, drift tolerance thresholds, harmful output tolerances) within the established risk tolerance and acceptance thresholds
- Develops and maintains templates and standards for risk documentation (model cards, risk assessments, impact analyses, risk scorecards); project teams produce their own documentation using these templates
- Supports project teams in applying the risk assessment framework and quality gates, escalating high-risk deployments for direct review
- Executes periodic independent risk audits on a sample basis to verify that federated execution meets the standards; project QAs provide first-line coverage
- Supports red-teaming and adversarial testing coordination with the Cybersecurity team, focusing on safety, bias, and harmful output dimensions
Background & Qualifications:
- Experience in AI/ML risk management, model risk management, technology risk, or a related analytical function Working knowledge of AI-specific frameworks and legislation (NIST AI RMF, ISO 42001 & 23053, EU AI Act, and the proliferating landscape of US state-level AI legislation)
- Familiarity with risk assessment across safety, fairness, reliability, explainability, and robustness dimensions
- Hands-on experience with model evaluation, bias and fairness testing, or AI red-teaming is a plus
Skills:
- AI risk taxonomy and assessment methodology maintenance
- Developing risk evaluation rubrics: bias testing, fairness metrics, explainability, drift, and harmful output
- Risk documentation: model cards, risk assessments, impact analyses, and risk scorecards
- Model evaluation and fairness/safety testing
- Audit execution and independent risk review
- Cross-functional collaboration with Engineering and Cybersecurity
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
It is the policy of Mobility to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, Mobility will provide reasonable accommodations for qualified individuals with disabilities.
More about this job
Responsibilities
The specialist will maintain the organization's AI risk taxonomy and develop evaluation rubrics for safety, fairness, and reliability. They will also conduct independent risk audits and coordinate adversarial testing with the cybersecurity team.
Requirements
Candidates should have experience in AI/ML risk management or related analytical functions and a working knowledge of AI frameworks like NIST AI RMF and the EU AI Act. Hands-on experience with model evaluation, bias testing, or red-teaming is highly preferred.
Skills
- AI Risk Taxonomy
- Risk Assessment Methodology
- Bias Testing
- Fairness Metrics
- Explainability
- Model Cards
- Risk Documentation
- Audit Execution
- NIST AI RMF
- ISO 42001
- EU AI Act
- AI Red-teaming
- Adversarial Testing
- Model Risk Management
- Technology Risk
- Cross-functional Collaboration
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Security & Safety
- Data & Analytics
- Consulting
- Software
Keywords
- AI Risk Management
- Model Risk Management
- NIST AI RMF
- ISO 42001
- EU AI Act
- Bias Testing
- Fairness Metrics
- Explainability
- Model Cards
- Risk Assessment
- Red-teaming
- Adversarial Testing
- Cybersecurity
- Drift Tolerance
- Compliance
- Technology Risk
- Audit
- Impact Analysis
- Risk Scorecards
- AI Governance