Analyst | Full time | AI Systems, Safety & Effectiveness

Requisition Number: 8963

Position: Analyst, AI Systems, Safety & Effectiveness

Status: Full time  

Number of Vacancies: 1 

Department: AI Systems, Safety & Effectiveness

Role Level: PG06 ($32.43 to $40.59) 

Site: 2085 Hurontario 

Work Model: Hybrid

Shift/Hours of Work: All Shifts; Days, evenings, nights and weekends 

Posted: Oct 19, 2026

Deadline: Oct 26, 2026  

A New Kind of Health Care for a Healthier Community. That’s our Vision at Trillium Health Partners (THP), one of the largest community-based acute care facilities in Canada. Comprised of the Credit Valley Hospital, the Mississauga Hospital and the Queensway Health Centre, along with several satellite locations, THP serves the growing and diverse populations of Mississauga, West Toronto and surrounding communities, and is a teaching hospital affiliated with the University of Toronto and home to Institute for Better Health.

Our common purpose is to improve care, elevate health, and strengthen the communities we serve. Grounded in the values of compassion, excellence, and courage, we strive each day to be our best and work toward a better future. Our mission begins with delivering the highest quality care through continuous improvement, while partnering to create a more seamless health system.

We provide services centred on people’s needs, striving for better health by supporting prevention as well as delivering treatment. We help communities thrive by building partnerships, fostering inclusion, and strengthening health and well-being for all.

Learn more about THPs Strategy by reading our Plan to 2030. 

Aligned to our Plan to 2030, THP is working together with our community on Trillium HealthWorks, the largest infrastructure renewal in Canada’s history, that will shape the future of our community and beyond, transforming health care with the future Peter Gilgan Mississauga Hospital, including Ontario’s first hospital dedicated to women’s and children’s health at the Shah Family Hospital for Women and Children and expanding the Queensway Health Centre, which will become The Gilgan Family Queensway Health Centre.

Learn more about Trillium HealthWorks by visiting the Trillium HealthWorks Website.

If you are passionate about your career, motivated to improve the health of the community, committed to excellence, quality and patient safety consider joining our Better Together team!

Job Description:

Reporting to the Director, AI Systems, Safety and Effectiveness, the Analyst, AI Systems, Safety, and Effectiveness plays a key role in ensuring that AI solutions deployed across THP are safe, effective, and aligned with clinical, operational, and organizational needs. The Analyst leads business analysis activities across the AI lifecycle, translating stakeholder needs into use cases, user stories, and business/technical requirements, product and project management, and designs and executes the evaluation, validation, and post-deployment monitoring of AI systems, including generative and agentic AI. Working closely with AI Engineer(s), clinical and operational teams, and privacy, security, and governance stakeholders, the Analyst produces the evidence, documentation, and reporting that enable responsible AI decision-making and continuous improvement.

Key Responsibilities:

• Lead business analysis for AI systems across the lifecycle, working with clinical, operational, and / or technical stakeholders to define problems, intended use, and success measures.

• Map current and future-state workflows and guide the creation of use cases, user stories, business cases, and business/technical requirements that assess impact on existing work processes and systems.

• Design and execute pre-deployment evaluation and validation of AI systems, including Generative and Agentic AI, using structured test plans, benchmarking, and evaluation frameworks that assess accuracy, grounding, hallucination, bias and fairness, usability, workflow fit, and human-in-the-loop review points.

• Support and lead project planning and product management activities for AI solutions.

• Support AI lifecycle management, including performance metrics, dashboards, drift and incident tracking, user feedback, and outcome measures; analyze results and prepare reports and recommendations for leadership and AI governance bodies.

• Actively participate in project status meetings and contribute to project management activities.

• Prepare presentations, briefing materials, and education content for clinical, operational, executive, and community-oriented audiences.

• Create robust documentation of AI systems and underlying design decisions, including system fact sheets, risk and impact assessments, evaluation reports, and standard operating procedures.

• Contribute to AI safety policies and procedures that support compliance with PHIPA, responsible AI, and applicable regulatory requirements.

Qualifications & Skills:

• Master's degree in Health Informatics (MHI), Management of Innovation (MMI), or equivalent required

• Strong business analysis skills, including requirements elicitation, workflow mapping, use case and user story development, and Agile methodology

• Technical understanding of Generative AI, Agentic AI, large language models, retrieval-augmented generation (RAG), and prompt engineering sufficient to design meaningful evaluations and collaborate effectively with AI Engineers

• Analytical and quantitative skills to design evaluation plans, define metrics, analyze performance data, and interpret results

• Broad project management skills, including planning, tracking deliverables, and managing risks and issues

• Excellent oral and written communication skills, including the ability to translate complex technical findings into clear reports and presentations (e.g., MS PowerPoint) for clinical, operational, and executive audiences

• Critical thinking, attention to detail, and a strong commitment to patient safety, equity, privacy, and human-centred design

Preferred Qualifications:

• Certification in AI Product Management, Generative AI, and/or AI evaluation (e.g., responsible AI, AI assurance, or LLM evaluation)

• Training in AI governance (e.g., IAPP Artificial Intelligence Governance Professional)

• Training in Agile methodology, health data privacy (PHIPA), and quality improvement or patient safety methods

• Proficiency with data analysis and visualization tools (e.g., Excel, Power BI, SQL, or Python)

Notes to Applicants:

If you do not see yourself fully reflected in every job requirement listed on this posting, we still encourage you to reach out and apply. Research has shown candidates from underrepresented groups often only apply when they feel 100% qualified. We encourage applicants who are members of groups that have been marginalized on any grounds enumerated under the Ontario Human Rights Code to consider this opportunity.

Trillium Health Partners is an equal opportunity employer committed to fostering a healthy, safe and respectful environment for healing, based on our values compassion, excellence and courage.  To be Better Together, we commit to fostering a respectful workplace culture that promotes a safe and supportive environment for everyone who provides care, supports caregiving, receives care or visits the hospital.

In accordance with the Accessibility for Ontarians with Disabilities Act, 2005 and the Ontario Human Rights Code, Trillium Health Partners will provide accommodations throughout the recruitment and selection process to applicants with disabilities as required. 

Applicants must be eligible to work in Canada. We would like to thank all applicants for their interest in this position, however, only those selected for an interview will be contacted. Trillium Health Partners is recognized under the French Language Services Act.

As a condition of employment, we require all staff to be fully vaccinated for COVID19, in addition to other vaccinations required by the Public Hospitals Act. 

Building an Antiracist and Equitable Team and Why it is Important to Us - A New Kind of Health Care for a Healthier Community

When we set out to build our vision and future, we connected with and heard from our community - patients, families, visitors, physicians, staff and volunteers. Our plan to create a new kind of health care for a healthier community means advancing health across the hospital, the system and the community and is built on an inter-connected system of care organized around patients and leaving no one behind. Recognizing this mission could not be realized without also assessing and investing in our internal practices, culture and processes we are building an organization where everyone at THP feels they belong, their voice matters, and contributes to our collective success.  We commit to making systemic fairness a reality for all and are working to ensure that the community we serve is reflected at all levels, and in all professions at THP.  Diversity is our strength and we recognize and value teaching and learning we all contribute and benefit from in our environment; our unique lived experiences matter and shape our actions and behaviors.  In becoming an antiracist organization, we acknowledge the existence of oppression, racism, bias and complicity, and we have been working steadily to make changes in the way we work to dismantle these barriers. This includes developing and realizing an action plan to advance racial equity and embed anti-racism accountability across IBH, starting with our anti-Black racism priority initiative. 

Candidates are selected on the basis of their skill, ability, experience and qualifications. 

Where these factors are relatively equal seniority shall govern providing the successful applicant. 

Trillium Health Partners’ (THP) is an equal opportunity employer who values the importance of antiracism work and is committed to integrating antiracism, diversity, equity and inclusion best practices throughout THP operations, policies and culture. Therefore, we ask that even if you do not see yourself fully reflected in every job requirement listed on this posting, we still encourage you to reach out and apply. Research has shown that candidates from underrepresented groups often only apply when they feel 100% qualified. We encourage all applicants who are members of groups that have been marginalized on any grounds enumerated under the Ontario Human Rights Code based on race, gender identity or expression, sex, sexual orientation, disability, political belief, religion, marital or family status, age, and/or status as a First Nations, Métis or Inuk/Inuit person to consider this opportunity. 

In accordance with the Accessibility for Ontarians with Disabilities Act, 2005 and the Ontario Human Rights Code Trillium Health Partners will provide accommodations throughout the recruitment and selection process to applicants with disabilities. If selected to participate in the recruitment and selection process, please inform Human Resources of the nature of any accommodation(s) that you may require in respect of any materials or processes used to ensure your equal participation. 

 All personal information is collected under the authority of the Freedom of Information and Protection of Privacy Act. 

 Trillium Health Partners is identified under the French Language Services Act. 

 Our organization may use automated tools, including artificial intelligence (AI) or algorithm-assisted systems, to support the initial review of applications. These tools are used only to assist our recruiters and hiring managers; all hiring decisions include meaningful human involvement and final review. 

We thank all those who apply but only those selected for further consideration will be contacted. 

Trillium Health Partners is one of Canada’s largest community-based teaching hospitals. Our team of more than 17,000 people serves the growing and diverse populations of Mississauga, west Toronto, and surrounding communities through the Credit Valley Hospital, the Mississauga Hospital, the Queensway Health Centre, and nine satellite locations. Guided by our values of compassion, excellence, and courage, and through our strategic roadmap, Plan to 2030, we are creating a new kind of health care - defined not by illness, but by the health and well-being of people and communities.