Back to results

Sr. Systems Testing/QA Specialist (AI/LLM testing experience)

  • Toronto, ON, Canada

Contract

Applications open in a new tab.

Job details

Job type
Contract
Apply by
Experience
Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
Posting language
English
Posted

Original job description

Job Role: Sr. Systems Testing/QA Specialist (AI/LLM testing experience)

Location : Toronto, ON/Onsite

Position Type : Contract Role

Start Date

2026-12-15

End Date

2027-06-14

Location: 3 days onsite

Public Sector Experience: Preferred

Ideal Candidate Rate: CAD 70-75/Hr (Depending on the experience)

Must Have:

  • Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
  • Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
  • Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing - across web-based, mobile, and cloud platforms.
  • Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.

Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.

More about this job

Responsibilities

Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.

Requirements

Requires at least three years of hands-on AI-assisted testing experience, including agentic AI, LLM technologies, and chatbot applications. Also requires 10 or more years testing large-scale applications across web, mobile, on-premise, and cloud platforms, with experience using specialized AI testing tools.

Skills

  • AI-Assisted Testing
  • Agentic AI
  • Large Language Models
  • AI-Powered QA Agents
  • Chatbot Testing
  • Test Case Development
  • UI Testing
  • Integration Testing
  • Regression Testing
  • Performance Testing
  • User Acceptance Testing
  • Mobile Testing
  • Cloud Testing
  • DeepEval
  • Applitools
  • Promptfoo

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Software
  • Government & Public Sector

Keywords

  • AI-Assisted Testing
  • Agentic AI
  • Large Language Models
  • AI-Powered QA Agents
  • Chatbot Applications
  • Test Case Development
  • Large-Scale Applications
  • On-Premise Web Solutions
  • Cloud-Based Integrations
  • Mobile Platforms
  • UI Testing
  • Integration Testing
  • Regression Testing
  • Performance Testing
  • AI-Enabled Systems
  • User Acceptance Testing
  • DeepEval
  • Applitools
  • Promptfoo
  • SaolaAI
  • Reflect AI
  • Copilot Studio Kit
  • Public Sector

Report this job