Sr. Systems Testing/QA Specialist (AI/LLM testing experience)
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Posting language
- English
- Posted
Original job description
Job Role: Sr. Systems Testing/QA Specialist (AI/LLM testing experience)
Location : Toronto, ON/Onsite
Position Type : Contract Role
Start Date
2026-12-15
End Date
2027-06-14
Location: 3 days onsite
Public Sector Experience: Preferred
Ideal Candidate Rate: CAD 70-75/Hr (Depending on the experience)
Must Have:
- Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing - across web-based, mobile, and cloud platforms.
- Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.
Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.
More about this job
Responsibilities
Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.
Requirements
Requires at least three years of hands-on AI-assisted testing experience, including agentic AI, LLM technologies, and chatbot applications. Also requires 10 or more years testing large-scale applications across web, mobile, on-premise, and cloud platforms, with experience using specialized AI testing tools.
Skills
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- AI-Powered QA Agents
- Chatbot Testing
- Test Case Development
- UI Testing
- Integration Testing
- Regression Testing
- Performance Testing
- User Acceptance Testing
- Mobile Testing
- Cloud Testing
- DeepEval
- Applitools
- Promptfoo
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Government & Public Sector
Keywords
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- AI-Powered QA Agents
- Chatbot Applications
- Test Case Development
- Large-Scale Applications
- On-Premise Web Solutions
- Cloud-Based Integrations
- Mobile Platforms
- UI Testing
- Integration Testing
- Regression Testing
- Performance Testing
- AI-Enabled Systems
- User Acceptance Testing
- DeepEval
- Applitools
- Promptfoo
- SaolaAI
- Reflect AI
- Copilot Studio Kit
- Public Sector