Senior QA Specialist – AI Testing
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- Minimum 10+ years of experience in software quality assurance and systems testing for large-scale applications.
- Posting language
- English
- Posted
Original job description
Job Title: Senior Systems Testing / QA Specialist – AI Testing
Employment Type: Contract
Duration: June 2027
Location: Toronto
Ideal Rate: $70- $75 (Based on Experience)
Hybrid: 3 days onsite
Must haves:
- Minimum 10+ years of experience in software quality assurance and systems testing for large-scale applications.
- Minimum 3 years of hands-on experience in AI-assisted testing, including AI-powered QA agents, agentic AI, LLM technologies, or chatbot applications used to create and execute test cases.
- Demonstrated experience testing AI-enabled systems, including response accuracy, hallucinations, prompts, AI safety, and AI security.
- Strong experience in test automation and manual testing across functional, integration, regression, performance, and UAT activities.
- Experience testing web-based applications, mobile platforms, cloud integrations, and on-premises solutions.
- Hands-on experience with AI testing tools such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, Copilot Studio Kit, or equivalent solutions.
- Experience with automation tools such as Selenium, Playwright, Tosca, Micro Focus/OpenText UFT, or Cucumber.
- Experience with performance testing tools such as JMeter or OpenText LoadRunner.
- Strong understanding of SDLC, Agile/Scrum, Waterfall, Hybrid, and DevOps methodologies.
Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.
More about this job
Responsibilities
Test large-scale applications and AI-enabled systems using manual and automated approaches across functional, integration, regression, performance, and user acceptance testing. Assess AI response accuracy, hallucinations, prompts, safety, and security across web, mobile, cloud, and on-premises solutions.
Requirements
Requires at least 10 years of software quality assurance and systems testing experience, including at least three years of hands-on AI-assisted testing with AI agents, agentic AI, LLMs, or chatbots. Candidates should have experience with AI testing, automation, and performance tools, and understand SDLC, Agile/Scrum, Waterfall, Hybrid, and DevOps methodologies.
Skills
- Software Quality Assurance
- Systems Testing
- AI-Assisted Testing
- AI Testing
- Test Automation
- Manual Testing
- Functional Testing
- Integration Testing
- Regression Testing
- Performance Testing
- User Acceptance Testing
- Web Application Testing
- Mobile Testing
- Cloud Integrations
- AI Safety and Security
- Agile/Scrum
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
Keywords
- Software Quality Assurance
- Systems Testing
- AI-Assisted Testing
- AI-Powered QA Agents
- Agentic AI
- Large Language Models
- Chatbots
- AI Response Accuracy
- Hallucinations
- Prompt Testing
- AI Safety
- AI Security
- Test Automation
- Manual Testing
- Functional Testing
- Integration Testing
- Regression Testing
- Performance Testing
- User Acceptance Testing
- Web Applications
- Mobile Platforms
- Cloud Integrations
- On-Premises Solutions
- DeepEval
- Promptfoo
- Applitools
- Selenium
- Playwright
- JMeter
- OpenText LoadRunner