Senior Systems Testing/QA Specialist – AI Testing
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- Minimum 10+ years of experience in software testing/QA across large-scale web applications, cloud integrations, and mobile platforms.
- Posting language
- English
- Posted
Original job description
Position: Senior Systems Testing/QA Specialist – AI Testing
- Minimum 3 years of hands-on experience in AI-assisted testing, developing AI-powered QA agents using Agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
- Hands-on experience with AI testing tools such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, and Copilot Studio Kit.
- Minimum 10+ years of experience in software testing/QA across large-scale web applications, cloud integrations, and mobile platforms.
- Strong expertise in AI testing, including response accuracy, hallucination detection, prompt testing, prompt injection, AI security, privacy, and safety testing.
- Extensive experience in functional, UI, integration, regression, performance, accessibility, and UAT testing, along with AI-assisted test automation and CI/CD pipelines.
- Proficiency in automation tools such as Selenium, Micro Focus/OpenText UFT, and TOSCA, and performance testing tools such as JMeter and OpenText LoadRunner.
- Experience with test planning, test case development, defect lifecycle management, and QA leadership using Jira, OpenText ALM/Octane, and Agile, Waterfall, Hybrid, or DevOps methodologies.
More about this job
Responsibilities
Develop and use AI-powered QA agents and AI testing tools to create and execute test cases, evaluating AI responses for accuracy, hallucinations, prompt vulnerabilities, security, privacy, and safety. Lead and perform broad software testing and automation across web, cloud, and mobile applications, including test planning, defect management, and QA delivery within CI/CD and project methodologies.
Requirements
Requires at least 10 years of software testing or QA experience across large-scale web applications, cloud integrations, and mobile platforms, including at least 3 years of hands-on AI-assisted testing experience. Candidates should have expertise in AI testing and test automation tools, performance testing, QA leadership, test management platforms, and Agile, Waterfall, Hybrid, or DevOps methodologies.
Skills
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- AI-Powered QA Agents
- Chatbot Testing
- Prompt Testing
- Hallucination Detection
- AI Security Testing
- Test Automation
- Functional Testing
- Performance Testing
- Accessibility Testing
- Selenium
- JMeter
- Jira
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Management & Leadership
- Consulting
Keywords
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- AI-Powered QA Agents
- Chatbot Applications
- DeepEval
- Promptfoo
- Applitools
- SaolaAI
- Reflect AI
- Copilot Studio Kit
- Hallucination Detection
- Prompt Injection
- AI Security
- Privacy Testing
- Safety Testing
- Functional Testing
- UI Testing
- Integration Testing
- Regression Testing
- Performance Testing
- Accessibility Testing
- User Acceptance Testing
- Selenium
- Micro Focus/OpenText UFT
- TOSCA
- JMeter
- OpenText LoadRunner
- Jira
- OpenText ALM/Octane