Systems Testing/QA Specialist
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
The Senior Systems Testing/QA Specialist (QA Lead) is responsible for planning, coordinating, executing, and overseeing quality assurance activities for application delivery. The role covers functional and automated testing, performance and accessibility testing, and specialized testing of AI-enabled systems. The successful candidate will help ensure solutions meet business requirements, technical expectations, and quality standards.
Key Responsibilities Quality Assurance Leadership
- Lead testing activities for assigned projects, including planning, coordination, execution, and oversight.
- Assess quality risks based on verification and validation results and recommend mitigation strategies.
- Implement and maintain quality processes supporting development and production change management.
- Develop master test plans, test plans, test cases, test scripts, and test completion reports.
- Design manual and automated tests, including functional, system, regression, integration, load, and performance scenarios.
- Work with development leads and business analysts to prepare suitable test data.
- Advise and support business users in developing User Acceptance Testing (UAT) test cases.
- Execute functional, regression, integration, usability/accessibility, performance, and other required tests manually and/or using automation tools.
- Conduct AI testing, including functional AI testing, response accuracy, hallucination testing, prompt testing, AI security and privacy testing (including prompt injection), and AI safety testing for inappropriate behaviours.
- Manage test cycles, monitor progress, track issues, coordinate defect resolution, and maintain detailed test results and discrepancy records.
- Coordinate with project managers, implementation teams, system administrators, architects, vendors, and database administrators to align testing with timelines and technical requirements.
- Lead or support business users during UAT and provide guidance as required.
- Document and communicate defects and test discrepancies to relevant stakeholders throughout the testing lifecycle.
- Provide regular updates on testing progress, issues, and outcomes to project teams and management.
- Prepare a Test Completion Report summarizing testing activities and results for project gating decisions.
- Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
- 10+ years of experience testing large-scale applications, including on-premises web solutions, cloud-based integrations, and mobile platforms.
- At least 3 years of hands-on AI-assisted testing experience, including developing AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
- Experience using AI tools to improve test coverage, negative testing, and regression testing, with knowledge of AI-assisted automation for CI/CD pipelines.
- Experience leading and coordinating testing activities with project teams and a strong understanding of SDLC delivery approaches, including Waterfall, Agile/Scrum, Hybrid, and DevOps.
- Strong analytical skills across business processes, information systems, information management, web UI design, and accessibility.
- Excellent written and verbal communication skills and the ability to work effectively with multidisciplinary teams.
- Certification in Software Quality Engineering or an equivalent credential is considered an asset.
- Hands-on experience across UI, integration, regression, performance, AI-enabled systems, and UAT testing for web, mobile, and cloud platforms.
- Experience with AI testing tools and technologies such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and Copilot Studio Kit.
- Automated testing experience with Micro Focus UFT, TOSCA, Selenium, and Cucumber.
- Performance testing experience with JMeter and OpenText LoadRunner.
- Experience with defect and test management tools such as OpenText ALM, OpenText Octane, JIRA, Visual Studio, and Confluence.
- Experience with ServiceNow, Salesforce, SAP, or equivalent platforms is considered an asset.
- Ability to analyze business requirements and user stories, design test scenarios, develop test cases and scripts, prepare test data, and assess results.
- Develop detailed manual and automated test plans, test cases, and test scripts aligned with business requirements and project objectives.
- Execute functional, regression, integration, system, performance, usability, and UAT testing across platforms and environments; document and report results.
- Maintain accurate records of defects and test discrepancies using designated QA tools and provide timely reports and recommendations.
- As needed, develop and implement automated testing frameworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium, and Cucumber.
- As needed, conduct load and stress testing using LoadRunner or JMeter and provide performance analysis reports with actionable recommendations.
- Collaborate with business analysts and developers to create and manage test data and scenarios for robust business-process validation.
- Support QA processes and continuous improvement across Agile, DevOps, and traditional delivery environments.
- 3+ years of solid AI-assisted testing experience, including hands-on development of AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications.
- 10+ years of testing experience with large-scale applications across on-premises web solutions, cloud integrations, and mobile platforms.
- Extensive hands-on testing experience across UI, integration, regression, performance, AI-enabled systems, and UAT for web, mobile, and cloud platforms.
- Practical experience with AI testing tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and/or Copilot Studio Kit.
More about this job
Responsibilities
Lead and coordinate quality assurance activities, including test planning, manual and automated execution, AI-system testing, defect management, and support for user acceptance testing. Report testing progress and outcomes, coordinate with multidisciplinary project teams, and provide recommendations to improve quality and manage risks.
Requirements
Requires 10+ years of experience testing large-scale applications across on-premises web, cloud-integrated, and mobile platforms, including extensive hands-on testing across functional, integration, regression, performance, AI-enabled systems, and UAT. Requires at least 3 years of AI-assisted testing experience involving AI-powered QA agents, agentic AI, LLMs, or chatbots, plus a post-secondary degree in computer science, electronic engineering, or a related discipline.
Skills
- Quality Assurance Leadership
- Manual Testing
- Automated Testing
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- Functional Testing
- Regression Testing
- Integration Testing
- Performance Testing
- Accessibility Testing
- User Acceptance Testing
- Test Planning
- Defect Management
- Test Automation
- SDLC
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Management & Leadership
Keywords
- Quality Assurance
- Software Testing
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- Chatbot Applications
- DeepEval
- Applitools
- Promptfoo
- SaolaAI
- Reflect AI
- Copilot Studio Kit
- Micro Focus UFT
- OpenText UFT
- Selenium
- Cucumber
- JMeter
- OpenText LoadRunner
- OpenText ALM
- OpenText Octane
- JIRA
- Visual Studio
- Confluence
- ServiceNow
- Salesforce
- SAP
- Agile
- Scrum
- DevOps
- CI/CD