Systems Testing/QA Specialist

Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Apply by: Nov 13, 2026
Posting language: English
Posted: Oct 14, 2026

Original job description

Position Overview

The Senior Systems Testing/QA Specialist (QA Lead) is responsible for planning, coordinating, executing, and overseeing quality assurance activities for application delivery. The role covers functional and automated testing, performance and accessibility testing, and specialized testing of AI-enabled systems. The successful candidate will help ensure solutions meet business requirements, technical expectations, and quality standards.

Key Responsibilities Quality Assurance Leadership

Lead testing activities for assigned projects, including planning, coordination, execution, and oversight.
Assess quality risks based on verification and validation results and recommend mitigation strategies.
Implement and maintain quality processes supporting development and production change management.

Test Design and Planning

Develop master test plans, test plans, test cases, test scripts, and test completion reports.
Design manual and automated tests, including functional, system, regression, integration, load, and performance scenarios.
Work with development leads and business analysts to prepare suitable test data.
Advise and support business users in developing User Acceptance Testing (UAT) test cases.

Test Execution and Management

Execute functional, regression, integration, usability/accessibility, performance, and other required tests manually and/or using automation tools.
Conduct AI testing, including functional AI testing, response accuracy, hallucination testing, prompt testing, AI security and privacy testing (including prompt injection), and AI safety testing for inappropriate behaviours.
Manage test cycles, monitor progress, track issues, coordinate defect resolution, and maintain detailed test results and discrepancy records.

Coordination and Collaboration

Coordinate with project managers, implementation teams, system administrators, architects, vendors, and database administrators to align testing with timelines and technical requirements.
Lead or support business users during UAT and provide guidance as required.

Reporting and Communication

Document and communicate defects and test discrepancies to relevant stakeholders throughout the testing lifecycle.
Provide regular updates on testing progress, issues, and outcomes to project teams and management.
Prepare a Test Completion Report summarizing testing activities and results for project gating decisions.

Required Qualifications and Experience

Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
10+ years of experience testing large-scale applications, including on-premises web solutions, cloud-based integrations, and mobile platforms.
At least 3 years of hands-on AI-assisted testing experience, including developing AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
Experience using AI tools to improve test coverage, negative testing, and regression testing, with knowledge of AI-assisted automation for CI/CD pipelines.
Experience leading and coordinating testing activities with project teams and a strong understanding of SDLC delivery approaches, including Waterfall, Agile/Scrum, Hybrid, and DevOps.
Strong analytical skills across business processes, information systems, information management, web UI design, and accessibility.
Excellent written and verbal communication skills and the ability to work effectively with multidisciplinary teams.
Certification in Software Quality Engineering or an equivalent credential is considered an asset.

Technical Capabilities

Hands-on experience across UI, integration, regression, performance, AI-enabled systems, and UAT testing for web, mobile, and cloud platforms.
Experience with AI testing tools and technologies such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and Copilot Studio Kit.
Automated testing experience with Micro Focus UFT, TOSCA, Selenium, and Cucumber.
Performance testing experience with JMeter and OpenText LoadRunner.
Experience with defect and test management tools such as OpenText ALM, OpenText Octane, JIRA, Visual Studio, and Confluence.
Experience with ServiceNow, Salesforce, SAP, or equivalent platforms is considered an asset.
Ability to analyze business requirements and user stories, design test scenarios, develop test cases and scripts, prepare test data, and assess results.

Key Deliverables

Develop detailed manual and automated test plans, test cases, and test scripts aligned with business requirements and project objectives.
Execute functional, regression, integration, system, performance, usability, and UAT testing across platforms and environments; document and report results.
Maintain accurate records of defects and test discrepancies using designated QA tools and provide timely reports and recommendations.
As needed, develop and implement automated testing frameworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium, and Cucumber.
As needed, conduct load and stress testing using LoadRunner or JMeter and provide performance analysis reports with actionable recommendations.
Collaborate with business analysts and developers to create and manage test data and scenarios for robust business-process validation.
Support QA processes and continuous improvement across Agile, DevOps, and traditional delivery environments.

Must-Have Requirements

3+ years of solid AI-assisted testing experience, including hands-on development of AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications.
10+ years of testing experience with large-scale applications across on-premises web solutions, cloud integrations, and mobile platforms.
Extensive hands-on testing experience across UI, integration, regression, performance, AI-enabled systems, and UAT for web, mobile, and cloud platforms.
Practical experience with AI testing tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and/or Copilot Studio Kit.

Apply About employer

More about this job

Responsibilities

Lead and coordinate quality assurance activities, including test planning, manual and automated execution, AI-system testing, defect management, and support for user acceptance testing. Report testing progress and outcomes, coordinate with multidisciplinary project teams, and provide recommendations to improve quality and manage risks.

Requirements

Requires 10+ years of experience testing large-scale applications across on-premises web, cloud-integrated, and mobile platforms, including extensive hands-on testing across functional, integration, regression, performance, AI-enabled systems, and UAT. Requires at least 3 years of AI-assisted testing experience involving AI-powered QA agents, agentic AI, LLMs, or chatbots, plus a post-secondary degree in computer science, electronic engineering, or a related discipline.

Skills

Quality Assurance Leadership
Manual Testing
Automated Testing
AI-Assisted Testing
Agentic AI
Large Language Models
Functional Testing
Regression Testing
Integration Testing
Performance Testing
Accessibility Testing
User Acceptance Testing
Test Planning
Defect Management
Test Automation
SDLC

Visa sponsorship

Not detected in the job text

Keywords

Quality Assurance
Software Testing
AI-Assisted Testing
Agentic AI
Large Language Models
Chatbot Applications
DeepEval
Applitools
Promptfoo
SaolaAI
Reflect AI
Copilot Studio Kit
Micro Focus UFT
OpenText UFT
Selenium
Cucumber
JMeter
OpenText LoadRunner
OpenText ALM
OpenText Octane
JIRA
Visual Studio
Confluence
ServiceNow
Salesforce
SAP
Agile
Scrum
DevOps
CI/CD

Report this job