Client: Supply Ontario – RQ00822
We are seeking an experienced
Systems Testing/QA Specialist – Senior (QA Lead) with extensive experience in quality assurance, manual and automated testing, and AI-assisted testing for large-scale applications. The ideal candidate will have hands-on experience developing AI-powered QA agents using agentic AI, Large Language Model (LLM) technologies, and chatbot applications to create and execute test cases. The successful candidate will lead testing activities throughout the software development lifecycle, design and manage comprehensive test plans, validate application functionality and performance, oversee defect resolution, and ensure alignment with business requirements and quality standards across web-based, mobile, cloud-based, and AI-enabled systems.
Role Snapshot
- Job Title: RQ00822 – Systems Testing/QA Specialist – Senior
- Client: Supply Ontario
- Work Location: Metro Hall, 55 John Street, Toronto, Ontario, Canada
- Work Arrangement: Hybrid – Up to 3 Days Onsite, Subject to Hiring Manager’s Discretion
- Start Date: December 15, 2026
- End Date: June 14, 2027
- Business Days: 130.00
- Anticipated Duration: 6 months
- Hours: 7.25 hours per day, 5 days per week
- Public Sector Experience: Preferred
Must Have
- Minimum of 3 years of solid experience in AI-assisted testing, with hands-on experience developing AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Extensive hands-on experience with all layers of testing, including UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing (UAT), across web-based, mobile, and cloud platforms.
- Proven ability to execute AI testing activities using specialized tools such as Deep Eval, Alditols, Prompt foo, Solai, Reflect AI, Agentic AI, Copilot Studio Kit, and similar tools.
Description
Qualifications
The Quality Assurance Specialist (QA Lead) is responsible for performing application testing tasks and Quality Assurance activities, including Functional Testing, Automation Testing, and various AI testing activities as described below.
The Quality Assurance Specialist (QA Lead) will participate in planning and estimating the activities required to test new solutions and enhanced applications. The specialist will participate in developing Master Test Plans, Test Cases, Test Scripts, Test Completion Reports, and other testing documentation while providing advice to business users on developing Test Cases for User Acceptance Testing.
The specialist will execute tests as required and perform issue tracking and resolution.
The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability and ensure alignment with business requirements and quality standards.
Key Responsibilities
- Quality Assurance Leadership
- Lead testing efforts for assigned projects, including planning, coordination, execution, and oversight of QA activities.
- Assess risks to quality based on verification and validation results and provide recommendations for mitigation.
- Implement and maintain quality processes that support development and production change management.
- Test Design and Planning
- Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.
- Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.
- Collaborate with development leads and business analysts to design and create test data to support test execution.
- Test Execution and Management
- Perform various types of testing manually and/or using automation tools, including:
- Functional Testing
- Regression Testing
- Integration Testing
- Usability/Accessibility Testing
- Performance Testing
- Perform the following types of AI testing activities:
- Functional AI Testing
- Response Accuracy Testing
- Hallucination Testing
- Prompt Testing
- AI Security and Privacy Testing, including prompt injection
- AI Safety Testing, including inappropriate behaviours
- Execute test cycles, monitor progress, and manage defect resolution and issue tracking.
- Maintain detailed records of test results and discrepancies using designated QA tools.
- Coordination and Collaboration
- Work closely with project managers, implementation teams, system administrators, architects, vendors as needed, and database administrators to ensure testing activities align with project timelines and technical requirements.
- Lead and assist business users in conducting User Acceptance Testing (UAT), providing guidance and support as needed.
- Reporting and Communication
- Manage the full-cycle process of documenting and communicating test discrepancies and defects to appropriate stakeholders.
- Provide regular updates on testing progress, issues, and outcomes to project teams and management.
- Develop and build a Test Completion Report summarizing all testing activities and results for gating purposes.
Assignment Duties
- Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Minimum of 3 years of solid experience in AI-assisted testing, with hands-on experience developing AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
- Experience using AI tools to increase testing coverage, perform negative testing and regression testing, and apply knowledge of AI-assisted automation for CI/CD pipelines.
- Experience leading and coordinating testing activities in collaboration with project teams, with a strong understanding of various delivery methodologies, including SDLC Waterfall, Agile (Scrum), Hybrid, and DevOps.
- Certification in Software Quality Engineering or an equivalent credential is considered a strong asset.
- Excellent analytical skills in business processes, information systems, information management, and web UI design and accessibility.
- Strong written and verbal communication skills, with the ability to collaborate effectively across multidisciplinary teams.
Technical Capabilities
- Extensive hands-on experience with all layers of testing, including UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing, across web-based, mobile, and cloud platforms.
- Proven ability to execute AI testing activities using specialized tools such as Deep Eval, Alditols, Prompt foo, Solai, Reflect AI, Agentic AI, Copilot Studio Kit, and similar tools.
- Skilled in implementing automated testing using tools such as Micro Focus UFT, TOSCA, Selenium, and Cucumber, as well as conducting performance testing with JMeter and OpenText Load Runner.
- Experience with platforms such as ServiceNow, Salesforce, SAP, or equivalent platforms is considered an asset.
- Strong experience executing test cycles, analysing results, and managing the full defect lifecycle using tools such as OpenText ALM, OpenText Octane, JIRA, Visual Studio, Confluence, and similar tools.
- Demonstrated capability in analysing business requirements and user stories to design test scenarios, develop test cases and scripts, prepare test data, and assess results for quality assurance.
Deliverables
Key Deliverables
- Design and deliver detailed manual and automated test plans, test cases, and test scripts aligned with business requirements and project objectives.
- Perform various testing types, including functional, regression, integration, system, performance, usability, and User Acceptance Testing (UAT), across multiple platforms and environments. Report and document results accordingly.
- Maintain accurate records of test discrepancies and defects using designated QA tools and provide timely reports and recommendations to stakeholders.
- On an as-needed basis, develop and implement automated testing frameworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium, Cucumber, and similar tools.
- On an as-needed basis, conduct load and stress testing using tools such as Load Runner or JMeter and deliver performance analysis reports with actionable insights.
- Collaborate with business analysts and developers to create and manage test data and scenarios that support robust validation of business processes.
- Support the implementation of quality assurance processes and contribute to the continuous improvement of testing practices within Agile, DevOps, and traditional environments.
Additional Terms and Working Conditions
- Anticipated Duration: 6 months.
- Location: Up to 3 days onsite, subject to the Hiring Manager’s discretion.
- Public Sector Experience: Preferred.
How to Apply
If you are interested and your profile matches the requirements, kindly send the following mandatory documents to
hrsmss@smsoftconsulting.com by
Monday, October 19, 2026, at 10:00 AM EST.
Mandatory Documents
- Updated Resume in Word format (Mandatory)
- Skills Matrix and References (Mandatory)
- Expected Hourly Rate (Mandatory)
- Visa Status (Mandatory)
- LinkedIn ID (Mandatory)
Without the mandatory documents, we cannot submit a candidate.
Please note that the original job request also specifies the following documents: Updated Resume in Word format, Expected Hourly Rate, and Qualification Matrix. Please ensure that all applicable submission requirements are met.
Please use the
Apply Online option on our career site to apply for this opportunity.
WhatsApp Group
For daily job updates, you can also join our WhatsApp group using the link below:
Join our WhatsApp Group
Email is the best way to reach us. 
