Back to results

Senior QA Specialist – AI Testing

  • Toronto, ON, Canada

Contract

Applications open in a new tab.

Job details

Job type
Contract
Apply by
Experience
Minimum 10+ years of experience in software quality assurance and systems testing for large-scale applications.
Posting language
English
Posted

Original job description

Job Title: Senior Systems Testing / QA Specialist – AI Testing

Employment Type: Contract

Duration: June 2027

Location: Toronto

Ideal Rate: $70- $75 (Based on Experience)

Hybrid: 3 days onsite

Must haves:

  • Minimum 10+ years of experience in software quality assurance and systems testing for large-scale applications.
  • Minimum 3 years of hands-on experience in AI-assisted testing, including AI-powered QA agents, agentic AI, LLM technologies, or chatbot applications used to create and execute test cases.
  • Demonstrated experience testing AI-enabled systems, including response accuracy, hallucinations, prompts, AI safety, and AI security.
  • Strong experience in test automation and manual testing across functional, integration, regression, performance, and UAT activities.
  • Experience testing web-based applications, mobile platforms, cloud integrations, and on-premises solutions.
  • Hands-on experience with AI testing tools such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, Copilot Studio Kit, or equivalent solutions.
  • Experience with automation tools such as Selenium, Playwright, Tosca, Micro Focus/OpenText UFT, or Cucumber.
  • Experience with performance testing tools such as JMeter or OpenText LoadRunner.
  • Strong understanding of SDLC, Agile/Scrum, Waterfall, Hybrid, and DevOps methodologies.

Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.

More about this job

Responsibilities

Test large-scale applications and AI-enabled systems using manual and automated approaches across functional, integration, regression, performance, and user acceptance testing. Assess AI response accuracy, hallucinations, prompts, safety, and security across web, mobile, cloud, and on-premises solutions.

Requirements

Requires at least 10 years of software quality assurance and systems testing experience, including at least three years of hands-on AI-assisted testing with AI agents, agentic AI, LLMs, or chatbots. Candidates should have experience with AI testing, automation, and performance tools, and understand SDLC, Agile/Scrum, Waterfall, Hybrid, and DevOps methodologies.

Skills

  • Software Quality Assurance
  • Systems Testing
  • AI-Assisted Testing
  • AI Testing
  • Test Automation
  • Manual Testing
  • Functional Testing
  • Integration Testing
  • Regression Testing
  • Performance Testing
  • User Acceptance Testing
  • Web Application Testing
  • Mobile Testing
  • Cloud Integrations
  • AI Safety and Security
  • Agile/Scrum

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Software
  • Engineering

Keywords

  • Software Quality Assurance
  • Systems Testing
  • AI-Assisted Testing
  • AI-Powered QA Agents
  • Agentic AI
  • Large Language Models
  • Chatbots
  • AI Response Accuracy
  • Hallucinations
  • Prompt Testing
  • AI Safety
  • AI Security
  • Test Automation
  • Manual Testing
  • Functional Testing
  • Integration Testing
  • Regression Testing
  • Performance Testing
  • User Acceptance Testing
  • Web Applications
  • Mobile Platforms
  • Cloud Integrations
  • On-Premises Solutions
  • DeepEval
  • Promptfoo
  • Applitools
  • Selenium
  • Playwright
  • JMeter
  • OpenText LoadRunner

Report this job