Back to results

Quality Engineering Lead - AI Assurance Chatbot Tester

  • Toronto, ON, Canada

Full-time

Applications open in a new tab.

Job details

Job type
Full-time
Apply by
Education
Bachelor’s degree
Posting language
English
Posted

Original job description

Infosys is seeking an AI Assurance Chatbot Tester to validate, test, and assure the quality, reliability, security, and accuracy of AI-powered chatbot solutions. The role involves functional testing, conversational testing, prompt validation, response accuracy verification, API and workflow validation, and identification of risks such as hallucinations, bias, prompt injection vulnerabilities, and compliance issues. The candidate will collaborate with AI engineers, developers, and business stakeholders to improve chatbot quality while supporting Responsible AI and AI governance initiatives.

Required Qualifications

  • Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
  • 4 years of Information Technology experience.
  • Candidate must be located within commuting distance of Mississauga, ON / Montreal, QC or be willing to relocate to one of these areas. This position may require travel.
  • At least 4 years of software testing experience.

Required Skills

  • Functional Testing and Quality Assurance processes.
  • AI chatbot testing, conversational testing, and user experience validation.
  • Response accuracy, relevance, and completeness validation.
  • Positive, negative, boundary, and edge-case testing.
  • Generative AI, LLMs, and chatbot platforms.
  • API testing using Postman or similar tools.
  • Integration and end-to-end testing of chatbot workflows.
  • Hallucination detection and response consistency validation.
  • Prompt injection testing and AI security validation.
  • Bias identification and AI risk validation.
  • Security, privacy, and regulatory compliance validation.
  • Test management and defect tracking using Jira, Azure DevOps, or similar tools.
  • Defect reporting, quality metrics, and test reporting.
  • Collaboration with AI engineers, developers, and business stakeholders.
  • Analytical, communication, and problem-solving skills.

Preferred Skills

  • AI Assurance.
  • Responsible AI.
  • AI Risk Management.
  • Copilot testing.
  • ChatGPT testing.
  • Gemini testing.
  • Enterprise AI assistant testing.
  • Prompt engineering.
  • AI security concepts.
  • Playwright automation.
  • Selenium automation.

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.

Estimated annual compensation range for the candidate based in the below location will be:

Ontario: $ 83150 to $ 123375

About Us

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO

Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
More about this job

Responsibilities

Test AI-powered chatbots for functionality, conversational quality, response accuracy, reliability, security, and compliance. Identify AI risks and collaborate with engineers, developers, and business stakeholders to improve chatbot quality and support Responsible AI and governance initiatives.

Requirements

Requires at least four years of IT and software testing experience, with skills in functional QA, chatbot and LLM testing, API and workflow validation, and AI risk and security assessment. A bachelor's degree or foreign equivalent is required, though progressive specialty experience may substitute for education; candidates must be authorized to work in Canada without employer-sponsored immigration.

Skills

  • Functional Testing
  • Quality Assurance
  • AI Chatbot Testing
  • Conversational Testing
  • User Experience Validation
  • Response Accuracy Validation
  • Generative AI
  • Large Language Models
  • API Testing
  • Integration Testing
  • End-to-End Testing
  • Hallucination Detection
  • Prompt Injection Testing
  • AI Security Validation
  • Bias Identification
  • Test Management

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Software
  • Engineering
  • Security & Safety
  • Management & Leadership

Keywords

  • Functional Testing
  • Quality Assurance
  • AI Assurance
  • Chatbot Testing
  • Conversational Testing
  • Generative AI
  • Large Language Models
  • Prompt Validation
  • Prompt Engineering
  • API Testing
  • Postman
  • Integration Testing
  • End-to-End Testing
  • Hallucination Detection
  • Prompt Injection
  • Responsible AI
  • AI Governance
  • AI Risk Management
  • AI Security
  • Bias Identification
  • Regulatory Compliance
  • Jira
  • Azure DevOps
  • Playwright
  • Selenium
  • Copilot
  • ChatGPT
  • Gemini
  • Defect Tracking
  • Test Reporting

Report this job