Quality Engineer – AI Chatbot Validation
- Toronto, ON, Canada
$40 to $45 CAD / hour · Contract
Applications open in a new tab.
Job details
- Pay
- $40 to $45 CAD / hour
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Title: Quality Engineer – AI Chatbot Validation
Location: Toronto, ON
Work Arrangement: 1 Day onsite
Employment Type: Contract
Domain: BFSI
Pay Rate: CAD 40-45/hr on Incorporated
Application Deadline: Oct 30th, 2026
SKILLS REQUIRED
- 5+ years of experience in Quality Engineering, QA, Software Testing, Test Automation, or Software Development.
- Strong programming skills in Java, Python, Groovy, or equivalent languages, with 5+ years of hands-on experience.
- Experience validating AI/ML applications, GenAI solutions, LLMs, chatbots, conversational AI, and AI-powered APIs.
- Strong hands-on experience with Selenium, Playwright, Cucumber/Gherkin, RestAssured, or comparable automation tools.
- Experience testing APIs, microservices, databases, system integrations, functional/non-functional requirements, and regression testing.
- Proficiency with JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Strong understanding of TDD, BDD, ATDD, Continuous Testing, and Risk-Based Testing practices.
- Experience evaluating AI outputs for accuracy, relevance, grounding, hallucinations, bias, toxicity, consistency, and prompt effectiveness.
- Ability to develop AI evaluation datasets, test scenarios, test data, and automated validation strategies for GenAI applications.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
More about this job
Responsibilities
Validate AI-powered chatbots, LLMs, GenAI solutions, APIs, and related integrations through functional, non-functional, and regression testing. Develop evaluation datasets, test scenarios, test data, and automated strategies to assess AI outputs for accuracy, relevance, grounding, hallucinations, bias, toxicity, consistency, and prompt effectiveness.
Requirements
Requires 5+ years of experience in quality engineering, QA, software testing, test automation, or software development, along with 5+ years of hands-on programming experience in Java, Python, Groovy, or an equivalent language. Candidates should have experience with AI/ML applications and automation tools, API and integration testing, testing frameworks, and practices such as TDD, BDD, ATDD, continuous testing, and risk-based testing.
Skills
- Quality Engineering
- Software Testing
- Test Automation
- Java
- Python
- Groovy
- AI/ML Validation
- Generative AI
- Large Language Models
- Chatbots
- Selenium
- Playwright
- Cucumber/Gherkin
- API Testing
- JUnit
- Risk-Based Testing
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
- Finance & Accounting
Keywords
- Quality Engineering
- Quality Assurance
- Software Testing
- Test Automation
- Java
- Python
- Groovy
- AI/ML
- Generative AI
- Large Language Models
- Chatbots
- Conversational AI
- AI-Powered APIs
- Selenium
- Playwright
- Cucumber
- Gherkin
- RestAssured
- JUnit
- TestNG
- qTest
- ReadyAPI
- JMeter
- TDD
- BDD
- ATDD
- Continuous Testing
- Risk-Based Testing
- API Testing
- Microservices