Quality Engineer -AI Chatbot Validation
- Brampton, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Description
- 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
- 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
- 5+ years of experience building and maintaining test automation frameworks.
- Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
- Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
- Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
- Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
- Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
- Ability to create effective test data and evaluation datasets for AI-driven functionality.
- Strong analytical, problem-solving, communication, and technical documentation skills.
- Ability to work effectively in a fast-paced, cross-functional Agile environment.
More about this job
Responsibilities
Build and maintain automated test frameworks, and validate AI-powered chatbots, conversational systems, APIs, integrations, databases, microservices, and regression suites. Evaluate AI response quality, including accuracy, relevance, grounding, toxicity, bias, hallucinations, and consistency, while collaborating in an Agile environment.
Requirements
Requires at least five years of experience in quality engineering, quality assurance, test automation, or software development, along with at least five years of programming experience and test automation framework experience. Candidates should have hands-on experience with automation tools and AI or machine learning testing, understand modern testing practices, and demonstrate strong analytical, communication, and documentation skills.
Skills
- Quality Engineering
- Quality Assurance
- Test Automation
- Java
- Python
- Groovy
- Test Automation Frameworks
- AI and Machine Learning Testing
- Chatbot Validation
- Selenium
- Cucumber/Gherkin
- Playwright
- RestAssured
- API Testing
- JUnit
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
Keywords
- Quality Engineering
- Quality Assurance
- Test Automation
- Java
- Python
- Groovy
- Automation Frameworks
- Artificial Intelligence
- Machine Learning
- Chatbots
- Large Language Models
- Generative AI
- Selenium
- Cucumber
- Gherkin
- Playwright
- RestAssured
- JUnit
- TestNG
- qTest
- ReadyAPI
- JMeter
- API Testing
- Microservices
- Regression Testing
- TDD
- ATDD
- BDD
- Continuous Testing
- Risk-Based Testing