Closed listing
Quality Engineer / SDET – AI Chatbot Validation
- Toronto, ON, Canada
Full-time
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Full-time
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Job TitleQuality Engineer (QE) / SDET – AI Chatbot ValidationKey Roles & Responsibilities• Validate chatbot responses for accuracy, relevance, completeness, and consistency.• Create and execute test scenarios, test cases, and regression test suites.• Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.• Perform chatbot conversation analysis and recommend quality improvements.• Develop and maintain test automation for chatbot validation where possible.• Work closely with developers, AI engineers, and content teams to resolve defects.• Track, document, and report defects, test results, and quality metrics.• Support UAT, release validation, and production quality monitoring.Key Skillsets• 5+ Yrs of strong QA / SDET / Test Automation experience.• Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.• Knowledge of prompt engineering concepts• Experience with Jira, Confluence, GitHub, and Agile delivery.• Experience with API testing and automation frameworks.• Strong analytical and troubleshooting skills.• Experience with Python, Selenium, Playwright, PyTest, or similar tools.• Strong communication and documentation skills.
validating chatbot responses
More about this job
Responsibilities
Validate chatbot responses for accuracy, relevance, completeness, and consistency; create and execute test scenarios and regression suites; and identify hallucinations, defects, formatting issues, and knowledge gaps. Analyze conversations, maintain test automation, collaborate with technical and content teams to resolve defects, report quality metrics, and support UAT, release validation, and production monitoring.
Requirements
Requires 5+ years of QA, SDET, or test automation experience, including experience testing AI, LLM, generative AI, chatbot, virtual assistant, or conversational platforms. Candidates should know prompt engineering, API testing, automation frameworks, and tools such as Python, Selenium, Playwright, or PyTest, and have strong analytical, troubleshooting, communication, and documentation skills.
Skills
- Chatbot Validation
- Quality Assurance
- Software Development Test Engineering
- Test Automation
- AI and LLM Testing
- Prompt Engineering
- API Testing
- Python
- Selenium
- Playwright
- PyTest
- Jira
- Confluence
- GitHub
- Agile Delivery
- Defect Tracking
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
- Education
- Government & Public Sector
Keywords
- Quality Engineer
- SDET
- Quality Assurance
- Chatbot Validation
- Artificial Intelligence
- Large Language Models
- Generative AI
- Chatbots
- Virtual Assistants
- Conversational Platforms
- Prompt Engineering
- Test Scenarios
- Test Cases
- Regression Testing
- Test Automation
- Conversation Analysis
- Hallucination Detection
- API Testing
- Python
- Selenium
- Playwright
- PyTest
- Jira
- Confluence
- GitHub
- Agile
- User Acceptance Testing
- Release Validation
- Production Quality Monitoring
- Defect Tracking