Software Engineer in Test
- Toronto, ON, Canada
$40 to $45 CAD / hour · Contract
Applications open in a new tab.
Job details
- Pay
- $40 to $45 CAD / hour
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Title: SDET – AI Chatbot Validation
Location: Toronto, ON
Work Arrangement: Hybrid (1 day/week)
Employment Type: Contract
Rate: CAD 40-45
Domain: BFSI
Application Deadline: Nov. 15th, 2026
Skills:
- Experience testing AI or machine learning-powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
- 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
- 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
- 5+ years of experience building and maintaining test automation frameworks.
- Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
- Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
- Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
- Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
- Ability to create effective test data and evaluation datasets for AI-driven functionality.
- Strong analytical, problem-solving, communication, and technical documentation skills.
- Ability to work effectively in a fast-paced, cross-functional Agile environment.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
More about this job
Responsibilities
Build and maintain test automation frameworks and validate AI-powered chatbots, conversational systems, APIs, integrations, databases, and microservices. Test functional and non-functional requirements, regression suites, and AI response quality, including accuracy, relevance, grounding, toxicity, bias, hallucinations, and consistency.
Requirements
Requires at least five years of relevant quality engineering, quality assurance, test automation, or software development experience, including five years of programming and test automation framework experience. Candidates should have hands-on experience with automation and testing tools, AI quality evaluation, test data creation, testing methodologies, and collaboration in an Agile environment.
Skills
- AI Application Testing
- Chatbot Validation
- LLM Validation
- Test Automation
- Java
- Python
- Groovy
- Selenium
- Cucumber/Gherkin
- Playwright
- RestAssured
- API Testing
- JUnit
- TestNG
- JMeter
- Prompt Evaluation
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Data & Analytics
Keywords
- AI Chatbot Validation
- Artificial Intelligence
- Machine Learning
- Large Language Models
- Generative AI
- Conversational Systems
- Quality Engineering
- Quality Assurance
- Test Automation Frameworks
- Java
- Python
- Groovy
- Selenium
- Cucumber
- Gherkin
- Playwright
- RestAssured
- JUnit
- TestNG
- qTest
- ReadyAPI
- JMeter
- API Testing
- Microservices
- TDD
- ATDD
- BDD
- Continuous Testing
- Risk-Based Testing