Closed listing
Senior Quality Engineer - AI
- Toronto, ON, Canada
Full-time
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Full-time
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Required Skills:
- 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
- 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
- 5+ years of experience building and maintaining test automation frameworks.
- Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
- Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
- Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
- Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
- Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
- Ability to create effective test data and evaluation datasets for AI-driven functionality.
- Strong analytical, problem-solving, communication, and technical documentation skills.
- Ability to work effectively in a fast-paced, cross-functional Agile environment.
More about this job
Responsibilities
Build and maintain test automation frameworks, and test functional and non-functional requirements across APIs, integrations, databases, microservices, and regression suites. Evaluate AI-powered applications and features for quality, including accuracy, relevance, grounding, toxicity, bias, hallucinations, and response consistency, using effective test data and evaluation datasets.
Requirements
Requires at least five years of relevant quality engineering, quality assurance, test automation, or software development experience, including five years of programming and test automation framework experience. Candidates should have hands-on experience with automation and testing tools, testing methodologies, AI quality evaluation, and strong analytical, communication, and documentation skills, and be effective in a fast-paced Agile environment.
Skills
- Quality Engineering
- Quality Assurance
- Test Automation
- Java
- Python
- Groovy
- Selenium
- Cucumber/Gherkin
- Playwright
- RestAssured
- API Testing
- AI and Machine Learning Testing
- Test Automation Frameworks
- JUnit
- TestNG
- JMeter
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
- Data & Analytics
Keywords
- Quality Engineering
- Quality Assurance
- Test Automation
- Java
- Python
- Groovy
- Selenium
- Cucumber
- Gherkin
- Playwright
- RestAssured
- JUnit
- TestNG
- qTest
- ReadyAPI
- JMeter
- TDD
- ATDD
- BDD
- Continuous Testing
- Risk-Based Testing
- API Testing
- Microservices
- Regression Testing
- Artificial Intelligence
- Machine Learning
- Prompt Evaluation
- Grounding
- Hallucination Detection
- Agile