QA Automation Engineer - AI Solutions

Job Description

On behalf of our client, Affinity is seeking an experienced QA Automation Engineer – AI Solutions to support the testing and quality assurance of a growing portfolio of AI-enabled applications.

You will act as a critical quality gate between development and business User Acceptance Testing (UAT), ensuring applications function as intended across the user interface, underlying data and business logic before they reach business users.

You will work closely with internal developers and external vendor teams, taking business and solution requirements and translating them into effective testing strategies, detailed test cases and reusable automated regression coverage.

While previous experience testing AI or Large Language Model (LLM) applications is valuable, deep AI testing experience is not required. We are primarily looking for a strong QA Automation Engineer with hands-on Playwright, data validation and regression automation experience who is interested in working with AI solutions and helping evolve how these applications are tested.

This is also an opportunity for someone who wants to push beyond traditional QA. Over time, you will have the opportunity to explore how AI itself can be used to automate and accelerate testing, including contributing to the evolution of AI-driven testing capabilities.

What You’ll Do

• Perform end-to-end testing of AI-enabled applications across the UI, data and business-logic layers.
• Review business and solution requirements and translate them into clear, comprehensive test scenarios and test cases.
• Perform a combination of automated, functional and exploratory testing, identifying defects, edge cases and unexpected behaviors before solutions progress to business UAT.
• Build, maintain and enhance automated tests using Playwright.
• Develop and maintain reusable automated regression test suites that can be executed across applications and future releases.
• Validate that application data and outputs are accurate and consistent with expected business rules and requirements.
• Understand application data flows at an architectural level and use that understanding to identify potential quality issues.
• Test AI/LLM-enabled applications where outputs may not always be completely deterministic.
• Help establish practical approaches for assessing the accuracy, consistency and reliability of AI-generated outputs.
• Identify UI defects and usability issues that could negatively affect the end-user experience.
• Work closely with developers to identify, reproduce, document and resolve defects.
• Collaborate with internal development teams, vendors and business stakeholders throughout the testing lifecycle.
• Reduce the amount of testing currently performed by developers by establishing repeatable and efficient QA practices.
• Contribute to the ongoing improvement of existing test automation frameworks and, where required, assist with the development of additional automation capabilities.
• Explore the use of AI-assisted testing to improve test-case generation, test coverage and overall QA efficiency.
• Help evolve the testing function toward increased automation, including the longer-term use of AI agents and AI-driven testing approaches.
• Continuously look for opportunities to improve test coverage, reduce repetitive manual effort and identify issues earlier in the software development lifecycle.
  
  

What You Bring

Required Skills & Experience

• Strong professional experience in QA automation / software testing, ideally within complex enterprise application environments.
• Hands-on experience using Playwright for automated application testing.
• Demonstrated experience developing and maintaining automated regression test suites.
• Strong understanding of QA methodologies, testing strategies and software development lifecycles.
• Experience translating business and functional requirements into detailed test cases and testing scenarios.
• Experience performing both automated and hands-on functional/exploratory testing.
• Experience validating application data and ensuring outputs align with expected business rules.
• Sufficient understanding of application and data architecture to follow how data moves through a solution and identify where issues may occur.
• Ability to test across multiple application layers rather than focusing exclusively on UI testing.
• Strong analytical and problem-solving skills, with an ability to identify edge cases and scenarios that may not be immediately obvious from the requirements.
• Experience working collaboratively with software developers and technical teams to investigate and resolve defects.
• Strong written and verbal communication skills, including the ability to clearly document defects, test cases and testing results.
• A continuous-improvement mindset with an interest in making testing increasingly scalable, repeatable and automated.
  
  

Top Skills Necessary

• Strong QA Automation Engineering experience - 5+ years of experience designing, developing, and executing automated testing for enterprise applications.
• Hands-on Playwright experience – 2+ years of experience utilizing Playwright including building and maintaining automated test cases and validating application functionality across the user interface and business logic.
• Strong regression automation experience - 5+ years of experience developing, maintaining, and enhancing reusable automated regression test suites that support repeatable testing across releases.
• Data validation and end-to-end testing experience - 5+ years of experience demonstrating the ability to understand and test application data flows and verify that data, system outputs, and business rules are accurate.
  
  

Affinity Earn

Know someone who’s great for this, or any of our open roles? Earn up to $4,000/year for each successful referral through Affinity Earn. You can also earn up to $50,000 for helping us find new clients. Learn about our referral program at https://affinity-group.ca/earn/ or browse our jobs & follow us at https://www.linkedin.com/company/affinity-staffing/jobs/

About Affinity

Affinity Group is a technology and business consulting and services company. We believe in creating long term relationships between clients and consultants that foster a mutually beneficial partnership. Affinity is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided on the basis of qualifications, merit and business need.

For more information on Affinity, please visit www.affinity-group.ca

Job Number: 14053