Closed listing
QA Engineer – AI/ML | Banking, Payments & FinTech
- Toronto, ON, Canada
Full-time
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Full-time
- Closing date
- Experience
- 8+ years of experience in QA / Software Testing.
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Job Summary
We are looking for a QA Engineer with hands-on experience in AI/ML testing to validate AI/ML-powered applications and solutions. The ideal candidate will have strong QA fundamentals, experience testing AI/ML models and data pipelines, and preferably a background working with Banking, Payments, or FinTech clients.
Key Responsibilities
- Design and execute functional, integration, regression, system, and end-to-end testing for AI/ML applications.
- Develop test strategies and test cases for AI/ML models, data pipelines, APIs, and AI-powered applications.
- Validate model outputs, predictions, recommendations, classifications, and business rules against expected results.
- Perform data validation and data quality testing across training, validation, and production datasets.
- Test AI/ML workflows for accuracy, consistency, reliability, scalability, and performance.
- Validate AI model behavior across different datasets, edge cases, and negative scenarios.
- Perform API and backend testing for AI/ML services and microservices.
- Use SQL/Python for data validation, test automation, and analysis.
- Collaborate with Data Scientists, ML Engineers, Developers, Business Analysts, and Product Owners.
- Identify, document, track, and troubleshoot defects throughout the testing lifecycle.
- Support CI/CD pipelines and automated testing where applicable.
- Participate in Agile ceremonies, test planning, estimation, and release validation.
Required Skills
- 8+ years of experience in QA / Software Testing.
- Hands-on experience testing AI/ML-based applications or solutions.
- Strong understanding of AI/ML concepts, model validation, data testing, and model outputs.
- Experience with Python for test automation, data validation, or scripting.
- Strong SQL/database testing experience.
- Experience with REST API testing using Postman, REST Assured, or similar tools.
- Experience in functional, regression, integration, API, and end-to-end testing.
- Experience with test management and defect tracking tools such as Jira, ALM, or similar.
- Good understanding of Agile/Scrum methodologies.
More about this job
Responsibilities
Design and execute functional, integration, regression, system, and end-to-end tests for AI/ML applications, models, data pipelines, APIs, and services. Validate model outputs and data quality, troubleshoot defects, support automated testing and CI/CD, and collaborate with cross-functional teams throughout Agile planning and release validation.
Requirements
Requires 8 or more years of QA or software testing experience, hands-on testing of AI/ML applications, and a strong understanding of model validation and data testing. Candidates should have Python and SQL experience, REST API testing skills, familiarity with test management and defect tracking tools, and knowledge of Agile/Scrum.
Skills
- AI/ML Testing
- Quality Assurance
- Python
- SQL
- REST API Testing
- Functional Testing
- Regression Testing
- Integration Testing
- End-to-End Testing
- Data Validation
- Model Validation
- Test Automation
- Defect Tracking
- Agile/Scrum
- Banking and Payments
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Data & Analytics
- Finance & Accounting
Keywords
- AI/ML
- Quality Assurance
- Software Testing
- Model Validation
- Data Pipelines
- Data Quality
- Python
- SQL
- REST APIs
- Postman
- REST Assured
- Test Automation
- Functional Testing
- Regression Testing
- Integration Testing
- System Testing
- End-to-End Testing
- API Testing
- Backend Testing
- Microservices
- CI/CD
- Jira
- ALM
- Agile
- Scrum
- Banking
- Payments
- FinTech