Regression Test Engineer with AI/ML
- Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Original job description
Title- Regression Test Engineer with AI/ML
Location- Canada
Contract
Job Description:
We are looking for an experienced AI Automation Engineer to pilot an agent-driven regression-testing framework for Model Factory test cases. The role will focus on reducing manual effort in test-case creation and maintenance by leveraging Python, automated testing, LLMs, agent workflows, and RAG to generate, execute, validate, and report regression tests.
Key Responsibilities
- Design and develop an AI-driven framework to automate regression testing for Model Factory applications.
- Use Python and test automation frameworks to generate, recommend, and maintain high-value regression test cases.
- Build LLM-powered agents and RAG workflows to analyze requirements, existing test cases, and application behavior.
- Execute and validate tests in lower environments, comparing expected versus actual results.
- Integrate automated testing workflows into CI/CD pipelines for continuous regression testing.
- Leverage AWS services to support scalable test execution and automation.
- Generate actionable test reports highlighting failures, discrepancies, coverage gaps, and potential defects.
- Collaborate with development, QA, and DevOps teams to improve test coverage and reduce manual testing effort.
Required Skills
- Strong hands-on experience with Python and automated testing.
- Experience with regression testing, test-case generation, and test automation frameworks.
- Knowledge of LLMs, AI agents, RAG, and AI-driven workflow automation.
- Experience with CI/CD pipelines and AWS cloud services.
- Strong understanding of test validation, result comparison, defect reporting, and software quality practices.
Preferred Skills
- Experience building agentic AI solutions for software testing.
- Familiarity with Model Factory or ML model lifecycle testing.
- Experience integrating AI-powered automation into enterprise development workflows.
Ideal Candidate: A hands-on Python automation engineer with experience in AI/LLM agent workflows, AWS, and CI/CD, capable of building intelligent regression-testing solutions that minimize manual test design and maintenance.
Nitesh Jaiswal | Tekgence Inc
Linkedin:- linkedin.com/in/nitesh-ch-a378b5222
Direct: 469-421-5604 , Ext- 218 • nitesh.j@tekgence.com
6655 Deseo Dr, Suite 104,Irving, TX , 75039 • www.tekgence.com
More about this job
Responsibilities
Design and build an AI-driven regression-testing framework using Python, automated testing, LLM agents, and RAG to generate, execute, validate, and maintain test cases. Integrate testing into CI/CD and AWS workflows, report failures and coverage gaps, and collaborate with development, QA, and DevOps teams to reduce manual effort.
Requirements
Requires strong hands-on Python and test automation experience, including regression testing, test-case generation, validation, and defect reporting. Candidates should know LLMs, AI agents, RAG, CI/CD, and AWS; experience with agentic testing solutions or Model Factory and ML lifecycle testing is preferred.
Skills
- Python
- Automated Testing
- Regression Testing
- Test-Case Generation
- Test Automation Frameworks
- Large Language Models
- AI Agents
- Retrieval-Augmented Generation
- CI/CD Pipelines
- AWS
- Test Validation
- Defect Reporting
- Software Quality
- Agentic AI
- Model Lifecycle Testing
Visa sponsorship
Not detected in the job text
Hiring contact
Nitesh Jaiswal
Hiring contact email
nitesh.j@tekgence.com
Categories
- Technology
- Software
- Engineering
- Data & Analytics
Keywords
- Python
- Regression Testing
- Test Automation
- Test-Case Generation
- Model Factory
- Large Language Models
- AI Agents
- Agent Workflows
- Retrieval-Augmented Generation
- RAG
- CI/CD
- AWS
- Cloud Services
- Test Validation
- Expected-versus-Actual Comparison
- Defect Reporting
- Test Coverage
- Software Quality
- ML Model Lifecycle Testing
- Continuous Regression Testing
- Lower Environments
- QA
- DevOps