The role focuses on testing Generative AI components including LLMs, RAG, and Agentic AI. Responsibilities include API testing and implementing test automation frameworks.

Requirements

Candidates must be proficient in Python-based automation using PyTest or Robot Framework. Expertise in LLM evaluation, prompt-injection, and hallucination testing is required.

Experience

5 to 10 years

Working hours

40 hours per week

Job type

Contract

Work arrangement

Hybrid

Days in the office

Skills

GenAI Testing
LLM
RAG
Agentic AI
Python
API Testing
Test Automation
PyTest
Robot Framework
LLM Evaluation
Prompt-injection Testing
Hallucination Testing
CI/CD
Observability

Visa sponsorship

Not detected in the job text

Hiring contact

Parthasarathy K

Hiring contact email

[email protected]

Keywords

GenAI
LLM
RAG
Agentic AI
API
Test Automation
Python
PyTest
Robot Framework
Prompt-injection
Hallucination Testing
CI/CD
Observability
Banking
Information Technology

Original job description

GenAI Test Engineer

Location: Hybrid 4 days – Halifax, NS

Duration: 6+ Months

Job Description/ Responsibilities

GenAI Testing: LLM, RAG, Agentic AI, API and Test Automation

What are the top 3 skills required for this role?

GenAI, LLM, RAG and agentic AI testing

Python-based API and test automation, including PyTest or Robot Framework

LLM evaluation, prompt-injection and hallucination testing, CI/CD and observability

Authorization: Applicants must be legally authorized to work in Canada.

Regards,

_______________________

Parthasarathy K

Lead Recruiter

Work: 972-474-8787 Ext: 306,Direct: 972-737-8607

[email protected]

Themesoft Inc |Themesoft Jobs

Apply by Oct 15, 2026

Apply About employer

Report this job