Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

IT Services and IT Consulting · Canada

Website

Open jobs in Canada

Email me new jobs Save this search

Added 17 hours ago
AI
Chatbot Content Developer - Python/Java, AI
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 17 hours ago
AI
QA Guidewire Functional Tester
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Markham, ON
- Full-time
Added 18 hours ago
AI
Software Development Engineer in Test – GenAI / LLM
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 19 hours ago
AI
Senior AI Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 20 hours ago
AI
Cloud Platform Engineer – Azure, AWS, or GCP
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Calgary, AB
- Full-time
Added 20 hours ago
AI
Bilingual IT Support Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Mirabel, QC
- Full-time
Added 20 hours ago
AI
Cloud Security Engineer – Azure, Aws & Gcp
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
Added 20 hours ago
AI
ForgeRock Developer - IAM, SSO, OAuth 2.0 & OIDC
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
Added 20 hours ago
AI
IAM Engineer - Ping Identity, ForgeRock DS
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
Added 22 hours ago
AI
Senior Forward Deployed AI Engineer (Python, Data & GenAI)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 2 days ago
AI
Bilingual IT Recruitment Specialist
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
Added 2 days ago
AI
Chatbot Content Developer - Python/Java, AI
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 2 days ago
AI
Data & Analytics Solutions Architect - AI platforms, AWS, Databricks
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 2 days ago
AI
Data & Analytics Leader - BFSI, AI Transformation
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 2 days ago
AI
Adobe Site Reliability Engineer - Content Delivery Network
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 2 days ago
AI
Cyber Security Analyst
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Calgary, AB
- Full-time
Added 2 days ago
AI
Business System Analyst - Cybesecurity
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Calgary, AB
- Full-time
Added 2 days ago
AI
Product Support Analyst - Enterprise Applications
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Calgary, AB
- Full-time
Added 3 days ago
AI
Bilingual IT Support Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Mirabel, QC
- Full-time
Added 5 days ago
AI
Java Fullstack Developer – AWS & Capital Markets
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 6 days ago
AI
Automation Engineer- CMDB/Asset Management, Python, REST APIs
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Calgary, AB
- Full-time
Added 6 days ago
AI
Senior Site Reliability Engineer - AEM - Content Delivery Network
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 6 days ago
AI
Telecom Civil/Structural Drafter – 5G, Telecom Infrastructure & OIQ
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Montreal, QC
- Full-time
Added 7 days ago
AI
Site Reliability Engineer – Azure Operations, Databricks Support & Incident Response
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Added 7 days ago
AI
GCP Infrastructure & Cloud SRE Engineer
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Software Development Engineer in Test – GenAI / LLM

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 14, 2026
Posting language: English
Posted: Oct 15, 2026

Original job description

Software Development Engineer in Test – GenAI / LLM

Role Description

Work Arrangement: 1 day onsite per week

Experience Required: 6–8 years

Key Roles & Responsibilities

Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Create and execute test scenarios, test cases, and regression test suites.
Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Perform chatbot conversation analysis and recommend quality improvements.
Develop and maintain test automation for chatbot validation where possible.
Work closely with developers, AI engineers, and content teams to resolve defects.
Track, document, and report defects, test results, and quality metrics.
Support UAT, release validation, and production quality monitoring.

Key Skillsets

5 years of strong QA SDET test automation experience.
Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.
Knowledge of prompt engineering concepts.
Experience with Jira, Confluence, GitHub, and Agile delivery.
Experience with API testing and automation frameworks.
Strong analytical and troubleshooting skills.
Experience with Python, Selenium, Playwright, PyTest, or similar tools.
Strong communication and documentation skills.

Essential Skills

QA SDET and test automation.
AI, LLM, GenAI, chatbots, and conversational platforms.
Prompt engineering concepts.
API testing and automation frameworks.
Python, Selenium, Playwright, or PyTest.
Jira, Confluence, GitHub, and Agile delivery.
Analytical and troubleshooting skills.
Communication and documentation skills.

Desirable Skills

Digital: Python
Digital: Chatbots / Conversational Agents
Generative AI – Quality Engineering

Apply About employer

More about this job

Responsibilities

Validate chatbot responses for accuracy, relevance, completeness, and consistency; create and execute test scenarios, cases, and regression suites; and identify hallucinations, defects, formatting issues, and knowledge gaps. Develop chatbot test automation, collaborate with development, AI, and content teams to resolve issues, report quality metrics, and support UAT, release validation, and production monitoring.

Requirements

Requires 6–8 years of experience, including strong QA SDET and test automation experience, plus experience testing AI, LLM, GenAI, chatbot, or conversational platforms. Candidates should know prompt engineering, API testing, Python and relevant automation tools, Jira, Confluence, GitHub, and Agile delivery, and have strong analytical, troubleshooting, communication, and documentation skills.

Skills

Quality Assurance
Test Automation
Generative AI
Large Language Models
Chatbot Testing
Prompt Engineering
API Testing
Python
Selenium
Playwright
PyTest
Jira
Confluence
GitHub
Agile Delivery

Visa sponsorship

Not detected in the job text

Keywords

Quality Assurance
Test Automation
Generative AI
Large Language Models
Chatbots
Virtual Assistants
Conversational Platforms
Prompt Engineering
API Testing
Python
Selenium
Playwright
PyTest
Jira
Confluence
GitHub
Agile Delivery
Regression Testing
Test Scenarios
Test Cases
Chatbot Conversation Analysis
Hallucination Detection
User Acceptance Testing
Release Validation
Production Quality Monitoring
Defect Tracking
Quality Metrics

Report this job