Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 1 day ago
AN
DevOps Project Manager – DevOps Delivery, CI/CD & Enterprise Technology
Astra North Infoteck Inc.
Toronto, ON
- Contract
Coordinate delivery across one or more DevOps squads and the infrastructure, cloud, security, application, data, platform, quality-engineering, and support teams required to complete the…
Added 1 day ago
AN
Jira Service Management Developer – Java, Python, AI Automation & REST APIs
Astra North Infoteck Inc.
Toronto, ON
- Contract
Establish testing, monitoring, deployment, rollback, access-control, security, and governance practices for Jira, Java, Python, and AI solutions.
Added 1 day ago
AN
Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM
Astra North Infoteck Inc.
Toronto, ON
- Contract
3–5+ years of hands-on CI/CD, cloud, and platform engineering experience in enterprise environments.
Added 1 day ago
AN
Senior Quality Engineer – Test Automation, AI Testing & Java/Python
Astra North Infoteck Inc.
Toronto, ON
- Contract
5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
Added 1 day ago
AN
DevOps Engineer – GitHub Enterprise, GitHub Actions & CI/CD
Astra North Infoteck Inc.
Toronto, ON
- Contract
2–5+ years of practical experience in software development, DevOps, or systems engineering.
Added 1 day ago
GitHub - Bitbucket Migration Engineer - DevOps, CI/CD & SCM
Astra North Infoteck Inc.
Toronto, ON
MUST Have Skillsets
Added 1 day ago
Security Research Engineer - AI Security, Agentic AI & Emerging Cybersecurity
Astra North Infoteck Inc.
Toronto, ON
Must Have Technical Skills
Added 1 day ago
Solution Architect - Cloud, Distributed Systems, APIs & Agentic AI
Astra North Infoteck Inc.
Toronto, ON
Ensure safe adoption of technology that protects our clients and the organization, considering traditional security best practices and emerging threats.
Added 1 day ago
AN
QA Test Manager – Environment, Application Performance & Security Testing
Astra North Infoteck Inc.
Regina, SK
- Contract
The QA Test Manager orchestrates Test Environment Management (TEM), Application Performance Testing, and Application Security Testing across our insurance IT infrastructure. You will manage…
Added 1 day ago
AN
Power BI Technical Lead
Astra North Infoteck Inc.
Toronto, ON
- Full-time
Hybrid - 3 days in office
Added 1 day ago
AN
Java Backend developer - Java 17, DevSecOps, Kubernetes
Astra North Infoteck Inc.
Montréal, QC
- Contract
Candidate will play a key role in improving the security posture, resilience, and overall health of our platforms. This includes supporting vulnerabilities remediation, reducing technical…
Added 1 day ago
Salesforce Technical Lead- Financial Services Cloud.
Astra North Infoteck Inc.
Toronto, ON
Mentor developers and promote engineering excellence across the delivery team.
Added 1 day ago
AI Project Manager / Product Owner – Enterprise AI, Microsoft Copilot, ChatGPT & Generative AI
Astra North Infoteck Inc.
Montréal, QC
…backlog and delivery roadmap while ensuring delivery quality, security, compliance and measurable business value. This role sits at the intersection of programme leadership, AI product…
Added 1 day ago
Pega Lead Business Architect (LBA)
Astra North Infoteck Inc.
Mississauga, ON
Strong architecture and hands-on design expertise across Pega Platform, case management, application layers, data models, security, and integrations.
Added 1 day ago
Site Reliability Engineer – Azure Operations, Databricks Support & Incident Response
Astra North Infoteck Inc.
Toronto, ON
…readiness and platform support. You will work with platform engineering, security, network, application and data teams to keep services stable, secure and…
Added 1 day ago
AN
GCP Infrastructure & Cloud SRE Engineer.
Astra North Infoteck Inc.
Toronto, ON
- Contract
Implement cloud security, IAM, networking, governance, and compliance controls.
Added 1 day ago
Senior Architect I - Salesforce Commerce Cloud
Groupe Dynamite, Inc Garage
QC
…capabilities for Garage and Dynamite brands. Partnering with engineering managers, product, UX, and DevOps, you translate business vision into scalable, secure, and high-performance…
Added 1 day ago
M
Senior Sales Specialist - Windows and Device Sales
Microsoft
Toronto, ON
- $142,800 to $214,900 CAD / year
- Full-time
- On-site
…partners, to drive Windows platform adoption, strengthen technology security and help customers realize long‑term value from their device and endpoint…
Added 1 day ago
M
Cloud Solution Architect - AI Business Solutions
Microsoft
Toronto, ON · Vancouver, BC · Calgary, AB · Ottawa, ON
- $96,000 to $177,600 CAD / year
- Full-time
- On-site
- Drive and participate in proactive delivery management, spot resiliency and security issues, analyze problems, and provide solutions to meet customer needs.
Added 1 day ago
M
Strategic Account Technology Strategist - Public Sector
Microsoft
Toronto, ON
- $128,000 to $222,400 CAD / year
- Full-time
- On-site
Customer AI and Security Strategy Leadership - Document and articulate the customer’s business objectives, technology landscape and AI and Security strategy.
Added 1 day ago
M
Architecte de solutions cloud - Données et analytique / Cloud Solution Architect - Data & Analytics
Microsoft
Montréal, QC · Québec, QC
- $96,000 to $177,600 CAD / year
- Full-time
- On-site
Added 1 day ago
M
Principal Security Engineer
Microsoft
Vancouver, BC
- $142,400 to $257,500 CAD / year
- Full-time
- On-site
In this role, you will identify and investigate complex security vulnerabilities and novel attack vectors across Windows, develop proof-of-concept exploits, and design durable mitigations…
Added 1 day ago
M
Sales Specialist - Windows and Device Sales
Microsoft
Toronto, ON
- $103,500 to $170,700 CAD / year
- Full-time
- On-site
…partners, to drive Windows platform adoption, strengthen technology security and help customers realize long‑term value from their device and endpoint…
Added 1 day ago
M
AI Workforce Transformation Architect
Microsoft
Canada
- $124,600 to $225,600 CAD / year
- Full-time
- On-site
Added 1 day ago
M
Cowork and Agents Solution Sales Advisor
Microsoft
Goodwood, ON
- $142,800 to $214,900 CAD / year
- Full-time
- On-site
…customer outcomes and business growth. By uniting product, engineering, marketing, sales, customer success, and partners around a common customer mission, we help customers realize value…

Astra North Infoteck Inc.

Senior Quality Engineer – Test Automation, AI Testing & Java/Python

Toronto, ON, Canada

Contract

Apply on astra-north.zohorecruit.ca About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Sep 14, 2026

Original job description

Quality Engineer – Test Automation, Java/Python & GenAI
Roles and Responsibilities:
- Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
- Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
- Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
- Build automated tests for AI-enabled features, including prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
- Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services.
- Establish testing approaches for both deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
- Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
- Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
- Identify, document, prioritize, and track defects through resolution.
- Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
- Collaborate with cross-functional Agile teams to deliver reliable, secure, and user-focused product features.
- Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non-technical stakeholders.
Required Skills:
- 5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
- 5+ years of programming experience with Java, Python, Groovy, or a comparable language.
- 5+ years of experience building and maintaining test automation frameworks.
- Hands-on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
- Experience testing functional and non-functional requirements, APIs, integrations, databases, microservices, and regression suites.
- Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
- Understanding of TDD, ATDD, BDD, continuous testing, and risk-based testing practices.
- Experience testing AI or machine learning-powered applications, APIs, conversational systems, or generative AI features.
- Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
- Ability to create effective test data and evaluation datasets for AI-driven functionality.
- Strong analytical, problem-solving, communication, and technical documentation skills.
- Ability to work effectively in a fast-paced, cross-functional Agile environment.
Nice to Have:
- Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval-augmented generation, embeddings, or model observability.
- Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
- Experience testing cloud-native applications and distributed microservice architectures.
- Experience with security, performance, accessibility, or reliability testing.
- Experience developing automation scripts and reusable testing utilities.
- Experience with Tableau or other analytics and visualization platforms.
- CSTE certification or an equivalent quality engineering certification.
- Experience working directly with DevOps teams to implement automated quality gates and release controls.

Apply on astra-north.zohorecruit.ca About employer

More about this job

Responsibilities

The Senior Quality Engineer at Astra North Infoteck will design and maintain test automation frameworks and write automated tests for both standard and AI-enabled features. They will also work with DevOps and development teams to put quality checks into the release pipeline, track defects and report quality risks to stakeholders.

Requirements

Candidates need 5+ years in quality engineering or test automation and 5+ years of programming in Java, Python or Groovy. They also need hands-on experience with Selenium, Playwright or RestAssured, and experience testing AI or machine learning applications.

Skills

Java
Python
Groovy
Selenium
Cucumber/Gherkin
Playwright
RestAssured
JUnit
TestNG
qTest
ReadyAPI
JMeter
API testing
Regression testing
AI quality evaluation
Prompt evaluation
Hallucination detection
LLM testing
Test data creation
TDD
ATDD
BDD
Risk-based testing
CI/CD integration

Keywords

Test Automation
AI Testing
GenAI
LLM Testing
Java
Python
Groovy
Selenium
Cucumber
Gherkin
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
qTest
CI/CD
Quality Engineer
QA Automation

Seniority

Senior

Tools

Selenium
Cucumber
Playwright
RestAssured
JUnit
TestNG
ReadyAPI
JMeter
qTest
Jenkins

Languages

English

Report this job

Work requirements

Jobs in Canada