Find work in Canada.

500,015 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 10 days ago
C
Software Developer Embedded Systems I (Co-op) - Canada
Cisco
Montreal, QC
- Full-time
As an Embedded Systems Software Developer Co-op, you will contribute to the design, enhancement, and testing of foundational software powering Cisco’s networking platforms and intelligent…
Added 10 days ago
R
Lead Agentic AI Engineer
RBC
Toronto, ON
- Full-time
…productivity through agentic AI workflows - bridging business problems with intelligent automation. This is a high-ambiguity, rapid experimentation role where you'll define how vendor…
Added 10 days ago
R
Senior Manager, Engineer & Build
RBC
Toronto, ON
- Full-time
Partner with Platform/SRE on SLIs/SLOs, incident response, and postmortems.
Added 10 days ago
R
Prod Srvc Lead, Client Technology Support– Salesforce CRM
RBC
Toronto, ON
- Full-time
Experience with RHEL Unix / Linux / Windows environments and basic scripting (Perl, Bash, Python, Powershell, batch)
Added 10 days ago
M
Data Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
Experience with programming languages such as Python, SQL, Java, and/or Scala.
Added 10 days ago
E
Agentic AI Optimization Developer
Equifax
Toronto, ON · CAN - Ontario - Toronto
- Full-time
Experience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or…
Added 10 days ago
B
DevOps Engineer - New Grad (January 2027)
BDO
Toronto, ON
- Full-time
Develop automation and scripting using Python, PowerShell, and Azure CLI.
Added 10 days ago
X
Software Developer
Xe.com
Newmarket, ON
- Full-time
…repos are now aligned to faster container-based deployments with CI/CD pipelines. We are increasing the automation of testing and promoting a Shift-Left…
Added 10 days ago
X
Software Developer
Xe.com
Newmarket, ON
- Full-time
…repos are now aligned to faster container-based deployments with CI/CD pipelines. We are increasing the automation of testing and promoting a Shift-Left…
Added 10 days ago
SM
RQ00821 – Solution Architect – CRM – Intermediate
S M Software Solutions Inc
Toronto, ON
- Internship
Customization: Experience with Maximo Business Objects and Web Beans (Java), Automation Scripts (Java, Python, or other scripting languages).
Added 10 days ago
SM
RQ11486 – Data Ops/Cloud Data Engineer – Senior
S M Software Solutions Inc
Toronto, ON
- Internship
Experience with data pipeline and workflow development, orchestration, deployment, and automation, specializing in programming and pipelines to create and manage data flows and data…
Added 10 days ago
B
Director, Data Foundations, Automation & Infrastructure
BMO
Toronto, ON · YNG
- Full-time
As Director, Data Foundations, Automation & Information Infrastructure, you will lead a highly technical team responsible for delivering trusted, curated, and scalable data assets that…
Added 10 days ago
Q
FY27 Intern - Automotive Engineering Internship - Canada (16 months)
Qualcomm
Markham, ON
- Full-time
Experience with scripting languages like Python and CI/CD workflows
Added 10 days ago
SE
Senior Software Engineer II
Schneider Electric
Calgary, AB
- $114,750 to $162,000 CAD / year
- Part-time
…building and operating Generative AI solutions, including agentic automation platforms, product-integrated GenAI capabilities and internal AI applications. The remaining 25% will involve…
Added 10 days ago
M
Senior Software Engineer
Microsoft
Vancouver, BC
- Full-time
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java,…
Added 10 days ago
EC
Développeur(euse) logiciel principal(e) / Lead Software Developer
Eaton Corporation
Brossard, QC
- Full-time
Eaton's Electrical Engineering Services and Systems division is currently seeking a Lead Software Developer. This role is based in our Eaton Americas Innovation Center in Brossard (QC) and…
Added 10 days ago
RB
Senior Site Reliability Engineer
Royal Bank of Canada
Toronto, ON
- Full-time
Collaborate with development teams to ensure applications are designed for reliability, observability, and operational excellence
Added 10 days ago
HR
IT and Odoo Specialist
Haply Robotics
Montreal, QC
- Full-time
Python (for Odoo modules, integration scripts, lightweight automation).
Added 10 days ago
LV
Computer Vision Engineer, FPGA
LUCID Vision Labs, Inc.
Burnaby, BC
- Full-time
…a wide range of industries and applications such as factory automation, medical, life sciences and logistics. Our expertise combines deep industry experience with a passion for product…
Added 10 days ago
AS
Full Stack Java Developer
Apex Systems
Toronto, ON
- $55 to $80 USD / hour
- Contract
We are seeking an Expert Full Stack Developer to design, build, and maintain both front-end interfaces and back-end systems, including APIs, microservices, databases, and cloud deployments.…
Added 10 days ago
R
Senior Site Reliability Engineer
RBC
Toronto, ON
- Full-time
Collaborate with development teams to ensure applications are designed for reliability, observability, and operational excellence
Added 10 days ago
Machine Learning Engineer, Software QA - Creativity Apps
Apple
Vancouver, BC
…from defining evaluation strategy, evaluation scripting and automation, leading all stages of testing, triaging and driving issues to resolution, and ensuring high quality models are…
Added 10 days ago
C
Senior Offensive Security Engineer
Cognizant
Toronto, ON
- Full-time
…This role combines traditional offensive security expertise with AI/LLM security, cloud security, vulnerability management, and security automation. The ideal candidate will conduct web and…
Added 10 days ago
BR
AI Solutions Architect
Benchmark Recruitment
Vancouver, BC · Greater Vancouver Metropolitan Area
- Contract
Working closely with a cross-functional AI software development team, the successful candidate will own the end-to-end solution architecture, from requirements gathering and technical…
Added 10 days ago
KG
Agent & DevOps Platform Engineer
K&K Global Talent Solutions INC.
Toronto, ON
- Full-time
We are looking for an experienced Agent & DevOps Platform Engineer with 5 + years of expertise in AWS, Python, Kubernetes, CI/CD, DevSecOps, and AI/LLM platforms. In this role, you'll build…

Equifax

Agentic AI Optimization Developer

Toronto, ON, Canada
CAN - Ontario - Toronto, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Oct 15, 2026

Original job description

Synopsis of the role

At Equifax, we are moving past passive AI chat interfaces to build the future of autonomous workflows. We are creating intelligent, self-correcting multi-agent systems that can navigate complex software environments, utilize external tools, and solve open-ended business problems with minimal human intervention. To ensure these systems are safe, reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning Engineer.

In this role, you will be the guardian of our production AI reliability. You will bridge the gap between raw Large Language Model (LLM) capabilities and flawless autonomous execution. Unlike traditional software testers or prompt engineers, you will focus on the behavior, decision-making logic, tool-use efficiency, and long-term stability of multi-agent architectures. Your mission is to build the automated evaluation frameworks that keep our agents accurate, cost-effective, and hallucination-free.

What you will do

Golden Dataset Curation & Automated Evaluation

Build the "Golden Set": Curate, maintain, and augment high-quality reference datasets (Golden Sets) of documents, user queries, and expected agent trajectories to serve as the ultimate source of truth for testing.
Automate Eval Cycles: Design and implement automated, continuous evaluation pipelines to measure agent accuracy, latency, token spend, and fallback reliability before code hits production.
Trajectory & Reasoning Auditing: Trace and dissect complex, multi-step agent "thought" processes (e.g., ReAct, Reflection loops) to pinpoint exactly where an agent deviates from its intended logic path.

Agent Tuning & Developer Collaboration

Behavioral Optimization: Refine system prompts, context windows, and few-shot examples to optimize how agents execute complex, multi-step workflows.
Tool & Function-Calling Optimization: Fine-tune how agents interact with external APIs, databases, and UiPath RPA workflows - minimizing execution errors, redundant calls, and token overhead.
Augment Development: Partner closely with AI Solution Leads and AI Agent Developers to feed evaluation insights back into the development lifecycle, helping them build robust, reusable, and self-correcting agent components.

Production Guardrails & Lifecycle Management (LLMOps)

Defeat Drift & Hallucinations: Actively monitor deployed agents to identify, troubleshoot, and mitigate semantic drift, prompt injections, infinite execution loops, and hallucinations.
Maintain Autonomous Integrity: Implement robust guardrail frameworks to ensure agents maintain reliable, fact-based autonomous decision-making post-deployment in production.
RAG & Knowledge Integration: Optimize Domain-Specific Knowledge Bases and Retrieval-Augmented Generation (RAG) pipelines to ensure agents pull from accurate data rather than assumptions.

What Experience You Need

Experience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or orchestration patterns over the last 1–2 years.
Agentic & LLM Frameworks: Proven hands-on experience working with LLM orchestration frameworks (e.g., LangGraph, ADKs or specialized internal SDKs).
Function Calling Mastery: Deep understanding of JSON schema design for LLM tool-calling, function-calling, and structured outputs.
Advanced Debugging & Automation: Strong background in writing automated test scripts (Python-heavy) and using tracing/observability concepts to debug cascading errors in asynchronous, non-deterministic systems.

What Could Set You Apart

Experience with AI evaluation and observability platforms
Live production experience testing Agentic workflows and GenAI solutions
Familiarity with Google Cloud AI suite (Vertex & Gemini Enterprise Agent Platform) and UiPath ecosystem (Maestro).
Experience utilizing LLMs to securely generate high-quality synthetic data for edge-case testing.
Proficiency in Python or TypeScript, with a deep understanding of asynchronous programming, API design, and microservices architecture.
Demonstrated learning agility and a proactive approach to mastering new technologies.

This is a newly created position.

Primary Location:

CAN-Toronto-5700 Yonge

Function:

Function - Tech Dev and Client Services

Schedule:

Full time

Apply About employer

More about this job

Responsibilities

You will build automated evaluation frameworks to ensure the reliability, accuracy, and cost-effectiveness of autonomous multi-agent AI systems. Additionally, you will collaborate with developers to refine agent behavior, optimize tool-calling, and implement production guardrails to mitigate hallucinations and drift.

Requirements

The role requires 3+ years of experience in software quality or data engineering with a specific focus on LLM testing and orchestration patterns. Candidates must possess deep expertise in Python, LLM frameworks like LangGraph, and advanced debugging of non-deterministic systems.

Skills

Agentic AI
LLM
Python
Test Automation
Prompt Tuning
LangGraph
Function Calling
JSON Schema
Observability
Debugging
RAG
Data Engineering
Software Quality Engineering
API Design
Microservices
TypeScript

Visa sponsorship

Not detected in the job text

Keywords

Agentic AI
LLM
Multi-agent systems
Python
LangGraph
Prompt engineering
Test automation
Function calling
JSON schema
Observability
RAG
LLMOps
Debugging
API design
Microservices
TypeScript
Google Cloud AI
Vertex AI
Gemini
UiPath
Synthetic data
Software quality engineering
Data engineering
Orchestration
Hallucination mitigation
ReAct
Reflection loops
Production guardrails
Asynchronous programming
Enterprise-grade

Report this job