Find work in Canada.

492,522 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 2 days ago
Project Manager / Strategy Lead
Roboyo
ON
…manage the integrated program plan across all workstreams (RPA, Agentic Workflows,Generative AI, Data Science, Data Engineering), tracking milestones, dependencies, and critical…
Added 5 days ago
I
Forward Deployed Engineer
INVOKE
Montreal, QC
- Full-time
Lead the build of our intelligent automation platform, combining deterministic workflow orchestration, RPA, agentic AI workflows, RAG-based retrieval, and OCR/document extraction into…
Added 5 days ago
FS
Senior Platform Engineer, Performance Management
Four Seasons Hotels and Resorts
Toronto, ON · Four Seasons Corporate Headquarters Toronto
- Full-time
Added 6 days ago
SL
Director, Domain Enterprise Architect, RPA and Intelligent Automation
Sun Life
Toronto, ON · Waterloo, ON · Montreal, QC · Sun Life Toronto One York
- Full-time
The Director defines the RPA and Intelligent Automation domain strategy, future-state architectures, standards, reference architectures, and technology roadmaps. The scope includes RPA,…
Added 6 days ago
E
Agentic AI Developer
Equifax
Toronto, ON · CAN - Ontario - Toronto
- Full-time
…minimal human intervention. We are seeking a highly skilled Agentic AI Developer to be the core engineer constructing our next-generation AI…
Added 8 days ago
C
Service Line Sales Specialist - BFSI - Associate Director - 69896441
Cognizant
Toronto, ON
- Full-time
…transformation opportunities centered around Intelligent Automation, RPA, AI, Generative AI, and Agentic AI…
Added 9 days ago
E
Agentic AI Optimization Developer
Equifax
Toronto, ON · CAN - Ontario - Toronto
- Full-time
…reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning…
Added 12 days ago
SP
Technical Architect Director - PubSec - Mulesoft Canada
Salesforce Partner Canada
Toronto, ON
- Full-time
agents - that scales delivery. You are an industry thought leader who shapes the practice's point of view on the agentic future of the SaaS industry, translating where enterprise data, AI…
Added 13 days ago
I
Solutions Architect
INVOKE
Montreal, QC
- Full-time
…organizations across industries to design and implement scalable RPA and AI-driven workflows that improve efficiency, accuracy, and…
Added 14 days ago
ZL
[SCFD2MWC] AI Architect
ZettaMine Labs Pvt. Ltd.
Canada
- Full-time
Experience with AI, Generative AI, Agentic AI, RAG, workflow automation, document intelligence, RPA, or process mining.
Added 19 days ago
TC
RPA Platform Engineer
Tata Consultancy Services
Toronto, ON
- $90,000 to $100,000 CAD / year
- Full-time
Design, implement, and maintain on-premises and cloud-based RPA platforms to enable enterprise automation.
Added 19 days ago
SL
Director, Domain Enterprise Architect, RPA and Intelligent Automation
Sun Life Québec
Montreal, QC
- Full-time
The Director defines the RPA and Intelligent Automation domain strategy, future-state architectures, standards, reference architectures, and technology roadmaps. The scope includes RPA,…
Added 19 days ago
Software Developer- RPA / UiPath Specialist
Open Text Corporation
Mississauga, ON
As a Software Developer specializing in Robotic Process Automation (RPA), UiPath, and emerging agentic AI technologies, you will design, develop, deploy, and support intelligent automation…
Added 20 days ago
SL
Director, Domain Enterprise Architect, RPA and Intelligent Automation
Sun Life
Toronto, ON · Waterloo, ON · Montreal, QC · Sun Life Toronto One York
- Full-time
The Director defines the RPA and Intelligent Automation domain strategy, future-state architectures, standards, reference architectures, and technology roadmaps. The scope includes RPA,…
Added 20 days ago
SL
Director, Domain Enterprise Architect, RPA and Intelligent Automation
Sun Life Québec
Montreal, QC
- Full-time
The Director defines the RPA and Intelligent Automation domain strategy, future-state architectures, standards, reference architectures, and technology roadmaps. The scope includes RPA,…
Added 21 days ago
SP
Technical Architect Director - PubSec - Mulesoft Canada
Salesforce Partner Canada
Toronto, ON
- Full-time
agents - that scales delivery. You are an industry thought leader who shapes the practice's point of view on the agentic future of the SaaS industry, translating where enterprise data, AI…
Added 27 days ago
R
Manager, Operations Process Engineering
RBC
Toronto, ON
- Full-time
Interest in and basic understanding of technologies (Generative AI, Agentic AI, ML, RPA)
Added 27 days ago
GC
Engagement Manager
Greenlight Consulting
Toronto, ON
- $110,000 to $130,000 CAD / year
Greenlight helps organizations solve complex business challenges through intelligent automation, agentic AI, and custom technology solutions. Our teams work directly with clients to…
Added 27 days ago
RB
Manager, Operations Process Engineering
Royal Bank of Canada
Toronto, ON
- Full-time
Interest in and basic understanding of technologies (Generative AI, Agentic AI, ML, RPA)
Added 1 month ago
TC
Senior Automation Developer with Blue Prism
Tata Consultancy Services
Toronto, ON
- $90,000 to $110,000 CAD / year
- Full-time
We are seeking a highly skilled Senior Automation Developer to design, develop, and optimize automation solutions using Blue Prism, with complementary expertise in Python, SQL, and API…
Added 1 month ago
D
Senior Consultant, Finance Transformation
Deloitte
Toronto, ON
- Full-time
…reporting, and modernizing finance technology (e.g. Cloud ERP, EPM, RPA, Agentic AI) and data…
Added 2 months ago
IF
Security Advisor PAM Specialist
Intact FC
Mississauga, ON · Ottawa, ON · Toronto, ON · Montreal, QC
- Full-time
Design and implement vaulting strategies for Agentic AI identities - autonomous AI agents, LLM orchestrators, robotic process automation (RPA) bots, and AI-driven pipelines that require…
Added 2 months ago
E
Automation Solution Lead
Equifax
Toronto, ON · CAN - Ontario - Toronto
- Full-time
In this role, you won't just optimize existing workflows - you will design, build, and deploy sophisticated GenAI and Agentic AI solutions within our secure, globally integrated…
Added 3 months ago
DC
Solutions Architect
Dillon Consulting Limited
London, ON · Toronto, ON · Hamilton, ON · Guelph, ON · Kingston, ON · Ottawa, ON · Oakville, ON · Kitchener, ON · Vaughan, ON · Chatham-Kent, ON · North York, ON · Chatham, ON
- Full-time
Champion AI-assisted development across the team, establishing how coding assistants and agentic tools fit into our engineering practices, code review standards, and definition of done.
Added 1 month ago
S
Senior Solution Architect
SPECTRAFORCE
Toronto, ON
- Contract
Experience in AI, Generative AI, Agentic AI, Workflow Automation, Document Intelligence, RPA, or Process Mining.

Equifax

Agentic AI Optimization Developer

Toronto, ON, Canada
CAN - Ontario - Toronto, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Posting language: English
Posted: Oct 15, 2026

Original job description

Synopsis of the role

At Equifax, we are moving past passive AI chat interfaces to build the future of autonomous workflows. We are creating intelligent, self-correcting multi-agent systems that can navigate complex software environments, utilize external tools, and solve open-ended business problems with minimal human intervention. To ensure these systems are safe, reliable, and enterprise-grade, we are seeking an analytical Agentic AI Evaluation & Tuning Engineer.

In this role, you will be the guardian of our production AI reliability. You will bridge the gap between raw Large Language Model (LLM) capabilities and flawless autonomous execution. Unlike traditional software testers or prompt engineers, you will focus on the behavior, decision-making logic, tool-use efficiency, and long-term stability of multi-agent architectures. Your mission is to build the automated evaluation frameworks that keep our agents accurate, cost-effective, and hallucination-free.

What you will do

Golden Dataset Curation & Automated Evaluation

Build the "Golden Set": Curate, maintain, and augment high-quality reference datasets (Golden Sets) of documents, user queries, and expected agent trajectories to serve as the ultimate source of truth for testing.
Automate Eval Cycles: Design and implement automated, continuous evaluation pipelines to measure agent accuracy, latency, token spend, and fallback reliability before code hits production.
Trajectory & Reasoning Auditing: Trace and dissect complex, multi-step agent "thought" processes (e.g., ReAct, Reflection loops) to pinpoint exactly where an agent deviates from its intended logic path.

Agent Tuning & Developer Collaboration

Behavioral Optimization: Refine system prompts, context windows, and few-shot examples to optimize how agents execute complex, multi-step workflows.
Tool & Function-Calling Optimization: Fine-tune how agents interact with external APIs, databases, and UiPath RPA workflows - minimizing execution errors, redundant calls, and token overhead.
Augment Development: Partner closely with AI Solution Leads and AI Agent Developers to feed evaluation insights back into the development lifecycle, helping them build robust, reusable, and self-correcting agent components.

Production Guardrails & Lifecycle Management (LLMOps)

Defeat Drift & Hallucinations: Actively monitor deployed agents to identify, troubleshoot, and mitigate semantic drift, prompt injections, infinite execution loops, and hallucinations.
Maintain Autonomous Integrity: Implement robust guardrail frameworks to ensure agents maintain reliable, fact-based autonomous decision-making post-deployment in production.
RAG & Knowledge Integration: Optimize Domain-Specific Knowledge Bases and Retrieval-Augmented Generation (RAG) pipelines to ensure agents pull from accurate data rather than assumptions.

What Experience You Need

Experience: 3+ years of professional experience in software quality engineering, test automation, or data/ML engineering, with a dedicated focus on LLM testing, prompt tuning, or orchestration patterns over the last 1–2 years.
Agentic & LLM Frameworks: Proven hands-on experience working with LLM orchestration frameworks (e.g., LangGraph, ADKs or specialized internal SDKs).
Function Calling Mastery: Deep understanding of JSON schema design for LLM tool-calling, function-calling, and structured outputs.
Advanced Debugging & Automation: Strong background in writing automated test scripts (Python-heavy) and using tracing/observability concepts to debug cascading errors in asynchronous, non-deterministic systems.

What Could Set You Apart

Experience with AI evaluation and observability platforms
Live production experience testing Agentic workflows and GenAI solutions
Familiarity with Google Cloud AI suite (Vertex & Gemini Enterprise Agent Platform) and UiPath ecosystem (Maestro).
Experience utilizing LLMs to securely generate high-quality synthetic data for edge-case testing.
Proficiency in Python or TypeScript, with a deep understanding of asynchronous programming, API design, and microservices architecture.
Demonstrated learning agility and a proactive approach to mastering new technologies.

This is a newly created position.

Primary Location:

CAN-Toronto-5700 Yonge

Function:

Function - Tech Dev and Client Services

Schedule:

Full time

Apply About employer

More about this job

Responsibilities

You will build automated evaluation frameworks to ensure the reliability, accuracy, and cost-effectiveness of autonomous multi-agent AI systems. Additionally, you will collaborate with developers to refine agent behavior, optimize tool-calling, and implement production guardrails to mitigate hallucinations and drift.

Requirements

The role requires 3+ years of experience in software quality or data engineering with a specific focus on LLM testing and orchestration patterns. Candidates must possess deep expertise in Python, LLM frameworks like LangGraph, and advanced debugging of non-deterministic systems.

Skills

Agentic AI
LLM
Python
Test Automation
Prompt Tuning
LangGraph
Function Calling
JSON Schema
Observability
Debugging
RAG
Data Engineering
Software Quality Engineering
API Design
Microservices
TypeScript

Visa sponsorship

Not detected in the job text

Keywords

Agentic AI
LLM
Multi-agent systems
Python
LangGraph
Prompt engineering
Test automation
Function calling
JSON schema
Observability
RAG
LLMOps
Debugging
API design
Microservices
TypeScript
Google Cloud AI
Vertex AI
Gemini
UiPath
Synthetic data
Software quality engineering
Data engineering
Orchestration
Hallucination mitigation
ReAct
Reflection loops
Production guardrails
Asynchronous programming
Enterprise-grade

Report this job