Find work in Canada.

524,189 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 1 hour ago
A
Forward Deployed Engineer
Antasphere
Brussels, ON
- Contract
Build that solution using our internal platform: products, templates, and agent tooling that generate most of the software for you.
Added 1 hour ago
L
Senior Product Designer, Developer Platform
LiveKit
Canada
- Full-time
…design for one very specific, very opinionated person: the developer at 2am trying to figure out why their voice agent just failed a call. You'll design the tools developers use to test,…
Added 2 hours ago
A
Senior AI Quality Developer, Personalization
Autodesk
Toronto, ON
- Full-time
We're looking for a Senior AI Quality Developer to help make those experiences reliable and trustworthy. In this role, you'll work on Autodesk Assistant, helping ensure we deliver…
Added 2 hours ago
A
Senior AI Quality Developer, Personalization
Autodesk
Toronto, ON
- Full-time
We're looking for a Senior AI Quality Developer to help make those experiences reliable and trustworthy. In this role, you'll work on Autodesk Assistant, helping ensure we deliver…
Added 3 hours ago
UW
Applied AI Engineer (Contract)
Upstream Works Software
Canada
- Contract
Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.
Added 4 hours ago
MP
Junior Real Estate Agent – Dubai (Training Provided)
McCone Properties
Ottawa, ON
- Full-time
The average agent here earned US$112,000 last year, tax free; US$2.9 million is our best year, not the usual one. There is no salary, so arrive with around six months of savings while you…
Added 5 hours ago
M
AI Business Solutions
Microsoft
Calgary, AB · Edmonton, AB · Vancouver, BC · Winnipeg, MB
- Full-time
…business requirements into prioritized Copilot scenarios and agent solutions, and drive deployment, active usage, adoption, and expansion across the customer's…
Added 7 hours ago
SC
Senior Developer
SAP Careers
Montreal, QC
- $108,100 to $222,800 CAD / year
- Full-time
We are looking for a dynamic and motivated Senior Software Developer who embrace AI-assisted software development as part of their everyday engineering practice to join our engineering…
Added 7 hours ago
F
React JS Developer
Fortinet
Burnaby, BC
- Full-time
…data everywhere. We are currently seeking a dynamic ReactJS Developer to contribute to the success of our rapidly growing business. We are looking for a highly motivated individual who can…
Added 8 hours ago
C
Senior Agentic AI developer
CGI
Toronto, ON
- Full-time
…(GTO) Canada is seeking a highly skilled Senior Agentic AI Developer to design, develop, and deploy next-generation AI solutions leveraging Large Language Models (LLMs), Generative AI,…
Added 9 hours ago
A
Entry Level Advisory Development Program - Summer Analyst - Canada - NAELFY27
Accenture
Calgary, AB · Vancouver, BC · Ottawa, ON · Toronto, ON · Montreal, QC
- Full-time
Added 9 hours ago
P
Experienced Talent Acquisition Manager
PwC
Calgary, AB · Toronto, ON
- Full-time
Added 10 hours ago
Consultant, Local Employee Experience - (Western Canada)
McDonald's Corporation
Toronto, ON
You are a strategic HR professional and want to apply your expertise on a regional and national scale. You are a change agent and a strategic communicator who can effectively support our…
Added 10 hours ago
Global Mobility - Expatriate Tax - Manager - Vancouver
EY
Vancouver, BC
CPA, Enrolled Agent, or other relevant tax designation
Added 10 hours ago
Global Mobility - Expatriate Tax - Senior Manager - Toronto
EY
Toronto, ON
U.S. Certified Public Accountant (CPA) or Enrolled Agent (EA) credential, either obtained or currently in progress
Added 10 hours ago
T
Business System Analyst
TechDoQuest
Brampton, ON
- Full-time
Experience supporting Oracle AI Agent Studio initiatives
Added 10 hours ago
R
Senior Software Development Engineer, Customer Success Engineering
Remitly
Burnaby, BC
- Full-time
…be directly responsible for enhancing both the customer and agent experience, ensuring frictionless access to…
Added 10 hours ago
M
Sr. Manager, Workforce Readiness
McKesson
Mississauga, ON
- Full-time
Establish and lead change agent and people leader networks to drive adoption and gather feedback from the field.
Added 11 hours ago
A
Forward Deployed Solutions Lead
Accenture
Calgary, AB · Ottawa, ON · Toronto, ON · Montreal, QC
- Full-time
Hands-on MCP server or custom agent-tool development.
Added 12 hours ago
ES
AI security research engineer
Epsilon Solutions Ltd.
Toronto, ON
- Contract
Experience with AI red teaming, autonomous penetration testing, agent security, or AI-native security tooling.
Added 12 hours ago
TT
Senior Full Stack Software Engineer
True Talent Solutions Partners
Canada
- $200,000 to $275,000 USD / year
- Full-time
Establish effective practices for agent-driven software development across the team.
Added 12 hours ago
PC
Senior Manager Cyber Generalist
PwC Canada
Toronto, ON
- Full-time
Added 13 hours ago
TC
GCP Architect
TechNeptune Consulting Inc.
Canada
- Contract
Experience with LLM-based application architectures, ideally including agent-orchestrationframeworks such as LangGraph, LangChain and familiarity with the practical differences betweenLLM…
Added 13 hours ago
P
Senior Manager Cyber Generalist
PwC
Toronto, ON
- Full-time
Added 14 hours ago
G
Software Engineer, Full Stack
Gigi
Toronto, ON
- Full-time
We're hiring an AI Builder - a full stack software engineer - to join our engineering team in Toronto and own end-to-end feature development for Gigi, our AI agent.

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job