Find work in Canada.

524,440 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 3 hours ago
A
Manager, Global Practice and Delivery (Solutions & Services)
Acceldata
Kitchener, ON · Toronto, ON
- Full-time
…implementations, technical consulting, SaaS deployments, and platform…
Added 3 hours ago
A
Manager, Global Practice and Delivery (Solutions & Services)
Acceldata
Kitchener, ON
- Full-time
…implementations, technical consulting, SaaS deployments, and platform…
Added 3 hours ago
A
Manager, Global Practice and Delivery (Solutions & Services)
Acceldata
Toronto, ON
- Full-time
…implementations, technical consulting, SaaS deployments, and platform…
Added 3 hours ago
M
Investment Data Solutions Lead
Marsh
Toronto, ON
- Full-time
…specific capabilities and requirements, working closely with platform providers and technology teams to implement tailored, fit-for-purpose solutions. Responsibilities include a blend of…
Added 4 hours ago
A
Senior Full Stack Engineer, Applied AI
Autodesk
Vancouver, BC
- Full-time
We are looking for a Senior Software Developer who enjoys building great software, solving interesting problems, and thinking in systems, not just files. You will help develop AI-powered…
Added 4 hours ago
A
Senior Full Stack Engineer, Applied AI
Autodesk
Toronto, ON
- Full-time
We are looking for a Senior Software Developer who enjoys building great software, solving interesting problems, and thinking in systems, not just files. You will help develop AI-powered…
Added 4 hours ago
A
Senior Full Stack Engineer, Applied AI
Autodesk
Toronto, ON
- Full-time
We are looking for a Senior Software Developer who enjoys building great software, solving interesting problems, and thinking in systems, not just files. You will help develop AI-powered…
Added 4 hours ago
R|
Programmer
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
- Full-time
Experience with cloud-based infrastructure and application deployment (Amazon Web Services, Google Cloud Platform, Azure, etc.).
Added 5 hours ago
UW
Applied AI Engineer (Contract)
Upstream Works Software
Canada
- Contract
Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.
Added 5 hours ago
U
Team Lead, CPG
Uber
Toronto, ON
- Full-time
Own and evolve the CPG Ads sales and account management strategy with a focus on sustainable growth, client retention, and cross-platform expansion.
Added 5 hours ago
Developer
Rogers Communications
Toronto, ON
As a Mobile Applications Developer, you will join a squad of engineers designing, building and running our iOS and Android applications. You will spend most of your time hands-on in code,…
Added 5 hours ago
RB
Senior Quality Engineer
Royal Bank of Canada
Toronto, ON
- Full-time
Experience in financial services, banking, or wealth management; Experience with platform conversions, data migrations, .NET technologies (C#, ASP.NET, VB.NET)
Added 6 hours ago
X
Engineer - Reporting, Insights and Data-in
Xero
Remote, Canada
- Full-time
- Remote
You will join the Reporting team within Reporting, Insights and Data-In, building customer-facing experiences and shared platform capabilities that support reporting across Xero.
Added 6 hours ago
RB
Lead Full Stack Engineer
Royal Bank of Canada
Toronto, ON
- Full-time
Added 7 hours ago
Q
FY27 Intern - Deep Learning Research Internship - Canada (4 Months)
Qualcomm
Markham, ON
- Full-time
Our early career programs are designed to attract inventive minds, offering a platform to contribute to our long-term innovation pipeline. You'll be part of a community that values…
Added 8 hours ago
A
Quality Assurance Automation Developer
ATB
Calgary, AB · Edmonton, AB
- Full-time
As ATB’s next QA Automation Developer you will have a unique opportunity to contribute to ATB through challenging, meaningful and diverse opportunities while creating happiness for our…
Added 8 hours ago
A
Quality Assurance Lead
ATB
Calgary, AB · Edmonton, AB
- Full-time
…implementation based upon Salesforce and integrations into the platform. This role will support our software delivery engine and help increase code quality and speed to…
Added 8 hours ago
U
Scientifique des données III-Ing/Data Scientist III- Eng
UKG
Montreal, QC
- Full-time
Added 8 hours ago
Q
FY27 Intern - Design Automation & Quality Assurance Engineering Intern - Canada (16 months)
Qualcomm
Toronto, ON
- Full-time
Our early career programs are designed to attract inventive minds, offering a platform to contribute to our long-term innovation pipeline. You'll be part of a community that values…
Added 8 hours ago
LC
Marketing Intern, Foodservice & Ingredients (8 months)
Lactalis Canada
Toronto, ON · Etobicoke, ON
- Internship
AC Nielsen and/or research platform working knowledge would be an asset
Added 8 hours ago
Marketing Specialist, Executive Education, Edwards School of Business
University of Saskatchewan
Saskatoon, SK
Google Analytics certifications considered an asset.
Added 9 hours ago
SL
Business Portfolio Manager
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
…through resolution and partners across Finance, Journey and Platform teams, delivery stakeholders, and senior leadership to strengthen portfolio transparency, decisions, and execution. The…
Added 9 hours ago
SC
Senior Developer
SAP Careers
Montreal, QC
- $108,100 to $222,800 CAD / year
- Full-time
We are looking for a dynamic and motivated Senior Software Developer who embrace AI-assisted software development as part of their everyday engineering practice to join our engineering…
Added 9 hours ago
AC
Broadcom Clarity Developer
Adastra Corporation
Markham, ON
- Other
We are looking for a hands-on Broadcom Clarity Developer to design, develop, enhance, and support Broadcom Clarity PPM solutions across portfolio, project, resource, and financial…
Added 9 hours ago
M
IAM RBAC Business Solution Analyst Lead
Marsh
Toronto, ON
- Full-time
The chance to use automation, analytics, and AI to improve role management, access reviews, provisioning, and operational performance.

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job