Find work in Canada.

525,529 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 9 mins ago
B
Vice President, ETF Algo Engineer
BMO
Toronto, ON · FCP
- Full-time
…and build systematic trading, pricing, and risk-management solutions across multiple asset…
Added 9 mins ago
B
Senior Business Analyst, Loan Servicing Technology
BMO
Toronto, ON · FCP
- Full-time
As a Business Analyst, with a focus on AI-Enabled Delivery at BMO, you will play a critical role in bridging business needs, technology solutions, and emerging Artificial Intelligence (AI)…
Added 9 mins ago
PC
Director, Member Experience
Provincial Credit Union
PE · PEI, Prince Edward Island
- Full-time
Work with Retail, Business Services, Digital Member Experience, Member Administration and other teams to support a consistent experience across branches, telephone, digital and other…
Added 9 mins ago
PC
Director, Operations
Provincial Credit Union
PE · PEI, Prince Edward Island
- Full-time
Oversee core banking systems and related operational platforms, ensuring business needs are considered in technology initiatives, system implementations and operational changes.
Added 9 mins ago
J
Manager of UX Research
Jobgether
Canada
- $112,000 to $160,000 CAD / year
- Full-time
Combine research findings with product analytics from tools such as FullStory, Pendo, and Amplitude to establish baselines, assess problem severity, and recommend solutions.
Added 9 mins ago
J
Senior Enterprise Account Executive
Jobgether
Canada
- Full-time
Drive enterprise growth by acquiring high-value customers and expanding adoption of innovative environmental, health, and safety software solutions.
Added 9 mins ago
J
Account Manager, Medical Communications
Jobgether
Canada
- $75,000 to $90,000 CAD / year
- Full-time
As an Account Manager, Medical Communications, you will develop strategic client relationships and drive business growth across the pharmaceutical, biotechnology, healthcare, academic, and…
Added 9 mins ago
Industrial Millwright 433A
Smurfit Westrock
Guelph, ON
…dedicated to creating efficient and scalable paper and packaging solutions to help solve complex packaging challenges. Guided by our values of safety, loyalty, integrity and respect, we are…
Added 9 mins ago
W
Project Manager, Municipal Planning
WSP
Toronto, ON
- Full-time
With an unmatched breadth and depth of engineering, advisory and science‑based expertise, our global minds unite to power local solutions.
Added 9 mins ago
District Sales Manager
Moov Pool Products
Toronto, ON
As the local face of the company, you will build strong customer partnerships, identify new business opportunities, and help expand our presence in this strategically important market.…
Added 9 mins ago
4A
Automotive Sales Person - Ottawa
401 Auto
Ottawa, ON · Kanata, Ontario
- Full-time
…Companies, we’re building a new team and looking for a motivated, business-minded Non-Prime Finance Manager who wants more than just a job. We’re looking for someone who wants to learn the…
Added 9 mins ago
B
MAC (Move, Add, Change) Coordinator
BGIS
Ottawa, ON
- Full-time
Identifies challenges and can suggest solutions
Added 9 mins ago
4
Sr. Manager - Business Development – Defence Systems
49North
Richmond, BC · Halifax, NS · Ottawa, ON
- Full-time
The Senior Manager, Business Development – Defence Systems drives market expansion, shapes capture strategies and secures high-value contract awards across Canada’s multi-domain defence…
Added 24 mins ago
C
Automotive Consumer Affairs Specialist - Tier 3 (On-Site)
Concentrix
Chatham-Kent, ON · Chatham, ON
- Full-time
…to deliver exceptional customer experiences and tech-based solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
C
Customer Service / Tech Support Rep (On-Site)
Concentrix
Belleville, ON
- Full-time
…to deliver exceptional customer experiences and tech-based solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
C
Customer Service Rep (Travel Enthusiast) On-Site
Concentrix
NS · Glace Bay, NS
- Full-time
…game-changers to deliver exceptional customer experiences and solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
C
Customer Service Rep – On-Site (Bilingual: French / English)
Concentrix
Chatham-Kent, ON · Chatham, ON
- Full-time
…game-changers to deliver exceptional customer experiences and solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
C
Customer Service Rep (Travel Enthusiast) On-Site
Concentrix
Dartmouth, NS
- Full-time
…game-changers to deliver exceptional customer experiences and solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
T
Operations Manager (Civil/FTTH Construction)
Telecon
Saskatoon, SK
- Full-time
The business unit specializes in the construction of FTTH/FTTP networks. The Operations Manager is responsible for the full project cycle, starting from estimation through to project…
Added 24 mins ago
C
Customer Service Rep – Automotive (On-Site)
Concentrix
Mississauga, ON
- Full-time
…game-changers to deliver exceptional customer experiences and solutions for one of the world’s best-known brands. If you're ready to grow with a Fortune 500 company with an inclusive,…
Added 24 mins ago
KR
Senior Manager, Corporate Tax
Kassen Recruitment
AB · Edmonton, AB
- Full-time
…cross-border matters, and the judgment to support strategic business…
Added 24 mins ago
B
Practice Consultant - Medical Aesthetics
BoomerangFX
Mississauga, ON
- $65,000 to $75,000 CAD / year
- Full-time
Join an international team where your performance contributes directly to business growth and where you can develop valuable expertise in sales, healthcare technology and AI.
Added 24 mins ago
QM
Directeur de succursale - ventes et opérations / Branch Manager - Sales & Operations
Quantum Management Services Ltd.
Montreal, QC
- Full-time
Un chef de file mondial dans le domaine des produits industriels, des solutions techniques et des services à valeur ajoutée, qui accompagne ses clients dans les secteurs de la fabrication,…
Added 24 mins ago
R
Process Technician - E Nickel - Weekend Nights
RTX
Oakville, ON
- Full-time
Collins Aerospace is a leader in technologically advanced, intelligent solutions that help redefine the aerospace and defense industry. With a comprehensive portfolio and deep technical…
Added 24 mins ago
Senior Project Manager - Nuclear - Canada Central
GHD Group Pty Ltd
Waterloo, ON
To support GHD’s growth in the Energy business across Canada, GHD is making investments to increase our footprint in the nuclear sector. Our Canadian business is looking for a Senior…

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job