Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 8 mins ago
X
Senior Forward Deployed Engineer
Xero
Remote, Canada
- Full-time
- Remote
Your impact extends beyond the code; you will lead the delivery of high-stakes AI agents from discovery to production, while acting as a technical partner and evangelist. By defining the…
Added 8 mins ago
A
Senior Manager, Platform Technology Partnerships
Autodesk
Vancouver, BC
- Full-time
Lead co-innovation programs. Assess partner-technology fit to inform where and how to partner
Added 23 mins ago
HT
Manufacturing Engineer (Contract)
Husky Technologies
Bolton, ON
- Full-time
…passion of our people around the world and their desire to lead change. At the same time, we are not afraid to expect a lot and strive for leadership in all of our key markets. We are a…
Added 23 mins ago
HT
Engineering Team Leader (PET HR)
Husky Technologies
Bolton, ON
- Full-time
Plan, organize and lead a design team for new product development with adherence to Product Development Process, Husky Standards and Stage Gate. Responsibilities include estimating effort…
Added 23 mins ago
HT
Software Validation Technologist
Husky Technologies
Bolton, ON
- Full-time
…passion of our people around the world and their desire to lead change. At the same time, we are not afraid to expect a lot and strive for leadership in all of our key markets. We are a…
Added 53 mins ago
HT
PD Service - Mechanical
Husky Technologies
Bolton, ON
- Full-time
The Service team is a unique team in Development engineering responsible for enhancing the reliability and performance of Husky’s products by resolving systemic service issues. The team is…
Added 53 mins ago
HT
Applications Engineer
Husky Technologies
Bolton, ON
- Full-time
Lead end-to-end innovation and engineering initiatives, from concept ideation and prototyping through proof-of-concept validation, product development, and commercialization.
Added 53 mins ago
HT
Test Engineering Technologist - Process Packaging
Husky Technologies
Bolton, ON
- Full-time
To accelerate time-to-market with effective solutions that keep our customers in the lead, we leverage a powerful risk prioritized product development process. The Test Engineering…
Added 53 mins ago
HT
Mechanical Designer (Fluidpower)
Husky Technologies
Bolton, ON
- Full-time
Lead engineering design as part of the product development process by focusing on systems level and concept design. Translating product definition into high quality, reliable and…
Added 53 mins ago
HT
Advanced Applications Blow Molding Specialist
Husky Technologies
Bolton, ON
- Full-time
Ability to apply systematic engineering methodologies and data analysis techniques to identify meaningful technical solutions for Husky’s product offering
Added 53 mins ago
HT
PD Software for Service
Husky Technologies
Bolton, ON
- Full-time
The Service team is a unique team in Development engineering responsible for enhancing the reliability and performance of Husky’s products by resolving systemic service issues. The team is…
Added 53 mins ago
HT
Test Engineering Technologist
Husky Technologies
Bolton, ON
- Full-time
To accelerate time-to-market with effective solutions that keep our customers in the lead, we leverage a powerful risk prioritized product development process.The Test Engineering…
Added 53 mins ago
HT
Designer, Development (Mechanical)
Husky Technologies
Bolton, ON
- Full-time
…passion of our people around the world and their desire to lead change. At the same time, we are not afraid to expect a lot and strive for leadership in all of our key markets. We are a…
Added 53 mins ago
HT
Designer, Development (Electrical)
Husky Technologies
Bolton, ON
- Full-time
The Senior Designer, Development (Electrical) will be a key contributor to these product development teams, responsible for designing and delivering robust, safe and reliable electrical…
Added 53 mins ago
HT
Product Development Engineer
Husky Technologies
Bolton, ON
- Full-time
Our Development Engineering team is looking to hire an experienced Product Development Engineer. The successful candidate will lead the technical development of packaging products working…
Added 1 hour ago
S
VP, Consumer Business
Snaplii
Toronto, ON · Etobicoke, ON
- Full-time
A big part of the job is cross-functional. Product, Engineering, Growth, Operations, Finance and Compliance all touch the consumer business, and you're the one who gets them working from…
Added 1 hour ago
UW
Applied AI Engineer (Contract)
Upstream Works Software
Canada
- Contract
…around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to…
Added 1 hour ago
A
Java Developer
Actalent
Toronto, ON
- $24 to $33 CAD / hour
- Contract
As a Software Developer, you will lead the design and delivery of software services and website stacks that involve engaging creatives, cross-screen placements, targeting, optimization,…
Added 1 hour ago
A
Senior Manager, Asset Management & Engineering
ATCO
Calgary, AB
- Full-time
Lead the Facility Engineering, Operations Engineering, Maintenance and Asset Performance teams, aligning resources to Product Line priorities.
Added 2 hours ago
A
Senior Manager, Asset Management & Engineering
ATCO
Calgary, AB
- Full-time
Lead the Facility Engineering, Operations Engineering, Maintenance and Asset Performance teams, aligning resources to Product Line priorities.
Added 2 hours ago
B
Technical Expert, Engineering - Aircraft Systems Architecture, Flight Deck, Primary Avionics Systems
Bombardier
Montreal, QC
- Full-time
Lead aircraft-level trade studies and provide technical leadership on design decisions affecting product configuration, safety, performance, certification, and innovation.
Added 3 hours ago
A
Refinery Planning Economist (Relocation to Saudi Arabia is required.)
aramco
Toronto, ON
- Full-time
Lead local Linear Programming (LP) runs at individual refineries to drive commercial optimization, focusing on generating crude relative values and rankings that inform strategic decisions.…
Added 4 hours ago
P
Product Support Specialist
Pigment
Toronto, ON
- Full-time
You'll partner closely with customers to troubleshoot complex product issues, provide expert guidance, and empower them to get the most value from the platform. Working cross-functionally…
Added 4 hours ago
M
AI Business Solutions
Microsoft
Calgary, AB · Edmonton, AB · Vancouver, BC · Winnipeg, MB
- Full-time
…communication skills, customer-centric leadership, and the ability to lead virtual teams across Microsoft, partner organizations, and customer stakeholders. The Copilot Cloud Solution…
Added 4 hours ago
U
Scientifique des données III-Ing/Data Scientist III- Eng
UKG
Montreal, QC
- Full-time

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job