Find work in Canada.

524,189 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 1 hour ago
X
Senior Forward Deployed Engineer
Xero
Remote, Canada
- Full-time
- Remote
As a Senior Engineer within the Internal AI Accelerator Squad, you will be at the forefront of Xero’s transformation into an AI-native company. You will act as a forward-deployed engineer,…
Added 1 hour ago
A
Forward Deployed Engineer
Antasphere
Brussels, ON
- Contract
Antasphere is an AI product studio in Brussels. Alongside our own products, we build custom software for clients: each engagement is a signed project that needs someone to own it from…
Added 3 hours ago
UW
Applied AI Engineer (Contract)
Upstream Works Software
Canada
- Contract
Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.
Added 5 hours ago
OT
Lead Quality Assurance Developer
Open Text Corporation
Mississauga, ON · Richmond Hill, ON · Waterloo, ON
- Other
The Lead Quality Assurance Engineer owns QA strategy, governance, reporting, and execution across enterprise programs. This role leads teams through integration, functional, regression,…
Added 8 hours ago
AS
Databricks Data Engineer
Apex Systems
Toronto, ON
- $50 to $55 USD / hour
- Full-time
Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise Databricks data hub. This Engineer…
Added 8 hours ago
X
Software Engineer Co-op
Xradar
Burnaby, BC
- Full-time
As Xradar's Software Engineer Co-op, you will be part of the R&D team and help build software for our NDT devices. Our applications bring hardware and software together, turning complex…
Added 8 hours ago
T
Data Engineer Intern/Co-op (Winter 2027)
TD
Toronto, ON
- Full-time
…(Data-as-a-service or DaaS). Job responsibilities for a Data Engineer Intern/Co-op may vary by area. They may include, but are not limited to the…
Added 8 hours ago
HR
Data & Business Intelligence (BI) Analyst
Hopewell Residential
Calgary, AB
- Full-time
Maintain security within semantic models, including row-level security, and coordinate access requirements with Information Systems.
Added 8 hours ago
S
Firmware Engineer
Solidigm
Vancouver, BC
- Full-time
Software/firmware development processes including workflow and continuous integration validation
Added 9 hours ago
CH
Data Engineer
Cardinal Health Canada
Concord, ON
- Full-time
We are seeking a Data Engineer to develop and support reliable data solutions for reporting, analytics, and business decision-making. This role works within established architecture and…
Added 9 hours ago
CH
Data Engineer
Cardinal Health Canada
Concord, ON
- Full-time
We are seeking a Data Engineer to develop and support reliable data solutions for reporting, analytics, and business decision-making. This role works within established architecture and…
Added 9 hours ago
ST
Aircraft Loads Engineer
Sapsol Technologies Inc
Remote, Canada
- Contract
- Remote
You have experience with software development using version-control systems such as Git.
Added 9 hours ago
Mechatronics Engineer – Robotics & Grasping
Apera AI Inc
Vancouver, BC
Apera AI helps manufacturers make their factories more flexible and productive. Robots enhanced with Apera's software have 4D Vision - the ability to see and grasp objects with human-like…
Added 10 hours ago
Data Engineer
CareRx
Toronto, ON
…in an enterprise-grade data warehousing platform. The Data Engineer is responsible for operating the platform day to day: keeping data flowing, connecting new sources, and building data…
Added 10 hours ago
A
Entry Level Technology Development Program - Summer Analyst - Canada - NAELFY27
Accenture
Calgary, AB · Vancouver, BC · Ottawa, ON · Toronto, ON · Montreal, QC · Regina, SK
- Full-time
Identify, prioritize, and document high-impact opportunities for AI integration across client projects (e.g., customer support, research, legal review, software development).
Added 10 hours ago
O
Manager, Software Development
OpenText
Richmond Hill, ON
- Full-time
The Manager, Software Development leads the newly formed engineering team delivering the Image & Fax Aviator Platform. This first-line manager will recruit, onboard, coach, and directly…
Added 10 hours ago
T
Data Engineer Intern/Co-op (Winter 2027)
TD
Toronto, ON
- Full-time
…(Data-as-a-service or DaaS). Job responsibilities for a Data Engineer Intern/Co-op may vary by area. They may include, but are not limited to the…
Added 11 hours ago
A
Railway Infrastructure Specialist
AtkinsRéalis
Montreal, QC · Quebec, QC
- Full-time
…technology to transform the world's infrastructure and energy systems. Together, with our industry partners and clients, and our global team of consultants, designers, engineers and project…
Added 11 hours ago
ZS
RPA Platform Engineer
Zodiac Solutions, Inc
Toronto, ON
- Full-time
The Senior Platform Engineer develops, maintains, and manages Automation platform on premise, AWS cloud and vendor SaaS to enable automation across the bank and core operations enabling the…
Added 11 hours ago
T
Senior Software Developer In Test - Python Automation Engineer
Telesat
Ottawa, ON
- Contract
We are seeking a highly skilled Senior Python Automation Engineer to design, build, and evolve production-grade automation frameworks, engineering tools, and automated validation for…
Added 11 hours ago
Hardware Engineering, Staff Engineer- 19028
Synopsys
Ottawa, ON
…learning machines. We lead in chip design, verification, and IP integration, empowering the creation of high-performance silicon chips and software content. Join us to transform the future…
Added 11 hours ago
RI
Senior Full Stack Engineer
Remarcable, Inc.
Remote, Canada
- $140,000 to $190,000 CAD / year
- Full-time
- Remote
As a high-growth Series A SaaS company, we build practical, high-leverage software that modernizes one of North America's largest and most foundational industries.
Added 12 hours ago
O
Test Engineer
ORBCOMM
Ottawa, ON
- $75,000 to $95,000 CAD / year
- Full-time
Are you passionate about building reliable test systems that ensure products perform at their best? At ORBCOMM, we're looking for a hands-on Test Engineer to design, develop, and support…
Added 12 hours ago
V
Embedded Firmware Engineer - Energy Storage (Controls & Connectivity)
Verdyn
Oakville, ON
- Full-time
Role Description The Embedded Firmware Engineer - Energy Storage (Controls & Connectivity) will design, implement, and maintain embedded software for Verdyn’s energy storage products and…
Added 12 hours ago
VS
Staff SW Engineer (Sys)
VIAVI Solutions
Ottawa, ON
- Full-time
Develops software and tools in support of design, infrastructure and technology platforms, including operating systems, compilers, routers, networks, utilities, databases, cloud-based and…

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job