Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 15 days ago
General Duty Nurse (N2) - Child Health - CK3 Surgery
Winnipeg Regional Health Authority
Winnipeg, MB
Proficient with computers, software programs, and applications such as Windows and Word processing, spreadsheets, and databases.
Added 15 days ago
General Duty Nurse (N2) - Surgery - D2 Orthopedic Trauma/Spine
Winnipeg Regional Health Authority
Winnipeg, MB
Proficient with computers, software programs, and applications such as Windows and Word processing, spreadsheets, and databases.
Added 15 days ago
General Duty Nurse (N2) - NICU
Winnipeg Regional Health Authority
Winnipeg, MB
Proficient with computers, software programs, and applications such as Windows and Word processing, spreadsheets, and databases.
Added 15 days ago
General Duty Nurse (N2) - Child Health - Pediatric Hemodialysis
Winnipeg Regional Health Authority
Winnipeg, MB
Proficient with computers, software programs, and applications such as Windows and Word processing, spreadsheets, and databases.
Added 15 days ago
Administrative Assistant
Winnipeg Regional Health Authority
Brandon, MB
Acts as a resource for staff regarding software applications within the program.
Added 15 days ago
R|
Programmer
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
- Full-time
Field of Study: Computer Science, Software Engineering, Health Informatics, or a related field, or equivalent professional experience
Added 15 days ago
R|
Research Assistant - Public Engagement
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
- Full-time
Added 15 days ago
C
Alliance / Partner Marketing Manager (Hyperscalers)
CGI
Toronto, ON
- Full-time
A track record of joint marketing programs with hyperscalers (Microsoft, Google, AWS) or Software providers (SAP, Salesforce, Workday etc.)
Added 15 days ago
M
Survey Technologist
McElhanney
Vancouver, BC
- Full-time
Experience with Leica and Trimble instruments and field software.
Added 15 days ago
PR
Clerk - 4, Outpatient Pool - Pre-Op, SOP, Endoscopy
Peterborough Regional Health Centre
Peterborough, ON
- Part-time
…knowledge of functions required most often when using required software and…
Added 15 days ago
SJ
OSP Intake Worker - Bilingual English and French
St. Joseph's Healthcare Hamilton
Hamilton, ON
- Full-time
Demonstrated knowledge and comfort with computer software to generate correspondence and input data for a variety of facility-wide tools e.g. Microsoft Office Suite electronic health…
Added 15 days ago
J
Account Development Representative II
Jobgether
Canada
- Full-time
Location and work authorization: Must reside in Canada and be legally authorized to work in the designated location
Added 15 days ago
UO
Senior Officer, Finance
University of Ottawa
Ottawa, ON · University Centre
- Full-time
Knowledge of computer systems and software including financial systems, spreadsheets, databases, Internet and e-mail
Added 15 days ago
UO
Senior Officer, Payroll
University of Ottawa
Ottawa, ON · Tabaret Hall
- Full-time
Added 15 days ago
UO
Senior Web Developer
University of Ottawa
Ottawa, ON · Tabaret Hall
- Full-time
Added 15 days ago
UO
Intermediate Liaison, Student Recuitment
University of Ottawa
Ottawa, ON · Tabaret Hall
- Full-time
Added 15 days ago
UW
Applied AI Engineer (Contract)
Upstream Works Software
Canada
- Contract
Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.
Added 15 days ago
A
Subcontracts Specialist
Actalent
North Vancouver, BC
- $44 to $53 CAD / hour
- Contract
Added 15 days ago
A
Java Developer
Actalent
Toronto, ON
- $24 to $33 CAD / hour
- Contract
As a Software Developer, you will lead the design and delivery of software services and website stacks that involve engaging creatives, cross-screen placements, targeting, optimization,…
Added 15 days ago
Public Health Nurse (Infectious Diseases)
Region of Waterloo
Cambridge, ON · Kitchener, ON · Waterloo, ON
Added 15 days ago
Nurse Practitioner
Health Sciences North
ON · Sudbury, ON
Computer skills including Microsoft Office software.
Added 15 days ago
Addictions and Mental Health Worker
Health Sciences North
ON · Sudbury, ON
11. Demonstrated excellent computer skills with proficiency in Microsoft Office software (e.g. Word, Excel,
Added 15 days ago
Physiotherapist
Health Sciences North
Sudbury, ON
Demonstrated excellent computer skills with proficiency in Microsoft Office software, (e.g. Word, Excel, Power Point and Outlook) and patient information systems.
Added 15 days ago
HRIS Analyst
Health Sciences North
ON · Sudbury, ON
…resolutions; make recommendations to users on the correct usage of the software to reduce data errors and increase data…
Added 15 days ago
Department Aide
Health Sciences North
Sudbury, ON
Demonstrated computer skills with basic skills proficiency in Microsoft Office software (e.g. Word, Excel, and Outlook).

Upstream Works Software

Applied AI Engineer (Contract)

Canada

Contract

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 27, 2026

Original job description

About The Role

Upstream Works Software is hiring a contract Applied AI Engineer to contribute to the setup of our agentic AI evaluation and demo environment on Amazon Bedrock AgentCore.

Upstream Works is a Canadian software company with 25 years of experience in enterprise contact centre software, trusted by Cisco, Amazon Web Services and global partners.

Our platform brings AI into the contact centre, and this engagement will help us prove agent quality before it reaches customers.

You will own the hands on build: setting up AgentCore, creating a golden dataset and evaluation process, and delivering an end to end demo shaped around a real business use case. You will work closely with our Product Lead, who will define the business requirements the demo needs to meet.

Key Responsibilities

The work runs in three phases, each with a clear deliverable.

Setup AWS AgentCore

Lead the setup of Amazon Bedrock AgentCore in our AWS environment, including Runtime, Observability and Evaluations.
Configure secure access, permissions and logging following AWS best practices.
Document the setup so our team can maintain and extend it.

Build the golden dataset and evaluation process

Work with our Product Lead and subject matter experts to define realistic scenarios, expected responses and the steps the agent should take.
Build and version a golden dataset that reflects real contact centre interactions, using anonymized or synthetic data.
Design the evaluation approach, including success criteria, built in and custom evaluators, and a repeatable process for regression testing as the agent changes.
Report on agent quality in a way business stakeholders can understand.

Build an end to end demo in AgentCore

Build a working agent and connect it to the tools and data the use case needs.
Shape the demo around the business requirements defined with our Product Lead, and iterate based on feedback.
Prepare and present the demo to internal stakeholders.

Throughout the engagement, you will share regular progress updates, flag risks early, and leave behind clear documentation and reusable components.

Required Qualifications

3 or more years of hands on software or AI engineering experience, including building at least one LLM based application or agent that reached production or real users
Hands on experience with Amazon Bedrock and Amazon Bedrock AgentCore
Strong Python skills, including APIs, SDKs and data handling
Experience building AI agents with tool or function calling, retrieval, and at least one agent framework (for example, Strands, LangGraph, CrewAI or similar)
Experience designing evaluations for non deterministic AI systems, such as golden datasets, success criteria, LLM as a judge, and regression testing
Working knowledge of core AWS services, including IAM, CloudWatch, Lambda and S3
Ability to turn business requirements into a working technical solution with limited direction
Excellent written and verbal English, and the ability to explain technical results to non-technical stakeholders
Availability for regular meetings during Eastern Time business hours

Would Be An Asset

Experience with conversational AI or voice agents (for example, Amazon Connect, Cisco or Genesys)
AWS certifications, such as AWS Certified AI Practitioner, Machine Learning Engineer Associate or Solutions Architect Associate
Experience with Model Context Protocol (MCP) or AgentCore Gateway
Experience setting up evaluation in CI/CD pipelines
Experience handling sensitive customer data, including anonymization and privacy requirements

Apply on LinkedIn About employer

More about this job

Responsibilities

Set up and document Amazon Bedrock AgentCore, including secure access, observability, and evaluation capabilities. Develop a versioned golden dataset and repeatable evaluation process, then build, refine, and present an end-to-end agent demo based on business requirements.

Requirements

Requires at least three years of hands-on software or AI engineering experience, including a production or real-user LLM application, plus experience with Amazon Bedrock AgentCore, Python, AWS, agent frameworks, and AI evaluation. Candidates must be able to translate business needs into technical solutions, communicate results clearly in English, and attend regular meetings during Eastern Time business hours.

Skills

Amazon Bedrock AgentCore
Python
AWS
AI Agent Development
Tool And Function Calling
Retrieval-Augmented Generation
AI Evaluation
Golden Dataset Development
Regression Testing
IAM
CloudWatch
Lambda
S3
API And SDK Integration
Data Handling
Stakeholder Communication

Visa sponsorship

Not detected in the job text

Keywords

Amazon Bedrock
Amazon Bedrock AgentCore
AWS
Python
LLM
AI Agents
Strands
LangGraph
CrewAI
Tool Calling
Function Calling
Retrieval
Golden Dataset
AI Evaluation
LLM As A Judge
Regression Testing
IAM
CloudWatch
AWS Lambda
Amazon S3
Amazon Connect
Cisco
Genesys
Model Context Protocol
AgentCore Gateway
CI/CD
Conversational AI
Voice Agents
Data Anonymization
Contact Centre Software

Report this job

Work requirements

Jobs in Canada