Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 3 months ago
T(
Principal Product Engineer
Tilt (f.k.a. Delphia)
Remote, Canada
- $220,000 to $280,000 CAD / year
- Full-time
- Remote
Work closely with designers and AI/ML researchers to turn ambitious product ideas into fast, reliable software.
Added 3 months ago
S
Software Engineer, Back-End - Mail (Canada)
Superhuman
Remote, Canada
- $168,000 to $291,000 CAD / year
- Full-time
- Remote
8+ years of experience in back-end development, with strong fundamentals in algorithms, data structures, and system design.
Added 3 months ago
PA
AI Modeling Engineer
Palona AI
Toronto, ON
- Full-time
…speech and language quality, evaluation methodology, dataset development, and model behavior in…
Added 3 months ago
Solutions Architect, AI Systems
Viral Nation Inc.
Canada
…AI-driven products - not just models and dashboards, but working software that…
Added 3 months ago
PF
Solution Architect
Pattison Food Group
Langley (District), BC · Langley Office - Langley BC
- Full-time
10+ years of progressive IT experience including software development, automation, systems integration, and solution architecture.
Added 4 months ago
SI
Staff R&D Engineer-17397
Synopsys Inc
Vancouver, BC
- Full-time
Strong C++ skills in performance-sensitive software development
Added 3 months ago
S
Applied AI Lead - Edmonton
Sia
Edmonton, AB
- Full-time
Mentor junior technical talent and contribute to technical hiring and practice development
Added 3 months ago
T
Senior AI Engineer - Tangerine
Tangerine
Toronto, ON
- Full-time
Collaborates with AI and Agentic Development team to ensure the Tangerine AI platform supports their success
Added 3 months ago
EA
Machine Learning Engineer
exacare ai
Canada
- Full-time
Novel Solution Development: Research, design, and implement novel machine learning solutions using modern architectures to tackle complex business problems.
Added 3 months ago
MI
Project Engineer
Magna International
Brampton, ON
- Full-time
Able to work overtime, including afternoon, evening shifts and weekends as required · Must have valid passport and driver’s license
Added 3 months ago
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Amazon
Toronto, ON
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning…
Added 2 months ago
C
Engineering Manager, FDE Agentic Platform
Cohere
Remote, Canada
- Full-time
- Remote
Foster a culture of continuous improvement and innovation, focusing on bringing agentic solutions to every step of the development process.
Added 2 months ago
W
Senior AI Engineer - Evisort AI
Workday
Vancouver, BC · Toronto, ON · Canada, BC, Vancouver
- Full-time
…contribute to other areas of the product as needed. While AI development is the primary deliverable, this is first and foremost a software engineering role requiring deep expertise in…
Added 3 months ago
CI
AI Engineering Lead (Permanent)
CoreFactor Inc.
Toronto, ON · Downtown Toronto (Toronto Dominion Centre / Design Exchange), Ontario
- Full-time
Define and execute the long-term technical strategy for AI-driven business solutions. Lead the architecture and development of scalable, real-time AI systems that address key challenges and…
Added 3 months ago
C
Head of R&D, AI Integrations
Clario
Canada
- Full-time
Lead global, multidisciplinary software development and engineering test teams to deliver high‑quality, well‑architected solutions that incorporate AI/ML frameworks
Added 3 months ago
TA
Forward Deployed Engineer (Generative AI)
Tiger Analytics
Canada
- Full-time
Leverage the Agent Developer Kit (ADK) to build and manage multi-agent systems
Added 3 months ago
TA
Gen AI Engineer
Tiger Analytics
Canada
- Full-time
Experience: Minimum of 7+ years of professional experience in software development and AI engineering
Added 3 months ago
T
Senior Machine Learning Engineer
TD
Toronto, ON
- Full-time
…opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been…
Added 3 months ago
PS
Data Scientist, Data Science and Artificial Intelligence (Temporary – 18 months)
Public Sector Pension Investment Board
Montreal, QC
- Full-time
Added 3 months ago
JI
Senior MLOps Engineer | Ingénieur·e MLOps senior
Jesta I.S.
Montreal, QC
- Full-time
Work Model: Hybrid; 2 days per week in the Montreal office
Added 3 months ago
GS
Google Cloud Platform (GCP) Architect
GlassHouse Systems
Toronto, ON
- Full-time
Contribute to practice development, service offerings, reusable assets, and thought leadership initiatives.
Added 3 months ago
[VO2 Canada] -Ingénieur.e IA / LLM – Missions Ponctuelles
VO2 Group
Montreal, QC
Added 2 months ago
Senior Machine Learning Engineer, Growth
HelloFresh
Toronto, ON
This means a minimum of 2 days in office per week, with most teams in office between 2-3 days a week
Added 3 months ago
B
Principal Cloud Security Engineer
BMO
Toronto, ON · BMOPLACE
- Full-time
Work closely with Information Security, product, and software development teams to assess cybersecurity risk and recommend solutions in cloud, AI, and data environments
Added 3 months ago
M
Staff AI Engineer
Maple
Toronto, ON
- Full-time
Partner with Product and Engineering squads on agentic feature development as a senior technical partner and reviewer

Amazon

Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Aug 11, 2026

Original job description

The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for AWS's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on AWS ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 8+ years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams Preferred Qualifications: - Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 171,400.00 - 286,200.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

You will lead a team of engineers to design and implement high-performance compute kernels for ML operations on AWS accelerators. The role involves collaborating across compiler, runtime, and hardware teams to optimize ML workloads and provide direct support to customers.

Requirements

The role requires over 10 years of experience, including at least 3 years in engineering management and 3 years in system architecture. Candidates must have a strong background in software development life cycles and experience leading multi-tier web service development.

Skills

Machine learning
Software engineering management
Kernel optimization
System architecture
Deep learning
High-performance computing
Distributed architectures
Compiler optimization
PyTorch
Performance profiling
C++
Hardware-software boundary
Team leadership
Mentoring
Technical strategy

Benefits

Health insurance
Medical
Dental
Vision
Prescription
Basic life & AD&D insurance
Deferred profit sharing plan
Paid time off

Visa sponsorship

Not detected in the job text

Keywords

AWS Neuron
Annapurna Labs
Inferentia
Trainium
Machine Learning
Kernel Engineering
Compiler
Runtime
Distributed Systems
Performance Analysis
Fusion
Sharding
Tiling
Scheduling
Software Architecture
GenAI
Cloud Computing
Engineering Management
System Design
Optimization

Report this job

Work requirements

Jobs in Canada