Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 2 months ago
DD
Vehicle Management System Engineer
Dominion Dynamics
Ottawa, ON
- Full-time
Architect fault detection, isolation, and recovery (FDIR) logic and fail-safe behavior across central flight processing hardware and distributed actuators.
Added 2 months ago
TA
Bilingual Customer Success Specialist
Tali AI
Toronto, ON
- Full-time
As Bilingual Customer Success Specialist, you aren't just solving problems, you are the architect of the customer’s first 90 days. You will be responsible for turning new sign-ups into…
Added 2 months ago
Modern Infrastructure Customer Solutions Architect
Softchoice
Montreal, QC
Added 2 months ago
Associate Director, Customer Compensation & Policy
HelloFresh
Toronto, ON
The ideal candidate brings a rare combination: analytical rigor sharp enough to architect a global compensation engine from first principles, and the executive presence to drive adoption…
Added 2 months ago
Lead Technical Project Manager
MAP
Toronto, ON
Adobe Certifications: Adobe Certified Expert / Business Practitioner (ACC BP), AEP / CJA Architect or Specialist, Adobe Workfront Certification
Added 2 months ago
IT Industrial CrossFunction - Full Stack & AI Integration
Amrize
Mississauga, ON · Laval, QC
Partner with other IT/business stakeholders to define a technical roadmap, identify dependencies, and contribute to architect solutions that meet business needs with minimum deployment…
Added 2 months ago
SI
Lead Architect - Technical Delivery & Solutions
SIA Innovations Inc.
Montreal, QC
- Full-time
Added 2 months ago
DP
Building Systems & Quality Assurance Specialist
DEL PROPERTY MANAGEMENT INC.
Toronto, ON · Greater Toronto Area, Canada
- $120,000 to $140,000 CAD / year
- Full-time
Added 2 months ago
MC
Full Stack Software Developer (Full-time; Hybrid)
Mainstreet Credit Union Canada
Strathroy, ON
- $84,788 to $105,985 CAD / year
- Full-time
…access control expectations. You will work with the Technology Architect and Systems Administrator on platform patterns, security and integration approaches, Active Directory and Microsoft…
Added 2 months ago
C
Presales Solution Architect
Centrilogic
ON · Ontario, Canada
- Full-time
Presales Solution Architect, Cloud, AI and Data
Added 5 months ago
GA
Staff Software Engineer, Backend
Genius AI
Remote, Canada
- Full-time
- Remote
Architect and own the technical direction of AI-powered products and 0-to-1 builds, weighing long-term trade-offs with precision and keeping a healthy backlog of forward-looking,…
Added 2 months ago
GA
Software Engineer - All Levels
Genius AI
Remote, Canada
- Full-time
- Remote
…assist them. The engineers who join now will be the ones who architect it. We're hiring across two paths: product engineers who work at the intersection of AI capabilities and customer…
Added 2 months ago
SL
AI Engineer
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
Work closely with the Enterprise Architect to design and implement solutions that align with the platform capabilities roadmap
Added 7 months ago
K
Senior Consultant, Enterprise Performance Management
KPMG
Calgary, AB
- Full-time
Plan, architect, design, configure and test models and integrations.
Added 2 months ago
RA
Robotics Researcher
Rockwell Automation
Kitchener, ON · Waterloo, ON · Canada-Ontario-Waterloo
- $121,440 to $182,160 CAD / year
- Full-time
Architect & Implement: Design and deploy state-of-the-art algorithms for robotic perception, planning, and dexterous manipulation.
Added 2 months ago
JG
Information Architect - Senior
J&M Group
St. Catharines, ON
- Full-time
Added 2 months ago
B
Technical Recruiter
Bree
Toronto, ON
- Contract
…growth. As an early member of the talent team, you will be the architect of our engineering and product teams. You are someone who thrives in a high-velocity environment and is excited to…
Added 2 months ago
T
Directeur(trice), solutions clients SAP | SAP Customer Solution Director
Talan
Montreal, QC
- Full-time
Added 2 months ago
C
Senior Lead Software Engineer, Payment Systems - Vice President
Citi
Mississauga, ON
- Full-time
Citi's Core Payment Systems team is looking for a Senior Lead Software Engineer to architect and drive the modernization of global payment processing platforms that move USD 4 trillion in…
Added 2 months ago
Agentic AI Engineer/Architect - FTA
SIA Innovations INC
Montreal, QC
Fast-Track Apprenticeship Program - System Architect
Added 2 months ago
Senior ML Kernel Performance Engineer
Amazon
Toronto, ON
…high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of…
Added 2 months ago
C
Analog/mixed-signal IC Developer - Acacia (Hybrid)
Cisco
Ottawa, ON · Kanata, ON
- Full-time
This role can be performed Hybrid with three days per week onsite at our Ottawa office
Added 2 months ago
C
Analog/mixed-signal IC Developer - Acacia (Hybrid)
Cisco
Vancouver, BC
- Full-time
This role can be performed Hybrid with three days per week onsite at our Ottawa office
Added 2 months ago
B
Senior Consultant - Google Cloud Advisory - Firebase
BDO
Toronto, ON
- Full-time
Google Cloud Professional Cloud Architect Certification.
Added 2 months ago
D
Senior Solutions Engineer, Mid-Enterprise
Docker
Remote, Canada
- Full-time
- Remote
Proven experience as a Sales Engineer, Solutions Engineer, or Solution Architect in complex enterprise sales.

Amazon

Senior ML Kernel Performance Engineer

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 2, 2026

Original job description

The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- * Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- * Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- * Experience developing high performance libraries for HPC applications
- * Proficiency in low-level performance optimization for GPUs
- * Experience with LLVM/MLIR backend development for GPUs
- * Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- * Experience with parallel programming and optimization techniques
- * Understanding of GPU memory hierarchies and optimization strategies

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

Design and implement high-performance compute kernels for ML operations while collaborating across compiler, runtime, and hardware teams. Analyze and optimize kernel-level performance to resolve bottlenecks and enable customer models on AWS accelerators.

Requirements

Requires 5+ years of professional software development experience with expertise in accelerator architectures and low-level performance optimization. Candidates must have a strong background in GPU kernel optimization and experience leading design or architecture for complex systems.

Skills

Machine learning
Kernel optimization
C++
CUDA
Triton
LLVM
MLIR
PyTorch
TensorFlow
High-performance computing
Distributed architectures
System architecture
Performance analysis
GPU programming
Compiler optimization
Hardware acceleration

Benefits

Health insurance
Medical insurance
Dental insurance
Vision insurance
Prescription insurance
Basic life insurance
AD&D insurance
Deferred profit sharing plan
Paid time off
Restricted stock units

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
Kernel Engineering
Inferentia
Trainium
Neuron SDK
Deep Learning
GenAI
Compiler
Runtime
PyTorch
TensorFlow
CUDA
Triton
OpenCL
SYCL
ROCm
LLVM
MLIR
HPC
GPU
Performance Optimization
Distributed Systems
Software Architecture
Profiling
Fusion
Sharding
Tiling
Scheduling
Hardware Acceleration
AWS

Report this job

Work requirements

Jobs in Canada