Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 18 days ago
IR
Senior Compiler Engineer
IC Resources
Toronto, ON
- Full-time
Senior/Staff Compiler Engineer responsibilities:
Added 19 days ago
IC
Senior Compiler Engineer
Intel Corporation
Toronto, ON · CAN - - Toronto
- Full-time
The Compiler Engineering team in Data Center Group at Intel has an opportunity available for a Senior Compiler Engineer.
Added 23 days ago
Sr. Software Development Engineer, Neuron Explorer
Amazon
Toronto, ON
…UI, and the CLI that make up Neuron Explorer, partnering with compiler, runtime, and chip architecture teams to expose the data customers need to optimize their models. You will work with…
Added 26 days ago
C
AI Inference Core - Senior SDET, Release Integration Testing
Cerebras
Toronto, ON
- Full-time
We are looking for an experienced, hands-on Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing (RIT) function within Release & Feature Qualification…
Added 1 month ago
N
Senior Machine Learning Applications and Compiler Engineer, LPX
NVIDIA
Canada
- Full-time
We are now looking for a Senior Machine Learning Applications and Compiler Engineer!
Added 1 month ago
ET
Senior Analog Design Engineer
ESS Technology, Inc.
Kelowna, BC
- Full-time
As a Senior Analog Design Engineer, you will be a key technical contributor within the analog design group, responsible for the following:
Added 1 month ago
GM
Senior Software Developer - Virtualization and SIL Integration
General Motors
Markham, ON
- Full-time
…of Virtualization and Software-in-the-Loop (SIL) Integration Engineer to support our Test Environment Agile Release Train (SIL…
Added 1 month ago
AM
Sr. Physical Design Engineer, Place & Route Lead
Advanced Micro Devices, Inc
Markham, ON
- Full-time
…high-performance computing products on advanced process technologies. As a Senior Physical Design Engineer, you will lead physical implementation activities for complex designs, driving…
Added 1 month ago
A
Sr. Physical Design Engineer, Place & Route Lead
AMD
Markham, ON
- $155,200 to $232,800 CAD / year
- Full-time
…high-performance computing products on advanced process technologies. As a Senior Physical Design Engineer, you will lead physical implementation activities for complex designs, driving…
Added 1 month ago
UR
LLM Engineer
Urban Ridge Supplies
Markham, ON
- Full-time
…smarter, connected future for all. As a Qualcomm Machine Learning Engineer, you will create and implement machine learning techniques, frameworks, and tools that enable the efficient…
Added 1 month ago
OG
Compiler Engineer
Oho Group
Toronto, ON
- $200,000 to $300,000 CAD / year
- Full-time
We’re working with a well-funded start-up building a new compiler and software stack for high-performance accelerated computing.
Added 1 month ago
Q
GPU Compiler Engineer - Multiple Levels
Qualcomm
Markham, ON
- Full-time
…create a smarter, connected future for all. As a Qualcomm GPU Engineer, you may architect, design, implement, verify, and/or optimize the performance and power of GPU cores. Qualcomm…
Added 1 month ago
Q
FY27 Intern - Physical Mixed Layout Engineering Internship - Canada (16 months)
Qualcomm
Toronto, ON
- Full-time
As a Physical Mixed Layout Engineer Intern, you will have the unique opportunity to work alongside our experienced design team on the layout of complex integrated circuits. You will be…
Added 2 months ago
Senior Mobile Programmer
Epic Games
Montreal, QC
The Fortnite Technology Team is looking for an experienced Mobile Platform Engineer passionate about creating world-class, industry leading game engine technologies, targeting the full…
Added 2 months ago
EC
Digital - ASIC Design Automation Engineer
Eliyan Corporation
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Familiarity with industry-standard EDA tools (Synopsys VCS, Verdi, PrimeTime, Design Compiler; Cadence Genus; Spyglass; Questa; JasperGold).
Added 6 months ago
E
Digital - ASIC Design Automation Engineer
Eliyan
Toronto, Ontario
- Full-time
Familiarity with industry-standard EDA tools (Synopsys VCS, Verdi, PrimeTime, Design Compiler; Cadence Genus; Spyglass; Questa; JasperGold).
Added 2 months ago
MT
Senior SoC Design Engineer
Microchip Technology Inc.
Burnaby, BC · Canada - Burnaby
- $86,000 to $186,000 CAD / year
- Full-time
As a Senior Engineer I-Design , your job will be contributing to the following areas under guidance of experienced leaders in product development field:
Added 2 months ago
Senior ML Kernel Performance Engineer
Amazon
Toronto, ON
…ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling…
Added 3 months ago
FM
Software Development (Embedded) Engineer
Ford Motor Company
Ottawa, ON · Kanata, ON
- Full-time
Candidates who are in commuting distance to a Ford hub location may be required to be onsite four or more days per week
Added 3 months ago
R
SMTS Logic Design
Rambus
Montreal, QC
- Other
Employees are encouraged to spend an average of at least three days per week onsite, allowing for two days of remote work
Added 3 months ago
Q
Senior Embedded Software Engineer (C/C++), Machine Learning
Qualcomm
Markham, ON
- Full-time
1+ year of work experience in a role requiring interaction with senior leadership (e.g., Director and above).
Added 3 months ago
Q
Senior ASIC Design Engineer, Compute DSP/AI Processors (multiple levels)
Qualcomm
Markham, ON
- Full-time
Use of various design tools (VCS Simulator, Synopsys Compiler , Linting, CDC, LEC, CLP etc.) to check and improve design quality
Added 2 months ago
Software Development Engineer, Neuron Explorer
Amazon
Toronto, ON
…UI, and the CLI that make up Neuron Explorer, partnering with compiler, runtime, and chip architecture teams to expose the data customers need to optimize their models. You will work with…
Added 2 months ago
Sr. Memory Layout Engineer (7676)
TSMC
Ottawa, ON
In the role of Senior Memory Layout Engineer, you will primarily be responsible for challenging and cutting-edge custom layout design and be involved in R&D projects implemented on the…
Added 7 months ago
Q
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
Qualcomm
Markham, ON
- Full-time
Work closely with customers to drive solutions by collaborating with internal compiler, firmware and platform teams.

Amazon

Senior ML Kernel Performance Engineer

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 2, 2026

Original job description

The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- * Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- * Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- * Experience developing high performance libraries for HPC applications
- * Proficiency in low-level performance optimization for GPUs
- * Experience with LLVM/MLIR backend development for GPUs
- * Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- * Experience with parallel programming and optimization techniques
- * Understanding of GPU memory hierarchies and optimization strategies

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

Design and implement high-performance compute kernels for ML operations while collaborating across compiler, runtime, and hardware teams. Analyze and optimize kernel-level performance to resolve bottlenecks and enable customer models on AWS accelerators.

Requirements

Requires 5+ years of professional software development experience with expertise in accelerator architectures and low-level performance optimization. Candidates must have a strong background in GPU kernel optimization and experience leading design or architecture for complex systems.

Skills

Machine learning
Kernel optimization
C++
CUDA
Triton
LLVM
MLIR
PyTorch
TensorFlow
High-performance computing
Distributed architectures
System architecture
Performance analysis
GPU programming
Compiler optimization
Hardware acceleration

Benefits

Health insurance
Medical insurance
Dental insurance
Vision insurance
Prescription insurance
Basic life insurance
AD&D insurance
Deferred profit sharing plan
Paid time off
Restricted stock units

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
Kernel Engineering
Inferentia
Trainium
Neuron SDK
Deep Learning
GenAI
Compiler
Runtime
PyTorch
TensorFlow
CUDA
Triton
OpenCL
SYCL
ROCm
LLVM
MLIR
HPC
GPU
Performance Optimization
Distributed Systems
Software Architecture
Profiling
Fusion
Sharding
Tiling
Scheduling
Hardware Acceleration
AWS

Report this job

Work requirements

Jobs in Canada