Find work in Canada.

622,961 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 2 months ago
Construction Superintendent - Mechanical (Mackenzie)
IREN
AB · Mackenzie
…– and this role leads the cooling side: ensuring mechanical systems are installed, tested, flushed, and commissioned to meet project requirements, industry standards, and operational…
Added 2 months ago
Senior Manager - Data Platforms (IT Management/Operations)
Scotiabank
Toronto, ON
…vendor relationships, licensing, and procurement for internal IT…
Added 2 months ago
SAP iXp Intern - CX Cloud Operation, Platform Developer (AIOps)
SAP
Montreal, QC
Position title: SAP iXp Intern - CX Cloud Operation, Platform Developer (AIOps)
Added 2 months ago
Cybersecurity - Cloud Security - Manager (Cloud Security Specialist)
EY
Toronto, ON · Montreal, QC · Vancouver, BC · Edmonton, AB · AB · Calgary, AB
…areas: Information Security, Business Management, Information Systems, Computer Science, Engineering, and/or other related…
Added 2 months ago
Installation Engineering Designer
Alstom
Toronto, ON
You'll play a central role in supporting the engineering studies and installation design efforts for one of Canada’s busiest public transit systems. Day-to-day, you’ll work closely with…
Added 2 months ago
Planning Manager
Alstom
Toronto, ON
…high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility, we offer our diverse customers the broadest portfolio in the…
Added 2 months ago
Planning Manager
Alstom
Toronto, ON
…high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility, we offer our diverse customers the broadest portfolio in the…
Added 2 months ago
PC
Sales Representative - Building Automation Systems
PHS Canada
Kirkland, QC
- Full-time
…the design and implementation of HVAC control and automation systems for the industrial sector. Join our growing team and make a meaningful impact while benefiting from the support, tools,…
Added 2 months ago
Senior ML Kernel Performance Engineer
Amazon
Toronto, ON
…the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you…
Added 2 months ago
D
Product Development Engineering Co-op
Danaher
Vancouver, BC
- Full-time
Studying Nanotechnology Engineering, Engineering Physics, Systems Engineering, Mechatronics, Biomedical Engineering, or any other multi-disciplinary degree.
Added 2 months ago
B
Project Engineer, SSV
BRP
Valcourt, QC
- Full-time
…lead the design, development, and validation of mechanical systems for a line of recreational vehicle…
Added 2 months ago
A
Street Lighting & Traffic Signal Engineer, PEng (Electrical)
AECOM
Mississauga, ON
- $85,000 to $120,000 CAD / year
- Full-time
Apply Ontario Ministry of Transportation (MTO) standards and applicable industry codes to the design of roadway lighting and traffic signal systems.
Added 2 months ago
T
Software Engineer II - Release & Deploy
TD
Toronto, ON
- Full-time
Added 3 months ago
V
Senior Embedded Developer / Développeur(e) embarqué senior
Vention
Montreal, QC
- Full-time
Develop and maintain Python-based microservices (FastAPI, MQTT, orchestration services) running on embedded Linux systems
Added 2 months ago
W
Intermediate to Senior Civil Engineer
WSP
Kamloops, BC
- Full-time
Design and deliver civil engineering solutions for municipal water, wastewater, stormwater, and roadway infrastructure projects.
Added 2 months ago
BC
Project Manager, Renewable Energy
BBA Consultants
Quebec, QC
- Full-time
We’re focused on enhancing our front-end engineering and design (FEED) as well as our project development capabilities to complement our full engineering and design suite. As Project…
Added 3 months ago
W
Project Engineer
Wood
Vancouver, BC
- $115,000 to $152,000 CAD / year
- Full-time
The Project Engineer will provide engineering support and procurement support on various sized engineering projects. This includes assisting the coordination of the execution of…
Added 2 months ago
C
Security Systems Technician - Service or Installs
Convergint
Burnaby, BC
- Full-time
…providing customer and technical support for installed security systems; installing, programming, system start-up/check-out, certification, and related customer training on assigned…
Added 2 months ago
G
Principal Engineer, Electrical
Glencore
Sparwood, BC
- $153,000 to $189,000 CAD / year
- Full-time
Understanding of Electrical Engineering Control Plans and safety management systems
Added 2 months ago
BI
Senior Game Designer – Dead by Daylight
Behaviour Interactive
Montreal, QC
- Full-time
Define and communicate the vision for the UGC and modding experience, translating creative goals into clear player and creator flows, systems, documentation, and design requirements.
Added 5 months ago
WI
Firmware Engineer
Work in Ottawa
Ottawa, ON
- Full-time
Collaborate with cross-functional teams (hardware, software, QA, systems engineering) to deliver products on schedule.
Added 2 months ago
BC
Industrial Electrical Engineer (CEP) - Relocation to Sept-Îles
BBA Consultants
Quebec, QC
- Full-time
…the mining and metals, and energy sectors. BBA's electrical engineering teams stand out among Côte-Nord clients because of their cutting-edge technical expertise. This expertise is combined…
Added 2 months ago
BE
Operations - MPD Field Operator
Beyond Energy Services and Technology Corp.
Nisku, AB
- Full-time
Post secondary education in Petroleum Engineering or related field would be an asset.
Added 3 months ago
G
Développeur(euse) logiciel / Software Developer - C#/.NET
Genetec
Quebec, QC
- Full-time
We are looking for a Software Developer who is passionate of software development and who enjoys various types of tasks and challenges of all levels of complexity. You will participate in…
Added 2 months ago
AA
Spécialiste en Vibration des Systèmes / Systems Vibration Specialist
Airbus Aircraft
Montreal, QC
- Full-time
The A220 commercial aircraft Programme is looking for a Systems Vibration Specialist to join our Flight Physics team based in Mirabel (Québec, Canada), where you will work jointly with the…

Amazon

Senior ML Kernel Performance Engineer

Toronto, ON, Canada

Apply About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 2, 2026

Original job description

The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- * Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- * Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- * Experience developing high performance libraries for HPC applications
- * Proficiency in low-level performance optimization for GPUs
- * Experience with LLVM/MLIR backend development for GPUs
- * Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- * Experience with parallel programming and optimization techniques
- * Understanding of GPU memory hierarchies and optimization strategies

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annually

Apply About employer

More about this job

Responsibilities

Design and implement high-performance compute kernels for ML operations while collaborating across compiler, runtime, and hardware teams. Analyze and optimize kernel-level performance to resolve bottlenecks and enable customer models on AWS accelerators.

Requirements

Requires 5+ years of professional software development experience with expertise in accelerator architectures and low-level performance optimization. Candidates must have a strong background in GPU kernel optimization and experience leading design or architecture for complex systems.

Skills

Machine learning
Kernel optimization
C++
CUDA
Triton
LLVM
MLIR
PyTorch
TensorFlow
High-performance computing
Distributed architectures
System architecture
Performance analysis
GPU programming
Compiler optimization
Hardware acceleration

Benefits

Health insurance
Medical insurance
Dental insurance
Vision insurance
Prescription insurance
Basic life insurance
AD&D insurance
Deferred profit sharing plan
Paid time off
Restricted stock units

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
Kernel Engineering
Inferentia
Trainium
Neuron SDK
Deep Learning
GenAI
Compiler
Runtime
PyTorch
TensorFlow
CUDA
Triton
OpenCL
SYCL
ROCm
LLVM
MLIR
HPC
GPU
Performance Optimization
Distributed Systems
Software Architecture
Profiling
Fusion
Sharding
Tiling
Scheduling
Hardware Acceleration
AWS

Report this job