Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 2 months ago
JG
Senior Machine Learning Engineer
J&M Group
Toronto, ON
- Full-time
We are looking for an experienced Senior Machine Learning Engineer to support the AI CoE s Machine Learning and Data Science initiatives.
Added 2 months ago
FW
ELECTRONIC SYSTEMS & AVIONICS ENGINEER (M/F)
FLYING WHALES
Montreal, QC
- Full-time
Lead the development of flight control computers and avionics systems (hardware & software)
Added 2 months ago
KD
Embedded Firmware and Controls Engineer
Kyte Dynamics | Aerial Robotics Co.
Richmond, BC
- Full-time
We are seeking an Embedded Firmware & Controls Engineer to develop the low-level software and control systems that power our aerial robotics platforms. This role focuses on embedded…
Added 6 months ago
E
Municipal Engineer
Englobe
Edmonton, AB
- Full-time
Our MPE Edmonton Office is hiring a Municipal Engineer to join the team. This role is ideal for a professional engineer who is eager to work on diverse and impactful projects within a…
Added 2 months ago
TO
Mechanical Design Engineer- Plasma Diagnostics
Type One Energy
Vancouver, BC
- Full-time
If You Are Searching For The Best New Ideas And Share Our Vision, Join Us As a Mechanical Design Engineer- Plasma Diagnostics. This Is What You Need To Know
Added 2 months ago
CN
Hoisting and Rigging Engineering Specialist
Canadian Nuclear Laboratories
Chalk River, ON
- Full-time
Working schedule: Five (5) days per week, seven and a half (7.5) hours per day for a thirty-seven and a half (37.5) hour work week
Added 2 months ago
LM
Senior Systems Engineer - Integrated Bridge and Navigation
Lockheed Martin
Montreal, QC
- $91,250 to $119,750 CAD / year
- Full-time
Possess a bachelors’ degree from an accredited university in software, hardware, systems, mechanical, electrical or electronics engineering or a related discipline
Added 2 months ago
LM
Senior ILS \ Sustainment Engineer
Lockheed Martin
Halifax, NS
- Full-time
Familiarity with LSAR, RMA and LSA software tools
Added 2 months ago
LM
Systems Engineer - Underwater Warfare Systems (UWW)
Lockheed Martin
Halifax, NS
- Full-time
Possess a bachelors’ degree from an accredited university in software, hardware, systems, mechanical, electrical or electronics engineering or a related discipline
Added 2 months ago
AC
Senior Control Systems Software Designer
ATS Corporation
Cambridge, ON
- $42.31 to $58.17 CAD / hour
- Full-time
Integration of software with electrical and mechanical systems
Added 2 months ago
SP
Account Solution Engineer
Salesforce Partner Canada
Toronto, ON
- Full-time
The Solution Engineer is a role that we often hire at Salesforce. If you are interested in any type of Solution Engineering role, you've come to the right place. We look forward to…
Added 2 months ago
RB
Staff AI Engineer, AI DLC Platform
Royal Bank of Canada
Toronto, ON
- Full-time
Engineer reliability into the platform - circuit breakers, graceful degradation, rollback mechanisms, and zero-downtime deployments.
Added 2 months ago
T
Directeur(trice), solutions clients SAP | SAP Customer Solution Director
Talan
Montreal, QC
- Full-time
Added 2 months ago
A
Senior Structural Engineer - Mining & Industrial
AECOM
Edmonton, AB · Calgary, Alberta
- $120,000 to $180,000 CAD / year
- Full-time
We are seeking a highly skilled and experienced Senior Structural Engineer - Mining & Industrial to join our team for our Canadian mine infrastructure team.
Added 2 months ago
A
Senior Structural Engineer - Mining & Industrial
AECOM
Regina, SK · Calgary, Alberta
- $120,000 to $170,000 CAD / year
- Full-time
We are seeking a highly skilled and experienced Senior Structural Engineer - Mining & Industrial to join our team for our Canadian mine infrastructure team.
Added 2 months ago
N
IT Software Engineer - Microsoft Tools Team
Nelnet
Mississauga, ON · CAN - MISSISSAUGA
- Full-time
Responsible for developing enterprise wide cross-functional software solutions, working closely with IT Software Architects and IT Business Analysts technical teams.
Added 2 months ago
C
Senior Lead Software Engineer, Payment Systems - Vice President
Citi
Mississauga, ON
- Full-time
Citi's Core Payment Systems team is looking for a Senior Lead Software Engineer to architect and drive the modernization of global payment processing platforms that move USD 4 trillion in…
Added 2 months ago
Agentic AI Engineer/Architect - FTA
SIA Innovations INC
Montreal, QC
FORWARD - DEPLOYED Engineer · Montréal, QC · Full-Time, Permanent · 100% On-Site · Start Date: September 14, 2026
Added 2 months ago
Senior Software Development Engineer, Amazon MQ
Amazon
Vancouver, BC
As a Software Development Engineer with Amazon MQ, you will be responsible for designing, developing, testing, and deploying distributed open-source message broker systems and large-scale…
Added 2 months ago
T
Senior Java Full Stack Engineer, TD Securities
TD
Toronto, ON
- Full-time
Added 2 months ago
SAP iXp Intern - CX Cloud Operation, Platform Developer (AIOps)
SAP
Montreal, QC
We’re looking for someone curious, proactive, and passionate about both software engineering and AI-driven innovation in cloud operations.
Added 2 months ago
Senior ML Kernel Performance Engineer
Amazon
Toronto, ON
The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators,…
Added 2 months ago
A
Street Lighting & Traffic Signal Engineer, PEng (Electrical)
AECOM
Mississauga, ON
- $85,000 to $120,000 CAD / year
- Full-time
AECOM is seeking a Street Lighting & Traffic Signal Engineer to join our Transportation team based in Mississauga, Ontario.
Added 2 months ago
T
Software Engineer II - Release & Deploy
TD
Toronto, ON
- Full-time
We are looking for a hands-on engineer to improve how a digital banking platform is built, released, and operated. You will coordinate deployments, maintain and troubleshoot CI/CD…
Added 2 months ago
B
Principal Azure Cloud Platform Engineer
BMO
Toronto, ON · BMOPLACE
- Full-time
As a Principal Azure Platform Engineer, you will play a hands‑on engineering role within BMO’s Azure cloud ecosystem. You will be responsible for designing, building, and operating secure,…

Amazon

Senior ML Kernel Performance Engineer

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 2, 2026

Original job description

The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- * Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- * Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- * Experience developing high performance libraries for HPC applications
- * Proficiency in low-level performance optimization for GPUs
- * Experience with LLVM/MLIR backend development for GPUs
- * Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- * Experience with parallel programming and optimization techniques
- * Understanding of GPU memory hierarchies and optimization strategies

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

Design and implement high-performance compute kernels for ML operations while collaborating across compiler, runtime, and hardware teams. Analyze and optimize kernel-level performance to resolve bottlenecks and enable customer models on AWS accelerators.

Requirements

Requires 5+ years of professional software development experience with expertise in accelerator architectures and low-level performance optimization. Candidates must have a strong background in GPU kernel optimization and experience leading design or architecture for complex systems.

Skills

Machine learning
Kernel optimization
C++
CUDA
Triton
LLVM
MLIR
PyTorch
TensorFlow
High-performance computing
Distributed architectures
System architecture
Performance analysis
GPU programming
Compiler optimization
Hardware acceleration

Benefits

Health insurance
Medical insurance
Dental insurance
Vision insurance
Prescription insurance
Basic life insurance
AD&D insurance
Deferred profit sharing plan
Paid time off
Restricted stock units

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
Kernel Engineering
Inferentia
Trainium
Neuron SDK
Deep Learning
GenAI
Compiler
Runtime
PyTorch
TensorFlow
CUDA
Triton
OpenCL
SYCL
ROCm
LLVM
MLIR
HPC
GPU
Performance Optimization
Distributed Systems
Software Architecture
Profiling
Fusion
Sharding
Tiling
Scheduling
Hardware Acceleration
AWS

Report this job

Work requirements

Jobs in Canada