Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 2 months ago
RB
Staff AI Engineer, AI DLC Platform
Royal Bank of Canada
Toronto, ON
- Full-time
Engineer reliability into the platform - circuit breakers, graceful degradation, rollback mechanisms, and zero-downtime deployments.
Added 2 months ago
T
Directeur(trice), solutions clients SAP | SAP Customer Solution Director
Talan
Montreal, QC
- Full-time
Talan est un groupe international qui accompagne ses clients dans leur transformation Data & IA, de bout en bout, en combinant conseil en management et expertise technologique.
Added 2 months ago
C
Senior Lead Software Engineer, Payment Systems - Vice President
Citi
Mississauga, ON
- Full-time
Citi's Core Payment Systems team is looking for a Senior Lead Software Engineer to architect and drive the modernization of global payment processing platforms that move USD 4 trillion in…
Added 2 months ago
Agentic AI Engineer/Architect - FTA
SIA Innovations INC
Montreal, QC
FORWARD - DEPLOYED Engineer · Montréal, QC · Full-Time, Permanent · 100% On-Site · Start Date: September 14, 2026
Added 2 months ago
SAP iXp Intern - CX Cloud Operation, Platform Developer (AIOps)
SAP
Montreal, QC
Basic understanding of data structures, algorithms, and software engineering principles
Added 2 months ago
Senior ML Kernel Performance Engineer
Amazon
Toronto, ON
Added 5 months ago
WI
Firmware Engineer
Work in Ottawa
Ottawa, ON
- Full-time
We are excited to partner with AttoTude to attract top talent for Firmware Engineer.
Added 2 months ago
A
Senior Software Engineer, Inference
AssemblyAI
Canada
- $190,000 to $225,000 USD / year
- Full-time
We're hiring a Software Engineer to help turn cutting-edge AI research into products our customers rely on every day. You'll sit on a fast-paced engineering team between our research org…
Added 2 months ago
JC
Fire Systems Project Specialist
Johnson Controls
Delta, BC · Vancouver, BC · CAN BC DELTA
- Full-time
…resilience required in rapidly expanding industries such as data centers, healthcare, pharmaceuticals, advanced manufacturing, and higher…
Added 2 months ago
Staff Software Engineer
PlayStation Global
Waterloo, ON
Staff Software Engineer, Adaptive Experiences Platform
Added 2 months ago
Molding - Thermoforming Machine Operator(6 months Contract) - Shift B (7:30am - 7:30pm)
Polytainers Inc
Toronto, ON
…quality and delivery targets. He or she collects operating data for the purpose of conducting on-line adjustments to products, instruments, or equipment and troubleshoots technical…
Added 2 months ago
Procurement Engineer
Aecon
Pickering, ON · Toronto, ON
…support to the Manager of Proposals and Estimating or Project Engineer for Proposal and Project support respectively. May work directly with other Aecon personnel / departments,…
Added 2 months ago
S
Senior Data Engineer
Super.com
Remote, Canada
- Full-time
- Remote
As a Senior Data Engineer, you will be a key member of a high-performing team of senior data professionals, reporting directly to an Engineering Manager. You will be expected to tackle the…
Added 2 months ago
Portfolio Manager, Multi-Asset Wealth Solutions
Purpose Unlimited
Toronto, ON
AI handles the aggregation - pulling model and fund performance data, drafting first-pass commentary, flagging mandate drift across sub-advisors. You handle the judgment - the construction…
Added 2 months ago
O
Test Engineer
ORBCOMM
Ottawa, ON
- $75,000 to $95,000 CAD / year
- Full-time
…at their best? At ORBCOMM, we're looking for a hands-on Test Engineer to design, develop, and support automated test solutions used throughout product development, validation, and…
Added 2 months ago
S
Intermediate / Senior Product Engineer
Symend
Remote, Canada
- Full-time
- Remote
…You’re not a PM who hands off to engineering. You’re not an engineer who gets handed a spec. You do both, and you’re accountable for whether the product finds its…
Added 4 months ago
Senior QA Automation Engineer I (AP/ERP)
EBizCharge
Canada
Data entry, reporting, and transactional processes.
Added 2 months ago
GD
Junior Hardware Engineering Developer, FPGA
General Dynamics Missions System International
Ottawa, ON
- Full-time
Engineer, implement, and optimize FPGA-based solutions using Vivado, focusing on VHDL and HLS code development.
Added 2 months ago
T
Solution Engineer
Tanium
Ottawa, ON
- Full-time
Added 2 months ago
EE
GTM Engineer (Lead)
Edgecom Energy
Toronto, ON
- $150,000 to $180,000 CAD / year
- Full-time
…economics justify more hands, and you’ll make that case with…
Added 2 months ago
TM
PAVE AL | Project Manager
The Miller Group
Mississauga, ON
- Full-time
5+ years’ hands-on experience as a Project Coordinator, Project Engineer or Project Manager (or a combination thereof) handling medium to large scale road construction projects from…
Added 2 months ago
P
Remote Senior AI Product Engineer for a Climate Tech SaaS Company
Pearl
Remote, Canada
- Full-time
- Remote
An early-stage climate tech SaaS company is looking for a Senior AI Product Engineer to own end-to-end product feature delivery for its real-time carbon footprint and lifecycle assessment…
Added 2 months ago
P
Principal AI Engineer
PointClickCare
Mississauga, ON
- Full-time
PointClickCare is searching for a Principal AI Engineer who will lead and design AI systems across multiple SaaS solutions following our AI Design Patterns, defining technical standards and…
Added 2 months ago
GD
Co-op Winter 2027 - Software Developer - 8 Months
General Dynamics Missions System International
Ottawa, ON
- Internship
The Applications team for the Land C5ISR Program is looking for a Co-op Software Engineer to join our team. We develop and integrate various software products that enable the Canadian Army…
Added 2 months ago
Infrastructure Operations Engineer
NexGen Cloud
Quebec, QC
Direct hands-on experience physically working in data centres - you've personally stacked and racked hardware on-site

Amazon

Senior ML Kernel Performance Engineer

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 2, 2026

Original job description

The Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- * Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
- * Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
- * Experience developing high performance libraries for HPC applications
- * Proficiency in low-level performance optimization for GPUs
- * Experience with LLVM/MLIR backend development for GPUs
- * Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
- * Experience with parallel programming and optimization techniques
- * Understanding of GPU memory hierarchies and optimization strategies

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

Design and implement high-performance compute kernels for ML operations while collaborating across compiler, runtime, and hardware teams. Analyze and optimize kernel-level performance to resolve bottlenecks and enable customer models on AWS accelerators.

Requirements

Requires 5+ years of professional software development experience with expertise in accelerator architectures and low-level performance optimization. Candidates must have a strong background in GPU kernel optimization and experience leading design or architecture for complex systems.

Skills

Machine learning
Kernel optimization
C++
CUDA
Triton
LLVM
MLIR
PyTorch
TensorFlow
High-performance computing
Distributed architectures
System architecture
Performance analysis
GPU programming
Compiler optimization
Hardware acceleration

Benefits

Health insurance
Medical insurance
Dental insurance
Vision insurance
Prescription insurance
Basic life insurance
AD&D insurance
Deferred profit sharing plan
Paid time off
Restricted stock units

Visa sponsorship

Not detected in the job text

Keywords

Machine Learning
Kernel Engineering
Inferentia
Trainium
Neuron SDK
Deep Learning
GenAI
Compiler
Runtime
PyTorch
TensorFlow
CUDA
Triton
OpenCL
SYCL
ROCm
LLVM
MLIR
HPC
GPU
Performance Optimization
Distributed Systems
Software Architecture
Profiling
Fusion
Sharding
Tiling
Scheduling
Hardware Acceleration
AWS

Report this job

Work requirements

Jobs in Canada