Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 3 months ago
ML
Manager – Supplier Quality
Marshall Land Systems
Moncton, NB
- Full-time
Marshall Land Systems is seeking a Manager, Supplier Quality to join our team in Moncton, NB. Reporting to the Senior Quality Manager, the Manager, Supplier Quality will be responsible for…
Added 3 months ago
Product Manager
Brother Canada
Mississauga, ON · Dollard-Des Ormeaux, QC
Reporting to the Senior Product Manager, the Product Manager (PM) defines, plans, and leads the short-term (0–6 months) category Go-To-Market plan in partnership with Product Planning,…
Added 2 months ago
EI
EPC/TCS Project Manager
Ecolab Inc.
Calgary, AB
- Full-time
12+ years of progressive project/program management experience, including senior ownership of complex technical, customer-facing, capital, construction, infrastructure, or EPC-style…
Added 3 months ago
FI
Manager, Information Technology & Business
Formations Inc
Calgary, AB
- Full-time
We're looking for a Manager, Information Technology & Business Systems to own Formations' technology strategy, our ERP and core business systems, and our relationship with our external…
Added 2 months ago
RE
Senior Commissioning Technologist
Rising Edge Group
Halifax, NS
- Full-time
Valid Class 5 driver’s license required · Must have the ability to work in adverse weather conditions
Added 2 months ago
RE
Senior Commissioning Technologist
Rising Edge Group
Moncton, NB
- Full-time
Valid Class 5 driver’s license required · Must have the ability to work in adverse weather conditions
Added 2 months ago
RE
Senior Commissioning Technologist
Rising Edge Group
St. John's, NL
- Full-time
Valid Class 5 driver’s license required · Must have the ability to work in adverse weather conditions
Added 2 months ago
RE
Commissioning Technologist
Rising Edge Group
Edmonton, AB
- Full-time
Must have the ability to work in adverse weather conditions and have a valid Class 5 driver’s license
Added 2 months ago
RE
Commissioning Technologist
Rising Edge Group
Calgary, AB
- Full-time
Must have the ability to work in adverse weather conditions and have a valid Class 5 driver’s license
Added 3 months ago
BB
Senior Project Manager
Bosch Building Technologies North America
Vancouver, BC
- Full-time
As a Senior Project Manager, you will work closely with multiple teams within Bosch Building Technology as well as clients and subcontractors to scope, plan and build highly complex…
Added 3 months ago
PT
Senior Project Manager
Paladin Technologies
Vancouver, BC
- Full-time
As a Senior Project Manager, you will work closely with multiple teams within Bosch Building Technology as well as clients and subcontractors to scope, plan and build highly complex…
Added 3 months ago
E
Digital Risk Senior Manager
EY
Toronto, ON
- Full-time
To qualify for the role you must have
Added 3 months ago
E
Digital Risk Senior Manager
EY
Ottawa, ON
- Full-time
To qualify for the role you must have
Added 3 months ago
E
Digital Risk Senior Manager
EY
Halifax, NS
- Full-time
To qualify for the role you must have
Added 3 months ago
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Amazon
Toronto, ON
- Experience partnering with product or program management teams
Added 3 months ago
KC
Senior Tax Manager, Mining
KPMG Canada
Toronto, ON
- Full-time
As a Senior Tax Manager, you will work closely with Partners on complex tax planning initiatives and client engagements. Your leadership and technical expertise will enable you to oversee…
Added 3 months ago
BC
Delivery Manager - Integration
Bechtel Corporation
Toronto, ON
- Full-time
Champion, in consult with the Project Handover Manager, Project-wide handover planning and execution by leading the implementation of the Handover Management Plan and Procedures,…
Added 3 months ago
Senior Product Manager- ICM Operations
Forma.ai
Toronto, ON
Forma is hiring a Product Manager to lead key initiatives across our ICM Operations platform, spanning Core Services and Business Intelligence (BI). This includes workflows, automation,…
Added 3 months ago
A
Lead Building Operator
Allied
Vancouver, BC
- Full-time
Reporting to the Senior Manager, Technical Services, you will collaborate across our organization to address both the planned and unplanned operational needs of our buildings and support…
Added 3 months ago
Data and Research Analyst
Government of Alberta
Edmonton, AB
…housing programs and initiatives. Through your expertise in data management and analysis, you will help provide decision-makers with the information they need to improve outcomes for…
Added 3 months ago
KI
Information Technology (IT) Technician:
Kitchenuhmaykoosib Inninuwug Dibenjikewin Onaakonikewin (KIDO)
Big Trout Lake, ON
- Full-time
Must have working knowledge of the whole scope ofKIDO · Must have a working knowledge of computer systems,security, network and systems administration, databases and data storagesystems, and phone systems
Added 3 months ago
HC
Program Manager
Havas CX Canada
Toronto, ON
- Full-time
Requirements: Candidates must be available to work in the downtown Toronto office 2 days per week
Added 3 months ago
Network Operations Manager
Execulink Telecom
Woodstock, ON
Required to work in office a minimum of 3 days per week (Tuesday, Wednesday, Thursday)
Added 3 months ago
PI
Project Manager - Building Science
Pinchin in Canada
Victoria, BC
- Full-time
…variety of project activities, including site investigations and technical reporting for PCAs, DRs and BECAs, as well as training support, and quality assurance initiatives. You’ll be…
Added 3 months ago
A
Data Solutions Architect
Allied
Toronto, ON
- Full-time
Reporting to the Senior Manager, Data Strategy and Transformation, you will collaborate with Technology, Finance, Leasing, Portfolio Operations, Property Management, and other business…

Amazon

Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs

Toronto, ON, Canada

Apply on amazon.jobs About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Aug 11, 2026

Original job description

The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.

The Acceleration Kernel Library team is at the forefront of maximizing performance for AWS's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.

The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.

As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology

This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting-edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on AWS ML accelerators.

Explore the product and our history!
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html
https://aws.amazon.com/machine-learning/neuron/
https://github.com/aws/aws-neuron-sdk
https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success

Key job responsibilities
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:

* Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
* Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
* Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
* Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
* Work directly with customers to enable and optimize their ML models on AWS accelerators
* Collaborate across teams to develop innovative kernel optimization techniques

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:

Build high-impact solutions to deliver to our large customer base.

Participate in design discussions, code review, and communicate with internal and external stakeholders.

Work cross-functionally to help drive business decisions with your technical input.

Work in a startup-like development environment, where you’re always working on the most important stuff. Basic Qualifications: - 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 8+ years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams Preferred Qualifications: - Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.

CAN, ON, Toronto - 171,400.00 - 286,200.00 CAD annually

Apply on amazon.jobs About employer

More about this job

Responsibilities

You will lead a team of engineers to design and implement high-performance compute kernels for ML operations on AWS accelerators. The role involves collaborating across compiler, runtime, and hardware teams to optimize ML workloads and provide direct support to customers.

Requirements

The role requires over 10 years of experience, including at least 3 years in engineering management and 3 years in system architecture. Candidates must have a strong background in software development life cycles and experience leading multi-tier web service development.

Skills

Machine learning
Software engineering management
Kernel optimization
System architecture
Deep learning
High-performance computing
Distributed architectures
Compiler optimization
PyTorch
Performance profiling
C++
Hardware-software boundary
Team leadership
Mentoring
Technical strategy

Benefits

Health insurance
Medical
Dental
Vision
Prescription
Basic life & AD&D insurance
Deferred profit sharing plan
Paid time off

Visa sponsorship

Not detected in the job text

Keywords

AWS Neuron
Annapurna Labs
Inferentia
Trainium
Machine Learning
Kernel Engineering
Compiler
Runtime
Distributed Systems
Performance Analysis
Fusion
Sharding
Tiling
Scheduling
Software Architecture
GenAI
Cloud Computing
Engineering Management
System Design
Optimization

Report this job

Work requirements

Jobs in Canada