Find work in Canada.

547,906 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 44 mins ago
P
Senior DevOps Engineer
Pixieset
Vancouver, BC
- Full-time
We’re hiring a Senior DevOps Engineer to strengthen the shared platforms, infrastructure, and delivery workflows that our engineering teams rely on.
Added 1 hour ago
TA
Forward Deployed Engineer (FDE) - GenAI / Agentic AI
Tiger Analytics
Toronto, ON
- Full-time
Tiger Analytics is looking for experienced Forward Deployed Engineer with Gen AI experience to join our fast-growing advanced analytics consulting firm. Our employees bring deep expertise…
Added 1 hour ago
V
Construction and Commissioning Lead
Vale
Canada
- Full-time
Previous experience as a construction lead, supervisor or field engineer preferred
Added 1 hour ago
TU
Data Science & AI Graduate Scheme - Halifax
targetjobs UK
Halifax, NS
- Temporary
A Machine Learning & AI Engineer designing and deploying robust ML systems that bring data science to life through automation, CI/CD, and modern cloud engineering practices.
Added 1 hour ago
MC
AI Platform Engineer (35577)
Myticas Consulting
Toronto, ON
- Contract
Added 1 hour ago
PC
Application Release Engineer
Pyramid Consulting, Inc
Toronto, ON
- Contract
Immediate need for a talented Application Release Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Toronto - ON (Hybrid). Please review the job…
Added 1 hour ago
AI
AI Engineer (Agentic Systems)
Ample Insight Inc.
Toronto, ON
- Contract
Added 1 hour ago
A
Mechanical Engineer (Onsite)
Alchemy
Waterloo, ON
- $100,000 to $135,000 CAD / year
- Full-time
Alchemy is currently in search of a Mechanical Engineer in Waterloo, ON.
Added 1 hour ago
K
Senior Consultant - Cybersecurity, Strategy & Transformation
KPMG
Vancouver, BC · Victoria, BC
- Full-time
…cloud certifications such as Azure Fundamentals, Azure Security Engineer, AWS Technical Essentials or…
Added 1 hour ago
K
Consultant - Cybersecurity, Strategy & Transformation
KPMG
Vancouver, BC · Victoria, BC
- Full-time
…cloud certifications such as Azure Fundamentals, Azure Security Engineer, AWS Technical Essentials or…
Added 2 hours ago
TM
Ice Cream Process Engineer
The Magnum Ice Cream Company
ON · Simcoe, ON
- Full-time
Process engineers are involved in continuous improvements from the engineer viewpoint, responsible to solve chronical problems, reduce NVAA, develop standards, and drive productivity while…
Added 2 hours ago
AA
Ingénieur principal ou ingénieure principale en assurance qualité des logiciels/Senior Software Quality Assurance Engineer (ALQ)
Aviya Aerospace Systems
Longueuil, QC
- Full-time
…Aviya has an opening for a Senior Software Quality Assurance Engineer to join our engineering group in Montreal, Longueuil. ***Applicants are asked to submit an English resume as part of…
Added 2 hours ago
CC
Night Supervisor, Maintenance
Coca-Cola Canada Bottling Limited
Brampton, ON
- Full-time
Mechanical Engineering or Electrical Engineer background preferred.
Added 2 hours ago
P
DevOps Team Lead
Pixieset
Vancouver, BC
- Full-time
Added 2 hours ago
N
Senior Machine Learning Applications and Compiler Engineer, LPX
NVIDIA
Toronto, ON · Canada, Toronto
- Full-time
We are now looking for a Senior Machine Learning Applications and Compiler Engineer!
Added 2 hours ago
ST
AI Engineer
SS&C Technologies
Mississauga, ON
- Full-time
…Artificial Intelligence, and we're looking for an experienced AI Engineer to help lead that…
Added 3 hours ago
FA
Technical Sales Engineer - General Industry
FANUC America Corporation
Blainville, QC
- $93,000 to $138,000 CAD / year
- Full-time
FANUC Canada Sales Team is seeking a highly motivated, customer-focused Technical Sales Engineer - General Industry, based in Blainville, Quebec to help drive revenue growth and enhance…
Added 3 hours ago
L
Senior Software Engineer – AI Agents
lululemon
Vancouver, BC
- Full-time
As a Senior Software Engineer – AI Agents, you will lead the design and implementation of complex software systems and features spanning multiple services and components, establishing…
Added 3 hours ago
BC
Intermediate Structural Engineer
Bantrel Co.
Calgary, AB
- Full-time
We are currently seeking a qualified Intermediate Structural Engineer to join our Energy team, based out of Calgary. The Intermediate Structural Engineer will be responsible for developing…
Added 3 hours ago
E
Thanks for visiting our Job Board. Please review our open positions and apply to the positions that match your qualifications.
Evertz
Burlington, ON
- Full-time
The Process Engineer - SMT Support is responsible for developing, optimizing, and sustaining surface mount technology (SMT) manufacturing processes used in the production of broadcast and…
Added 3 hours ago
O
Senior/Staff Software Engineer - Tech Lead
OpenMined
Remote, Canada
- $126,000 to $188,000 USD / year
- Contract
- Remote
We're looking for a Senior / Staff Software Engineer to join OpenMined, a nonprofit building open-source infrastructure for federated AI.
Added 3 hours ago
OG
Intermediate Software Engineer - Onni Capital
Onni Group of Companies
Vancouver, BC
- Full-time
There is an exciting opportunity for an Intermediate Software Engineer to join Onni Capital in Vancouver.
Added 3 hours ago
Filed Engineer
Aecon
Calgary, AB
Aecon is seeking a Field Engineer to support the delivery of a major infrastructure project in Calgary, Alberta. This site-based position provides an opportunity to play an integral role in…
Added 3 hours ago
MM
Technical Leader
Martell Media
Waterloo, ON
- Full-time
Team adoption. Every engineer and contractor is effectively using the pipeline, with clear standards, shared workflows, and documented best practices.
Added 3 hours ago
W
Senior Salesforce Developer
Webflow
Remote, Canada
- Full-time
- Remote

Aptino, Inc.

Senior Machine Learning Systems Engineer

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 30, 2026

Original job description

We are looking for an experienced Senior Machine Learning Systems Engineer to optimize large language model (LLM) inference performance across AWS Trainium platforms, including Trainium2 and Trainium3.

The ideal candidate will have strong hands-on experience in Python, PyTorch, LLM inference frameworks, and accelerator performance optimization. This role focuses on improving inference latency, throughput, scalability, and cost efficiency for production-grade AI workloads.

Key Responsibilities:

Optimize LLM inference performance, focusing on decode latency, throughput, and serving costs.
Work with AWS Trainium2/Trainium3, AWS Neuron SDK, and vLLM on Neuron.
Implement and evaluate speculative decoding and Multi-Token Prediction (MTP) for Qwen-family models.
Profile, benchmark, and optimize production LLM workloads across GPU and Trainium platforms.
Optimize prefill/decode performance, continuous batching, KV-cache, and tensor/expert parallelism.
Support long-context inference workloads (100K+ tokens) and multi-chip scaling.
Work with advanced AI architectures, including Mixture of Experts (MoE) and State Space Models.
Develop benchmarking reports, technical documentation, implementation guides, and customer runbooks.
Collaborate with customer engineering teams to deliver measurable performance improvements.

Required Skills & Experience:

5+ years of experience in Machine Learning or Systems Engineering.
2+ years of hands-on experience with production LLM inference or serving.
Strong programming experience in Python and PyTorch.
Hands-on experience with LLM serving frameworks such as vLLM, TensorRT-LLM, SGLang, or Triton Inference Server.
Strong understanding of LLM inference concepts, including prefill, decode, continuous batching, and KV-cache management.
Experience with performance profiling, benchmarking, and accelerator workload optimization.
Knowledge of attention mechanisms, Mixture of Experts (MoE), tensor parallelism, and expert parallelism.
Strong analytical, problem-solving, and technical communication skills.

Preferred Qualifications:

Experience with AWS Trainium, Inferentia, AWS Neuron SDK, NxD Inference, or Neuron Kernel Interface (NKI).
Experience with speculative decoding, Medusa, EAGLE, or Multi-Token Prediction (MTP).
Kernel development experience using NKI, Triton, or CUDA.
Experience with Mamba, State Space Models, or large Mixture of Experts architectures.
Knowledge of FP8/INT8 quantization and model accuracy validation.
Previous experience in customer-facing engineering, consulting, or technical enablement.

Apply About employer

More about this job

Responsibilities

Optimize production LLM inference performance, latency, throughput, scalability, and cost across AWS Trainium and GPU platforms. Implement and benchmark inference techniques and architectures, support long-context and multi-chip workloads, and deliver technical documentation and measurable improvements with customer engineering teams.

Requirements

Requires 5+ years of machine learning or systems engineering experience, including 2+ years working hands-on with production LLM inference or serving. Candidates should have strong Python and PyTorch skills, experience with LLM serving frameworks and performance optimization, and knowledge of inference concepts, parallelism, attention, and MoE; Trainium, kernel development, quantization, and customer-facing experience are preferred.

Skills

Python
PyTorch
LLM Inference
vLLM
AWS Trainium
AWS Neuron SDK
Performance Profiling
Benchmarking
Continuous Batching
KV-Cache Management
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
Speculative Decoding
Multi-Token Prediction
Accelerator Optimization

Visa sponsorship

Not detected in the job text

Keywords

Python
PyTorch
Large Language Models
LLM Inference
AWS Trainium2
AWS Trainium3
AWS Neuron SDK
vLLM
TensorRT-LLM
SGLang
Triton Inference Server
NxD Inference
Neuron Kernel Interface
Speculative Decoding
Multi-Token Prediction
Medusa
EAGLE
Prefill
Decode
Continuous Batching
KV-Cache
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
State Space Models
Mamba
NKI
CUDA
FP8 Quantization
INT8 Quantization

Report this job