Jobs in Canada

Email me new jobs Save this search

Added 8 days ago
AI
AI Engineer (Agentic Systems)
Ample Insight Inc.
Toronto, ON
- Contract
Strong Python skills and experience building production-grade AI/ML systems.
Added 8 days ago
LI
Senior Software Engineer - C#/.NET & Blazor
LanceSoft, Inc.
Markham, ON
- $70 to $75 CAD / hour
- Contract
Design, develop, and maintain scalable, high-quality web applications and services using Blazor, C#/.NET, and Python.
Added 8 days ago
BD
Senior DevOps Engineer - Cloud Operations
Black Duck
Calgary, AB
- Full-time
Staff. DevOps Engineer will be a key player on the Cloud Operations team responsible for all SaaS and Hosted services across the company's product portfolio. They will proactively work with…
Added 8 days ago
Sr Manager or Principal Engineer for Firmware Development - 19315
Synopsys
Markham, ON
Scripting experience with Perl, Python, Bash, or Csh is an asset.
Added 8 days ago
ST
AI Engineer
SS&C Technologies
Mississauga, ON
- Full-time
…Artificial Intelligence, and we're looking for an experienced AI Engineer to help lead that…
Added 8 days ago
L
Senior Software Engineer – AI Agents
lululemon
Vancouver, BC
- Full-time
As a Senior Software Engineer – AI Agents, you will lead the design and implementation of complex software systems and features spanning multiple services and components, establishing…
Added 8 days ago
O
Senior/Staff Software Engineer - Tech Lead
OpenMined
Remote, Canada
- $126,000 to $188,000 USD / year
- Contract
- Remote
We're looking for a Senior / Staff Software Engineer to join OpenMined, a nonprofit building open-source infrastructure for federated AI.
Added 8 days ago
OG
Intermediate Software Engineer - Onni Capital
Onni Group of Companies
Vancouver, BC
- Full-time
There is an exciting opportunity for an Intermediate Software Engineer to join Onni Capital in Vancouver.
Added 8 days ago
MC
Senior QA Engineer III – Automation | Banking | API | Kafka | ETL (35729)
Myticas Consulting
Ottawa, ON
- Full-time
Senior QA Engineer III – Automation | Banking | API | Kafka | ETL
Added 8 days ago
MC
Network Engineer (35135)
Myticas Consulting
Ottawa, ON
- Full-time
We are looking for an experienced Network Service Engineer with strong expertise in customer network service configuration to support the design, implementation, and optimization of network…
Added 8 days ago
MC
Senior ASIC Verification Engineer (35885)
Myticas Consulting
Ottawa, ON · Kanata, ON
- Full-time
Advanced proficiency in SystemVerilog and scripting languages such as Python.
Added 8 days ago
MC
Coherent Optical Systems Engineer (35886)
Myticas Consulting
Ottawa, ON · Kanata, ON
- Full-time
We are seeking a Coherent Optical Systems Engineer to contribute to the design, development, characterization, and optimization of advanced coherent optical transceivers based on…
Added 8 days ago
MC
Data Analyst – Power BI Microsoft Fabric (35903)
Myticas Consulting
Ottawa, ON
- Full-time
Use Python/Pandas for data preparation, automation and analysis.
Added 8 days ago
MC
DevOps Specialist - Kubernetes (35700)
Myticas Consulting
Ottawa, ON
- Full-time
Proficiency with scripting and automation using PowerShell, Python, or similar languages
Added 8 days ago
MC
Senior Embedded Software Firmware Engineer (35835)
Myticas Consulting
Ottawa, ON
- Contract
We are seeking a Senior Embedded Software/Firmware Engineer to develop and test next-generation firmware for advanced embedded optical systems. This is a one-year contract based in Ottawa,…
Added 8 days ago
MC
Staff Embedded Software Firmware Engineer (35836)
Myticas Consulting
Ottawa, ON
- Contract
We are seeking a Staff Embedded Software/Firmware Engineer to design, develop, and test mission-critical firmware components for advanced embedded optical systems. This is a one-year…
Added 8 days ago
AI
Adobe Site Reliability Engineer - Content Delivery Network
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Toronto, ON
- Full-time
Senior Site Reliability Engineer - AEM - Content Delivery Network
Added 8 days ago
AM
IP Silicon Validation Engineer
Advanced Micro Devices, Inc
Markham, ON
- Full-time
The AMD NBIO Team is on the lookout for a dynamic, upbeat IP Validation Design Engineer to join our growing team. As a key contributor to the success of AMD’s IP, you will be part of a…
Added 8 days ago
AI
Senior Machine Learning Systems Engineer
Aptino, Inc.
Canada
- Contract
We are looking for an experienced Senior Machine Learning Systems Engineer to optimize large language model (LLM) inference performance across AWS Trainium platforms, including Trainium2…
Added 8 days ago
RC
Senior Associate - Identity and Access Management
RSM Canada
Toronto, ON
- Full-time
Development or scripting experience with relevant technologies such as Java, BeanShell, PowerShell, Python, JavaScript, XML, JSON, or REST APIs.
Added 8 days ago
AI
Adobe Experience Manager
Aptino, Inc.
Toronto, ON
- $70 to $75 CAD / hour
- Contract
We are looking for a hands-on Adobe Experience Manager (AEM) Engineer to join an enterprise digital experience platform initiative. The ideal candidate will have strong AEM development…
Added 8 days ago
JG
AI/ML Engineer
J&M Group
Toronto, ON
- Full-time
Familiarity with Python and libraries like pandas, scikit-learn, or PyTorch.
Added 8 days ago
RI
Senior Full Stack Java Developer - Capital Markets
Rose International
Mississauga, ON
- Full-time
Seeking a Senior Forward Deployed Engineer with deep Java and Python expertise to work directly with Fintech clients in the Spread Products space. This is a hybrid engineering and…
Added 8 days ago
TS
Data Engineer
The Semios Group
Remote, Canada
- $95,000 to $115,000 CAD / year
- Full-time
- Remote
As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted, analysis-ready datasets. You will work…
Added 8 days ago
B
Consultant, Cloud Engineer - Azure
BDO
Toronto, ON
- Full-time
BDO Digital is looking for a Consultant, Cloud Engineer to join our growing Cloud and Platform Engineering team. You will work alongside experienced engineers, architects and client teams…

Aptino, Inc.

Senior Machine Learning Systems Engineer

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 30, 2026

Original job description

We are looking for an experienced Senior Machine Learning Systems Engineer to optimize large language model (LLM) inference performance across AWS Trainium platforms, including Trainium2 and Trainium3.

The ideal candidate will have strong hands-on experience in Python, PyTorch, LLM inference frameworks, and accelerator performance optimization. This role focuses on improving inference latency, throughput, scalability, and cost efficiency for production-grade AI workloads.

Key Responsibilities:

Optimize LLM inference performance, focusing on decode latency, throughput, and serving costs.
Work with AWS Trainium2/Trainium3, AWS Neuron SDK, and vLLM on Neuron.
Implement and evaluate speculative decoding and Multi-Token Prediction (MTP) for Qwen-family models.
Profile, benchmark, and optimize production LLM workloads across GPU and Trainium platforms.
Optimize prefill/decode performance, continuous batching, KV-cache, and tensor/expert parallelism.
Support long-context inference workloads (100K+ tokens) and multi-chip scaling.
Work with advanced AI architectures, including Mixture of Experts (MoE) and State Space Models.
Develop benchmarking reports, technical documentation, implementation guides, and customer runbooks.
Collaborate with customer engineering teams to deliver measurable performance improvements.

Required Skills & Experience:

5+ years of experience in Machine Learning or Systems Engineering.
2+ years of hands-on experience with production LLM inference or serving.
Strong programming experience in Python and PyTorch.
Hands-on experience with LLM serving frameworks such as vLLM, TensorRT-LLM, SGLang, or Triton Inference Server.
Strong understanding of LLM inference concepts, including prefill, decode, continuous batching, and KV-cache management.
Experience with performance profiling, benchmarking, and accelerator workload optimization.
Knowledge of attention mechanisms, Mixture of Experts (MoE), tensor parallelism, and expert parallelism.
Strong analytical, problem-solving, and technical communication skills.

Preferred Qualifications:

Experience with AWS Trainium, Inferentia, AWS Neuron SDK, NxD Inference, or Neuron Kernel Interface (NKI).
Experience with speculative decoding, Medusa, EAGLE, or Multi-Token Prediction (MTP).
Kernel development experience using NKI, Triton, or CUDA.
Experience with Mamba, State Space Models, or large Mixture of Experts architectures.
Knowledge of FP8/INT8 quantization and model accuracy validation.
Previous experience in customer-facing engineering, consulting, or technical enablement.

Apply About employer

More about this job

Responsibilities

Optimize production LLM inference performance, latency, throughput, scalability, and cost across AWS Trainium and GPU platforms. Implement and benchmark inference techniques and architectures, support long-context and multi-chip workloads, and deliver technical documentation and measurable improvements with customer engineering teams.

Requirements

Requires 5+ years of machine learning or systems engineering experience, including 2+ years working hands-on with production LLM inference or serving. Candidates should have strong Python and PyTorch skills, experience with LLM serving frameworks and performance optimization, and knowledge of inference concepts, parallelism, attention, and MoE; Trainium, kernel development, quantization, and customer-facing experience are preferred.

Skills

Python
PyTorch
LLM Inference
vLLM
AWS Trainium
AWS Neuron SDK
Performance Profiling
Benchmarking
Continuous Batching
KV-Cache Management
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
Speculative Decoding
Multi-Token Prediction
Accelerator Optimization

Visa sponsorship

Not detected in the job text

Keywords

Python
PyTorch
Large Language Models
LLM Inference
AWS Trainium2
AWS Trainium3
AWS Neuron SDK
vLLM
TensorRT-LLM
SGLang
Triton Inference Server
NxD Inference
Neuron Kernel Interface
Speculative Decoding
Multi-Token Prediction
Medusa
EAGLE
Prefill
Decode
Continuous Batching
KV-Cache
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
State Space Models
Mamba
NKI
CUDA
FP8 Quantization
INT8 Quantization

Report this job