Find work in Canada.

620,779 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 7 days ago
TI
Product Specialist - Risk Management and Portfolio Solutions
TS Imagine
Montreal, QC
- Full-time
…solutions, as well as manage and improve our financial static data that is leveraged by leading financial institutions. You will learn topics including valuation, hedging and risk…
Added 7 days ago
L
Senior Software Engineer – AI Agents
lululemon
Vancouver, BC
- Full-time
…direction for the domain area including API design standards, data modeling approaches, and integration patterns while ensuring solutions meet scalability, reliability, and performance…
Added 7 days ago
P
Engineering Manager, Conversational AI
Pebl
Toronto, ON
- $154,000 to $195,000 CAD / year
- Full-time
We are looking for a hands-on Engineering Manager to lead our high-impact Conversational AI team. This is a critical leadership role for someone who is not only an effective manager but…
Added 7 days ago
O
Senior/Staff Software Engineer - Tech Lead
OpenMined
Remote, Canada
- $126,000 to $188,000 USD / year
- Contract
- Remote
…reproduce it. The ScreamingFace toolkit is the open-source Python library and engine, leveraging our URL4 protocol, to let any researcher (a frontier lab, a university group, an independent…
Added 7 days ago
OG
Intermediate Software Engineer - Onni Capital
Onni Group of Companies
Vancouver, BC
- Full-time
…the people whose problems you are solving, and help set the engineering standards for a team that is still being…
Added 7 days ago
S
Agentic AI Architect - Intelligence Engineering (Toronto)
Slalom
Toronto, ON · Greater Toronto Area, Canada
- Full-time
…quality, resilience, and purpose. By blending design, product engineering, analytics, and automation, we build the custom-built software and data products of…
Added 7 days ago
PC
Financial Instruments Valuation and Market Risk Manager
Pwc Canada
Toronto, ON · Montreal, QC
- Full-time
Experience with creating financial models utilizing strong programming skills in MATLAB, Python, R, FINCAD etc.
Added 7 days ago
MC
Senior QA Engineer III – Automation | Banking | API | Kafka | ETL (35729)
Myticas Consulting
Ottawa, ON
- Full-time
This is a senior, hands-on quality engineering role focused on automation framework development, API and backend testing, Kafka/event-driven testing, ETL and data pipeline validation,…
Added 7 days ago
MC
Network Engineer (35135)
Myticas Consulting
Ottawa, ON
- Full-time
The Network Service Engineer will work closely with Commercial, Product, Sales Engineering, Customers, Network Engineering, and external contractor teams to provide technical guidance on…
Added 7 days ago
MC
Coherent Optical Systems Engineer (35886)
Myticas Consulting
Ottawa, ON · Kanata, ON
- Full-time
This role requires close collaboration across optical, digital, high-speed analog, ASIC, software, and systems engineering teams. A key aspect of the position is the ability to understand…
Added 7 days ago
C
Full Stack Developer
CGI
Vancouver, BC
- Full-time
This role is well suited to a developer who has a strong technical foundation, is enthusiastic about learning new technologies, and can work effectively within an Agile multidisciplinary…
Added 7 days ago
BP
Artificial Intelligence & Model Risk Auditor
BNP Paribas
Montreal, QC
- Full-time
At least three years of professional experience in applied data science, machine learning engineering, or AI research, specifically involving LLMs and traditional machine learning models.
Added 7 days ago
A
Scientifique De Données
Actalent
Longueuil, QC
- $43 to $66 CAD / hour
- Contract
The PMO is seeking a Power BI & Data Science Analyst who can turn program data into actionable decisions. The position is approximately 50% complex dashboard and BI engineering and 50% data…
Added 7 days ago
A
Python Test Software Developer
Actalent
Sainte-Anne-de-Bellevue, QC
- $50 to $80 CAD / hour
- Contract
The Python Test Developer designs, develops, tests, integrates, and deploys software applications using general-purpose languages and technologies to support the testing of various…
Added 7 days ago
A
Data Scientist
Actalent
Longueuil, QC
- $43 to $66 CAD / hour
- Contract
The PMO is seeking a Power BI & Data Science Analyst who can turn program data into actionable decisions. The position is approximately 50% complex dashboard and BI engineering and 50% data…
Added 7 days ago
AI
Senior Machine Learning Systems Engineer
Aptino, Inc.
Canada
- Contract
The ideal candidate will have strong hands-on experience in Python, PyTorch, LLM inference frameworks, and accelerator performance optimization. This role focuses on improving inference…
Added 7 days ago
D
GenAI & Python Specialist - Operate (Future Opportunity)
Deloitte
Toronto, ON
- Full-time
Strong proficiency in Python engineering for data processing, model integration, APIs, and microservices
Added 7 days ago
RI
Senior Full Stack Java Developer - Capital Markets
Rose International
Mississauga, ON
- Full-time
…speed, and quality, and serve as the technical face of the engineering organization with customers. Java and Python should be applied according to the needs of each use case, including…
Added 7 days ago
T
Data Analytics Associate, CIB Business Management
TD
Toronto, ON
- Full-time
Hands-on experience with Databricks and related data platforms, supported by strong SQL and Python skills for data engineering, modeling, and scalable analytics.
Added 7 days ago
TS
Data Engineer
The Semios Group
Remote, Canada
- $95,000 to $115,000 CAD / year
- Full-time
- Remote
As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted, analysis-ready datasets. You will work…
Added 7 days ago
B
Consultant, Cloud Engineer - Azure
BDO
Toronto, ON
- Full-time
BDO Digital is looking for a Consultant, Cloud Engineer to join our growing Cloud and Platform Engineering team. You will work alongside experienced engineers, architects and client teams…
Added 7 days ago
PC
Specialist, BI Developer
Parkland Corporation
Calgary, AB
- Full-time
Join the Enterprise Business Intelligence team as a BI Developer focused primarily on data engineering within our Azure Databricks platform. This role designs, builds, tests, and supports…
Added 7 days ago
E
Specialist II TIS Application Observability
Enbridge
Calgary, AB · Edmonton, AB · Toronto, ON
- Full-time
Related university degree or two-year technical diploma in Computer Science, Information Technology, Engineering, or a related discipline. Without a degree, 3 additional years of related…
Added 7 days ago
LB
Senior Software Engineer, Agentic AI Products
Leo Berwick
Toronto, ON
- Full-time
We are hiring a Toronto-based Senior Software Engineer to join our founding in-house engineering team and build products from the ground up. This is a hands-on, individual contributor role…
Added 7 days ago
ZC
Senior Full Stack Developer (Angular & Java)
Ztek Consulting
Montreal, QC
- Full-time
You will be a technically proficient and enthusiastic developer, with a desire to work on back-end application development.

Aptino, Inc.

Senior Machine Learning Systems Engineer

Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type: Contract
Posting language: English
Posted: Oct 30, 2026

Original job description

We are looking for an experienced Senior Machine Learning Systems Engineer to optimize large language model (LLM) inference performance across AWS Trainium platforms, including Trainium2 and Trainium3.

The ideal candidate will have strong hands-on experience in Python, PyTorch, LLM inference frameworks, and accelerator performance optimization. This role focuses on improving inference latency, throughput, scalability, and cost efficiency for production-grade AI workloads.

Key Responsibilities:

Optimize LLM inference performance, focusing on decode latency, throughput, and serving costs.
Work with AWS Trainium2/Trainium3, AWS Neuron SDK, and vLLM on Neuron.
Implement and evaluate speculative decoding and Multi-Token Prediction (MTP) for Qwen-family models.
Profile, benchmark, and optimize production LLM workloads across GPU and Trainium platforms.
Optimize prefill/decode performance, continuous batching, KV-cache, and tensor/expert parallelism.
Support long-context inference workloads (100K+ tokens) and multi-chip scaling.
Work with advanced AI architectures, including Mixture of Experts (MoE) and State Space Models.
Develop benchmarking reports, technical documentation, implementation guides, and customer runbooks.
Collaborate with customer engineering teams to deliver measurable performance improvements.

Required Skills & Experience:

5+ years of experience in Machine Learning or Systems Engineering.
2+ years of hands-on experience with production LLM inference or serving.
Strong programming experience in Python and PyTorch.
Hands-on experience with LLM serving frameworks such as vLLM, TensorRT-LLM, SGLang, or Triton Inference Server.
Strong understanding of LLM inference concepts, including prefill, decode, continuous batching, and KV-cache management.
Experience with performance profiling, benchmarking, and accelerator workload optimization.
Knowledge of attention mechanisms, Mixture of Experts (MoE), tensor parallelism, and expert parallelism.
Strong analytical, problem-solving, and technical communication skills.

Preferred Qualifications:

Experience with AWS Trainium, Inferentia, AWS Neuron SDK, NxD Inference, or Neuron Kernel Interface (NKI).
Experience with speculative decoding, Medusa, EAGLE, or Multi-Token Prediction (MTP).
Kernel development experience using NKI, Triton, or CUDA.
Experience with Mamba, State Space Models, or large Mixture of Experts architectures.
Knowledge of FP8/INT8 quantization and model accuracy validation.
Previous experience in customer-facing engineering, consulting, or technical enablement.

Apply About employer

More about this job

Responsibilities

Optimize production LLM inference performance, latency, throughput, scalability, and cost across AWS Trainium and GPU platforms. Implement and benchmark inference techniques and architectures, support long-context and multi-chip workloads, and deliver technical documentation and measurable improvements with customer engineering teams.

Requirements

Requires 5+ years of machine learning or systems engineering experience, including 2+ years working hands-on with production LLM inference or serving. Candidates should have strong Python and PyTorch skills, experience with LLM serving frameworks and performance optimization, and knowledge of inference concepts, parallelism, attention, and MoE; Trainium, kernel development, quantization, and customer-facing experience are preferred.

Skills

Python
PyTorch
LLM Inference
vLLM
AWS Trainium
AWS Neuron SDK
Performance Profiling
Benchmarking
Continuous Batching
KV-Cache Management
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
Speculative Decoding
Multi-Token Prediction
Accelerator Optimization

Visa sponsorship

Not detected in the job text

Keywords

Python
PyTorch
Large Language Models
LLM Inference
AWS Trainium2
AWS Trainium3
AWS Neuron SDK
vLLM
TensorRT-LLM
SGLang
Triton Inference Server
NxD Inference
Neuron Kernel Interface
Speculative Decoding
Multi-Token Prediction
Medusa
EAGLE
Prefill
Decode
Continuous Batching
KV-Cache
Tensor Parallelism
Expert Parallelism
Mixture Of Experts
State Space Models
Mamba
NKI
CUDA
FP8 Quantization
INT8 Quantization

Report this job