Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 2 months ago
Q
Machine Learning Engineer, AI Processors (New Grad to Engineer Level)
Qualcomm
Markham, ON
- Full-time
We are seeking a talented Machine Learning Engineer to join the Qualcomm AI Processor Solutions team, where you will help develop next-generation AI applications for Qualcomm Snapdragon…
Added 2 months ago
IS
Senior Machine Learning / AI Engineer
INETCO Systems Ltd.
Vancouver, BC
- Full-time
We are looking for a Senior Machine Learning / AI Engineer to help design, build, test and deploy machine learning and AI-based systems for our BullzAI product line.
Added 3 months ago
C
Principal Engineer - Platform Architecture & Transformation
Conexiom
Kitchener, ON · Vancouver, BC
- Full-time
We are looking for an exceptional Principal Engineer to help lead the architectural transformation of Conexiom's platform. This is not a traditional individual contributor role. You will…
Added 2 months ago
AI Engineer
Guidepoint
Toronto, ON
…products. You will develop and scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration of responsible AI…
Added 2 months ago
W
Senior / Staff Software Engineer, AI Tech Strike Team
Waabi
Toronto, ON
- $165,000 to $265,000 USD / year
- Full-time
…agents, and workflows that accelerate how we work. As a Software Engineer on the AI Tech Strike Team, you will design, build, and ship the tools that compound the productivity of every team…
Added 5 months ago
P
Senior Software Engineer, Platform Engineering
PointClickCare
Mississauga, Ontario
- $142,700 to $158,600 CAD / year
- Full-time
…complex cross-functional problems through well-designed software systems - building APIs, services, and developer-facing applications that reduce cognitive load so development teams can…
Added 2 months ago
MC
Senior Machine Learning Engineer Specialist – AI Centre of Excellence (35668)
Myticas Consulting
Canada
- Contract
Senior Machine Learning Engineer / Specialist – AI Centre of Excellence
Added 5 months ago
E
DSP Engineer (Markham)
EvertzAV
Markham, Ontario
- Internship
Experience with real-time systems design on FPGA, CPU and GPU based platforms
Added 6 months ago
K
Senior Software Engineer, Agents
Klue
Vancouver, British Columbia
- $140,000 to $196,000 CAD / year
- Full-time
Build and ship backend systems that power agentic workflows. You design retrieval pipelines, orchestration layers, and multi-step agent architectures that turn millions of competitive data…
Added 3 months ago
Q
Machine Learning Engineer, AI Processors (Sr to Staff)
Qualcomm
Markham, Ontario
- Full-time
We are seeking a talented Machine Learning Engineer to join the Qualcomm AI Processor Solutions team, where you will help develop next-generation AI applications for Qualcomm Snapdragon…
Added 2 months ago
T
Founding AI/ML Engineer
Taskclan
Remote, Canada
- Full-time
- Remote
We are looking for a Founding AI/ML Engineer to help build the technical foundation of Taskclan Intelligence. You will work directly with the founder on model development, evaluation,…
Added 2 months ago
P
AI Engineer - Canada
Pulsora
Remote, Canada
- $60,000 to $70,000 CAD / year
- Full-time
- Remote
…developing, integrating, and optimizing complex agentic and RAG-based…
Added 2 months ago
AG
Lead AI Engineer
Altus Group
Toronto, ON
- Full-time
Reporting to the Principal Architect, we are hiring a Lead AI Engineer to help shape and build the next generation of AI capabilities across the Altus Group platform ecosystem. As our new…
Added 2 months ago
S
Forward Deployed Solution Engineer – Applied AI FDE
ServiceNow
Montreal, QC
- Full-time
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could…
Added 6 months ago
L
Senior Embedded Software Designer
Lumentum
Ottawa, Ontario
- Full-time
Powering high-speed data transmission for cloud data centers, AI/ML, enterprise systems, and communication services. Think streaming, gaming, and next-gen tech - we make it happen.
Added 6 months ago
L
Senior FPGA Design/Verification Engineer
Lumentum
Ottawa, Ontario
- Full-time
Title: Senior FPGA Design/Verification Engineer
Added 6 months ago
D
Machine Learning Engineer, Detection (TOR)
Doppel
Toronto, Ontario
- Full-time
We’re looking for a machine learning engineer to help build and scale the models and systems that power Doppel’s detection systems. Check out our blog post on how we set up our ML platform.…
Added 6 months ago
B
Machine Learning Engineer, Underwriting
Bree
Remote, Canada
- $130,000 to $230,000 CAD / year
- Full-time
- Remote
We’re looking for a Machine Learning Engineer to build and scale high-impact, world-class ML systems. You’re passionate about deploying AI solutions, optimizing performance, and driving…
Added 2 months ago
Principal AI Engineer - Tangerine
Scotiabank
Toronto, ON
Design and implement secure, resilient, and compliant AI platforms that integrate with existing enterprise systems, ensuring alignment with risk, ethics, fairness, and regulatory frameworks
Added 2 months ago
A
AI Systems Engineer – AI Model (Training & Inference)
AMD
Markham, ON
- $132,000 to $198,000 CAD / year
- Full-time
The AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and…
Added 6 months ago
H
AI Engineer - Remote
Huzzle.com
Canada
- Full-time
We are looking for a highly skilled AI Engineer to design, build, and deploy AI-driven applications and machine learning solutions. You'll work closely with product, engineering, and data…
Added 6 months ago
AI
Solution Engineer - Tooling (Vehicle Intelligence)
Applied Intuition
Owen Sound, Ontario
- Full-time
…end-to-end platform for building and validating intelligent systems at petabyte scale. As a Solution Engineer on the Tooling pillar, you will work with ADAS and AD engineering teams at OEMs…
Added 6 months ago
AI
Solution Engineer - Vehicle OS
Applied Intuition
Owen Sound, Ontario
- Full-time
We are looking for a bright engineer to help our customers solve complex technical problems across Applied Intuition’s Vehicle OS portfolio. In this role you will work closely with vehicle…
Added 6 months ago
F
Machine Learning Engineer
FactualIQ
Remote, Canada
- $160,000 to $190,000 CAD / year
- Full-time
- Remote
As a Machine Learning Engineer (Product AI), you'll build ML/AI tools that power SEAI's Decision Engine for our enterprise clients. You'll own the complete development lifecycle, from…
Added 2 months ago
Senior Data/AI Engineer
Guidepoint
Toronto, ON
…products. You will develop and scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration of responsible AI…

AMD

AI Systems Engineer – AI Model (Training & Inference)

Markham, ON, Canada

$132,000 to $198,000 CAD / year · Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Pay: $132,000 to $198,000 CAD / year
Job type: Full-time
Posting language: English
Posted: Sep 10, 2026

Original job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger - technology that moves the world forward.

The Role

The AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.

The Person

This role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.

Key Responsibilities

Training Infrastructure & Enablement

Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.

Inference Optimization & Serving

Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.

Cross-Cutting

Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience - SDKs, CI dashboards, documentation, and developer cloud enablement.

Preferred Experience

Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.

Preferred Academic Credentials

Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline

LOCATION: Markham, Canada

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Apply on LinkedIn About employer

More about this job

Responsibilities

Own the end-to-end model execution stack on AMD Instinct GPUs, focusing on large-scale training infrastructure and high-performance inference serving. Develop and optimize GPU kernels and serving frameworks to ensure AMD hardware is optimized for frontier AI models.

Requirements

Requires a strong background in shipping production AI/ML infrastructure and experience with GPU kernel optimization and distributed training. A degree in Computer Science or Engineering is preferred, along with familiarity with AMD Instinct architectures.

Skills

LLM Training
Inference Optimization
GPU Kernel Development
HIP
Triton
MLIR
Kubernetes
PyTorch
vLLM
DeepSpeed
Megatron-LM
RCCL
Quantization
Distributed Training
C++
GPU Architecture

Visa sponsorship

Not detected in the job text

Keywords

AI Systems
AMD Instinct
GPU
LLM
VLM
MoE
FSDP
DeepSpeed
Megatron-LM
RCCL
vLLM
SGLang
TorchServe
GEMM
Attention
Quantization
FP8
GPTQ
AWQ
HIP
Triton
MLIR
Kubernetes
Distributed Checkpointing
HPC
ROCm
MI300X
MI350X
MI355X
Semi-conductor

Report this job

Work requirements

Jobs in Canada