Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 2 months ago
A
Senior Counsel, Nuclear
AtkinsRéalis
Mississauga, ON
- Full-time
…nuclear development, reactor refurbishment and life extension, engineering and technology programs, decommissioning, strategic partnerships and international projects. Our Nuclear Legal…
Added 2 months ago
A
Vice President Commercial
AtkinsRéalis
Mississauga, ON
- Full-time
Added 2 months ago
S
Lead Site Reliability Engineer
SimCorp
Toronto, ON
- Full-time
…into a cloud-native SaaS provider. This role blends active engineering, incident response, platform configuration, and service quality, - guided by ITIL and SRE best…
Added 2 months ago
S
Senior Site Reliability Engineer
SimCorp
Toronto, ON
- $100,000 to $140,600 CAD / year
- Full-time
Flexible working in regular & evening shift on rotational basis and provide weekend or On-Call support as needed · Must have expertise with Microsoft Azure Cloud
Added 2 months ago
UI
Electrical Estimator
Uptime Industrial Inc.
Surrey, BC
- $100,000 to $120,000 CAD / year
Our Must Haves
Added 2 months ago
Training MRI Technologist
Prenuvo
Canada
Added 2 months ago
I
Sr. Staff Developer, Architecture
iQmetrix
Winnipeg, MB
- Full-time
…happiest with their hands on the keyboard, and who thinks in systems while they…
Added 2 months ago
I
Sr. Staff Developer, Architecture
iQmetrix
Vancouver, BC
- Full-time
…happiest with their hands on the keyboard, and who thinks in systems while they…
Added 2 months ago
I
Sr. Staff Developer, Architecture
iQmetrix
Toronto, ON
- Full-time
…happiest with their hands on the keyboard, and who thinks in systems while they…
Added 2 months ago
SG
Tech Ops Engineer
Scientific Games
HR Canada
- Full-time
…choice for government lotteries. From cutting-edge backend systems to exciting entertainment experiences and trailblazing retail and digital solutions, we elevate play every day. We push…
Added 2 months ago
V
Geologist / Senior Geological Technologist, Fixed-Term
Vale
Canada
- Full-time
Bachelor of Science in Geology, Bachelor of Geological Engineering, or Geological Technology Diploma
Added 2 months ago
A
IBM Maximo (MAS) Technical Architecture Lead
Accenture
Calgary, AB · Vancouver, BC · Ottawa, ON · Toronto, ON · Montreal, QC
- Full-time
Must have the ability to manage and ensure the successful completion of multiple technical tasks in assigned program
Added 2 months ago
Operations Support Representative 3
FortisBC
Trail, BC
To provide a wide range of administrative support functions to FortisBC Operations and Engineering.
Added 2 months ago
B
Construction Project Controls Officer
BGIS
Markham, ON
- Full-time
Change order, RFI, and submittal tracking systems
Added 2 months ago
D
Sr. Account Executive, Commercial Sales (Canada)
Docusign
Toronto, ON
- Full-time
(Frequency: Minimum 2 days per week; may vary by team but will be weekly in-office expectation)
Added 2 months ago
AM
AI Systems Engineer – AI Model (Training & Inference)
Advanced Micro Devices, Inc
Markham, ON
- Full-time
…written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be…
Added 6 months ago
B
Professional, Engineering, Airworthiness
Bombardier
Dorval, Quebec
- Full-time
You have well‑developed project engineering skills and a strong understanding of aircraft systems and operations.
Added 6 months ago
QT
Senior Applied AI Engineer - Product & Revenue Systems
QEA Tech
Markham, Ontario
- Full-time
The ideal candidate is a senior hands-on builder who can work across product, engineering, sales, and business teams to identify high-impact AI opportunities, build working systems, and…
Added 6 months ago
H
Senior Software Developer
Hive
Remote, Canada
- $123,600 to $187,900 CAD / year
- Full-time
- Remote
You must be based in Canada and have legal Canadian work authorization for this role
Added 6 months ago
DM
Refrigeration Mechanic
Denison Mines Corp.
Saskatoon, Saskatchewan
- Full-time
Denison is seeking a Refrigeration Mechanic to support the operation and maintenance of the freeze plant systems at the Wheeler River Phoenix Site. This role is responsible for operating…
Added 6 months ago
RA
Staff Embedded Software Engineer, Virtualization
Rivian and Volkswagen Group Technologies
Vancouver, British Columbia
- $137,300 to $181,890 CAD / year
- Full-time
…clear vision for automotive’s next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, we’re addressing the challenges of electric vehicles through…
Added 6 months ago
RA
Senior Embedded Software Engineer, VCS
Rivian and Volkswagen Group Technologies
Vancouver, British Columbia
- $108,200 to $143,430 CAD / year
- Full-time
…clear vision for automotive’s next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, we’re addressing the challenges of electric vehicles through…
Added 6 months ago
U
iOS Developer
UST
Ontario · Ontario, Canada
- Full-time
Experience developing applications and systems with complex networking requirements
Added 6 months ago
U
iOS Developer
UST
Ontario · Ontario, Canada
- Full-time
Experience developing applications and systems with complex networking requirements
Added 6 months ago
U
iOS Developer
UST
Ontario · Ontario, Canada
- Full-time
Experience developing applications and systems with complex networking requirements

Advanced Micro Devices, Inc

AI Systems Engineer – AI Model (Training & Inference)

1 Commerce Valley Drive, Markham, ON, L3T 7X6, Canada

Full-time

Apply on careers.amd.com About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Sep 10, 2027
Posting language: English
Posted: Sep 10, 2026

Original job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger - technology that moves the world forward.

THE ROLE:

The AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.

THE PERSON:

This role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.

KEY RESPONSIBILITIES:

Training Infrastructure & Enablement

Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.

Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.

Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).

Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.

Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.

Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.

Inference Optimization & Serving

Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.

Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.

Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.

Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.

Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.

Cross-Cutting

Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.

Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience - SDKs, CI dashboards, documentation, and developer cloud enablement.

PREFERRED EXPERIENCE:

Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.

PREFERRED ACADEMIC CREDENTIALS:

Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline

LOCATION: Markham, Canada

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Apply on careers.amd.com About employer

More about this job

Responsibilities

The role involves owning the end-to-end model execution stack on AMD Instinct GPUs, including large-scale training infrastructure and high-performance inference serving. You will optimize GPU kernels, manage distributed training clusters, and collaborate with architecture teams to validate software stacks on next-generation hardware.

Requirements

Candidates should have industry experience shipping production AI/ML infrastructure and hands-on expertise with frontier models on GPU hardware. A degree in Computer Science or a related technical field is required, along with proficiency in GPU programming and distributed systems.

Skills

GPU Kernel Optimization
LLM Training
Inference Serving
Distributed Systems
Kubernetes
RCCL
PyTorch
HIP
Triton
MLIR
vLLM
DeepSpeed
Megatron-LM
Performance Benchmarking
Observability
Anomaly Detection

Visa sponsorship

Not detected in the job text

Keywords

AI Systems Engineer
AMD Instinct
GPU
LLM
Training Infrastructure
Inference
Kubernetes
RCCL
HIP
Triton
MLIR
vLLM
DeepSpeed
Megatron-LM
Distributed Training
Quantization
FP8
Observability
Performance Engineering
HPC
Software Development
Silicon Architecture
CI/CD
Data Pipelines
Anomaly Detection
Benchmarking
SLA
ROCm
Machine Learning
Artificial Intelligence

Report this job

Work requirements

Jobs in Canada