Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 4 months ago
LT
Data Scientist
Larus Technologies
Ottawa, Ontario
- Full-time
Design and implement scalable, distributed AI/ML-based systems;
Added 4 months ago
LT
Frontend/UI Developer
Larus Technologies
Ottawa, Ontario
- Full-time
We are looking for a UI/Frontend Developer to join the Larus team. You will design and build the interfaces through which military planners, analysts, and decision-makers make sense of…
Added 2 months ago
A
Intermediate Electrical Engineer
AtkinsRéalis
Winnipeg, MB
- Full-time
Must have a valid driver’s license
Added 2 months ago
A
Civil Engineer, Transportation Infrastructure
AtkinsRéalis
Vancouver, BC · Victoria, BC
- Full-time
We're AtkinsRéalis, a world-class engineering services and nuclear organization. We connect people, data and technology to transform the world's infrastructure and energy systems. Together,…
Added 4 months ago
S
Intermediate Civil Engineer- Water
Stantec
Calgary, AB
- Full-time
…include greenfield infrastructure, expansion/upgrades to existing systems, trenchless installations and rehabilitation. It is expected that the Intermediate Civil Engineer will have…
Added 4 months ago
ZI
Lead Business Solutions Engineer
Zymeworks Inc.
Vancouver, British Columbia
- $105,000 to $161,000 CAD / year
8+ years of hands-on systems engineering experience in NetSuite, middleware and systems integrations.
Added 2 months ago
S
Maintenance Millwright (443A)
Septodont
Cambridge, ON
- $40 to $44 CAD / hour
- Full-time
Night Shift - Sunday to Thursday - 10pm to 6am - Shift Premium $3/hour
Added 4 months ago
A
Senior Hydrogeologist
AtkinsRéalis
Hamilton, Ontario · Toronto, Ontario · Vaughan, Ontario
- $113,600 to $156,200 CAD / year
- Full-time
We're AtkinsRéalis, a world-class engineering services and nuclear organization. We connect people, data and technology to transform the world's infrastructure and energy systems. Together,…
Added 3 months ago
C
Senior Product Designer, Accounting
Clio
Toronto, ON · Vancouver, BC · Calgary, AB
- Full-time
Design plays a pivotal role at Clio, standing alongside Product and Engineering as one of the three pillars of our Research and Development organization. Our product designers work directly…
Added 2 months ago
P&
Senior PLM Solution Architect (3DEXPERIENCE/DELMIA)
Pratt & Whitney
Longueuil, QC
- Full-time
Added 2 months ago
Y
Storage Site Reliability Engineer
Yochana
Montreal, QC
- Contract
✅ Support Linux-based environments and distributed storage systems
Added 3 months ago
BF
Spécialiste du cycle de vie du matériel – Structures d’aéronefs (ACS) / Life Cycle Materiel Specialist – Airframe Specialty (ACS).
Bell Flight
Gatineau, QC
- Full-time
Added 2 months ago
TA
Aircraft Avionics Technician-FR
Top Aces
Cold Lake, AB
- Full-time
Develop and maintain expertise on Top Aces aircraft avionics systems, to include troubleshooting, installation and/or repair/overhaul of avionics components;
Added 2 months ago
NV
Cloud Systems Engineer (ID#5522)
New Value Solutions
Richmond, BC
- Contract
New Value Solutions, a national IT consulting company, is seeking a Cloud Systems Engineer to support the design, implementation, automation, and ongoing management of enterprise cloud…
Added 2 months ago
C
Mining Solutions Specialist
Candrone
Burnaby, BC
- Full-time
Postsecondary education in Mining Engineering, Geological Engineering, Environmental Science, Geomatics/GIS, or a related field, or an equivalent combination of education and experience
Added 3 months ago
MM
Automation & AI Developer
Martell Media
Kelowna, BC
- Full-time
Systems Thinker: You see the whole and the parts at the same time. When a Zap misfires, you trace it Stripe → Relay.app → MySQL → HubSpot → Slack and find the seam where data broke, not…
Added 2 months ago
SH
Quality Assurance Analyst
SE Health
Markham, ON
- Contract
Bachelor's degree in Computer Science, Information Systems, Software Engineering, or another technically relevant discipline, or equivalent experience.
Added 2 months ago
SH
Senior Quality Assurance Engineer
SE Health
Markham, ON
- Contract
Bachelor's degree in Computer Science, Software Engineering, Information Systems, or another technically relevant discipline, or equivalent experience.
Added 2 months ago
A
AI Systems Engineer – AI Model (Training & Inference)
AMD
Markham, ON
- $132,000 to $198,000 CAD / year
- Full-time
…written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be…
Added 2 months ago
WI
Civil Technologist - Intermediate
WSP in Canada
Kamloops, BC
- Full-time
…tomorrow’s communities. From municipal roads to stormwater systems, your work will make a tangible difference across British…
Added 2 months ago
WI
Civil Technologist - Intermediate
WSP in Canada
Kamloops, BC
- Full-time
…tomorrow’s communities. From municipal roads to stormwater systems, your work will make a tangible difference across British…
Added 2 months ago
L
Electrical Engineer
LAPORTE
Calgary, AB
- Full-time
Flexible Work Arrangements: Hybrid work mode, with a minimum of 2 days per week in the office;
Added 3 months ago
IE
HR Administrator
INVIRO Engineered Systems Ltd.
Toronto, ON · Scarborough, ON
- Full-time
…your career? As one of Canada’s leading Mechanical/Electrical engineering firms, INVIRO is looking for a dedicated team member to join our growing team. Working with us means you'll be part…
Added 2 months ago
C
Mechanical Engineer Intern (Summer 2027)
CRB
Toronto, ON
- Internship
CRB is a leading provider of sustainable engineering, architecture, construction and consulting solutions to the global life sciences and food and beverage industries. Our more than 1,600…
Added 2 months ago
SA
Quality Assurance Specialist
Source Atlantic Ltd.
Saint John, NB
- $60,000 to $80,000 CAD / year
Recommend enhancements to processes, systems, and workflows that improve quality and operational efficiency.

AMD

AI Systems Engineer – AI Model (Training & Inference)

Markham, ON, Canada

$132,000 to $198,000 CAD / year · Full-time

Apply on canadacareers-amd.icims.com About employer

Application link verified · Nov 14, 2026. Applications open in a new tab.

Job details

Pay: $132,000 to $198,000 CAD / year
Job type: Full-time
Posting language: English
Posted: Sep 10, 2026

Original job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger - technology that moves the world forward.

The Role

The AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.

The Person

This role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.

Key Responsibilities

Training Infrastructure & Enablement

Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.

Inference Optimization & Serving

Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.

Cross-Cutting

Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience - SDKs, CI dashboards, documentation, and developer cloud enablement.

Preferred Experience

Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.

Preferred Academic Credentials

Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline

LOCATION: Markham, Canada

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Apply on canadacareers-amd.icims.com About employer

More about this job

Responsibilities

Own the end-to-end model execution stack on AMD Instinct GPUs, focusing on large-scale training infrastructure and high-performance inference serving. Develop and optimize GPU kernels and serving frameworks to ensure AMD hardware is optimized for frontier AI models.

Requirements

Requires a strong background in shipping production AI/ML infrastructure and experience with GPU kernel optimization and distributed training. A degree in Computer Science or Engineering is preferred, along with familiarity with AMD Instinct architectures.

Skills

LLM Training
Inference Optimization
GPU Kernel Development
HIP
Triton
MLIR
Kubernetes
PyTorch
vLLM
DeepSpeed
Megatron-LM
RCCL
Quantization
Distributed Training
C++
GPU Architecture

Benefits

AMD benefits program

Visa sponsorship

Not detected in the job text

Keywords

AI Systems
AMD Instinct
GPU
LLM
VLM
MoE
FSDP
DeepSpeed
Megatron-LM
RCCL
vLLM
SGLang
TorchServe
GEMM
Attention
Quantization
FP8
GPTQ
AWQ
HIP
Triton
MLIR
Kubernetes
Distributed Checkpointing
HPC
ROCm
MI300X
MI350X
MI355X
Semi-conductor

Seniority

Senior

Tools

AMD Instinct MI-series GPUs
RCCL
Kubernetes
PyTorch
vLLM
SGLang
TorchServe
DeepSpeed
Megatron-LM
HIP

Languages

English

Fields of study

Computer Engineering
Software Engineering
Computer Science

Report this job

Work requirements

Jobs in Canada