Find work in Canada.

328,209 jobs across our Canadian network. How we count

Jobs in Canada

Save this search

Added 11 days ago
Lead Software Engineer - Enterprise Applications
Citi
Mississauga, ON
Full-time
2+ years focused on AI software development, LLM‑based solutions, agentic systems, and/or machine learning.
Added 1 month ago
Analyste de données / Data Scientist
Genetec
Montreal, QC
Full-time
Expérience avec les services Azure tels que : Azure Synapse Analytics, Azure Data Factory, Azure Machine Learning, Azure Data Lake Storage
Added 1 month ago
Senior AI Engineer
Workday
Vancouver, BC · Canada, BC, Vancouver
Full-time
7+ years experience as a member of an AI engineer, data science, machine learning engineering, or other relevant software development team building applied machine learning products at…
Added 1 month ago
AI Engineer
Workday
Vancouver, BC · Canada, BC, Vancouver
Full-time
As a Machine Learning Engineer in Agent Factory, you’ll design and build the core ML systems behind Workday’s next generation of AI agents. Working within a small, senior, cross-functional…
Added 1 month ago
Senior AI/ML Engineer (AutoCAD & Civil 3D)
Autodesk
Toronto, ON
Full-time
3+ years of experience in Applied AI, Machine Learning, AI Product Engineering, ML Engineering, or Software Engineering with significant AI/ML responsibilities
Added 1 month ago
ML Engineer
Tigera
Vancouver, BC
…make decisions, call tools, hold credentials, and reach across systems in ways traditional models weren't designed for. The companies running thousands of these agents in production have…
Added 1 month ago
AI/ML Engineer
TC Transcontinental
Mississauga, ON
Full-time
Design and build machine learning and generative AI components that integrate with our data platforms and infrastructure, built for automation, reliability, and operational efficiency.
Added 1 month ago
AI Modeling Engineer
Palona AI
Toronto, ON
Full-time
Strong machine learning foundations and hands-on experience developing or evaluating production AI systems.
Added 1 month ago
Machine Learning Engineer
exacare ai
Canada
Full-time
We are seeking a highly adaptable, creative, and well-rounded Machine Learning Engineer to join our team. You will own the end-to-end ML lifecycle, from dataset creation and foundational…
Added 1 month ago
Senior AI Engineer, Full-Stack - Agent Factory
Workday
Vancouver, BC · Canada, BC, Vancouver
Full-time
…senior, cross-functional pods bring together product leaders, machine learning engineers, UX designers, and full-stack builders to create intelligent agents used by millions of people every…
Added 1 month ago
Forward Deployed Engineer (Generative AI)
Tiger Analytics
Canada
Full-time
Tiger Analytics is looking for experienced Forward Deployment Engineer (Generative AI) with Gen AI experience to join our fast-growing advanced analytics consulting firm. Our employees…
Added 1 month ago
AI/ML Research Engineer, LLM Post-Training & Evaluation
Innodata Inc.
Canada
$110,000 to $240,000 CAD / year
Full-time
Innodata is expanding its team of technical experts in LLM training, post-training, and evaluation systems. As an AI/ML Research Engineer, LLM Training & Evaluation, you will build and…
Added 1 month ago
Principal Cloud Security Engineer
BMO
Toronto, ON · BMOPLACE
Full-time
We are seeking an enthusiastic and passionate professional for a Senior Cloud, AI & Data Security Engineer role who wants to design and implement security solutions for systems and services…
Added 1 month ago
Researcher - Speech & Acoustic AI
Huawei Technologies Canada Co., Ltd.
Markham, ON
Full-time
Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial…
Added 2 months ago
AI / Machine Learning Engineer
Infoya Career Connect
Toronto, ON · Waterloo, ON
$85,000 to $105,000 CAD / year
Full-time
We are seeking a motivated and innovative AI / Machine Learning Engineer to join our growing engineering team. This role is ideal for recent graduates and early-career professionals who are…
Added 1 month ago
Investigations Engineer - Toronto
GPTZero
Remote, Canada
$140,000 to $230,000 CAD / year
Full-time · Remote
Craft machine learning ranking and classification systems to detect documents that have fabrications using LLMs.
Added 16 days ago
Senior Software Engineer, Full-Stack Applications - Ratings Technology
Fitch Group
Toronto, ON
…global capital markets by providing credit analysis, ratings, research, and commentary to financial market participants. For over 100 years, Fitch Ratings has been creating value for global…
Added 1 month ago
DL Performance Software Engineer - LLM Inference
NVIDIA
Toronto, ON · Canada, Toronto
Full-time
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and…
Added 16 days ago
Machine Learning Engineer, Safety and Customer Care AI
Lyft
Toronto, ON
As a Machine Learning Engineer on the SCC team, you will fine-tune and align models and build AI Agents that power how riders and drivers get help. Your work spans the full loop:…
Added 1 month ago
Senior AI Developer
Hinge Health
Remote, Canada
$136,800 to $205,200 CAD / year
Full-time · Remote
This role is focused on productionizing LLMs, VLMs, and multi-modal reasoning systems for millions of active users. You will own the infrastructure and operational foundations for…
Added 18 days ago
Senior Software Engineer, Full-Stack Applications - AI Innovation Teams
Fitch Group
Toronto, ON
Fitch Ratings is seeking a Senior Software Engineer to join our new AI Innovation teams in Toronto - where we're building the AI-powered platforms and applications that will transform…
Added 2 months ago
Applied AI, Forward Deployed Machine Learning Engineer
Mistral
Montreal, Quebec
Full-time
You have deep understanding of concepts and algorithms underlying machine learning and LLMs
Added 2 months ago
Engineering Manager - Forward Deployed Engineering (LLM)
Baseten
Montreal, Quebec
$260,000 to $380,000 USD / year
Full-time
…customer engineering teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production…
Added 2 months ago
Software Engineer - Model Performance
Baseten
Montreal, Quebec
$180,000 to $360,000 USD / year
Full-time
Proficiency in enhancing the performance of software systems, particularly in the context of large language models (LLMs).
Added 2 months ago
Software Engineer - GPU Networking & Distributed Systems
Baseten
Montreal, Quebec
$165,000 to $330,000 USD / year
Full-time
…of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from…

NVIDIA

DL Performance Software Engineer - LLM Inference

Toronto, ON, Canada
Canada, Toronto, Canada

Pay: The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.
Job type: Full-time
Experience: 5+ years of industry experience in software engineering or equivalent research experience.
Posting language: English
Posted: Aug 6, 2026

Apply About employer

Applications open in a new tab.

Original job description

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference software, optimize GPU kernels, drive industry benchmarks, and work with state-of-the-art research techniques to improve serving efficiency. You’ll collaborate across inference performance, kernels, training, large-scale serving, and research teams to push the frontier of accelerated computing for AI.

What you’ll be doing:

Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features and serving runtime algorithms.
Profile and optimize the inference framework (vLLM) with methods like speculative decoding, 5D Parallelism, and prefill-decode disaggregation.
Architect novel frameworks and runtime optimizations for inference infrastructure, benchmarking, and kernels.
Conduct and publish original research that advances the Pareto frontier in ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into production-grade, open-source software.
Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization.

What we need to see:

Bachelor’s, Master’s, or PhD degree in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE).
5+ years of industry experience in software engineering or equivalent research experience.
Strong programming skills in Python and one of C/C++, Go, or Rust. Solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, software engineering, distributed systems, deep learning theories.
Knowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and inference engines (e.g., vLLM and SGLang).
Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute).
Excellent debugging, problem-solving, and communication skills; ability to excel in a fast-paced, multi-functional setting.

Ways to Stand out from the Crowd

Experience developing major features and optimizations for LLM inference engines (e.g., vLLM, SGLang).
Hands-on work with LLM inference and training runtimes (deploying LLMs to production, large-scale LLM pre-training and RL), ML compilers and DSLs (e.g., Triton, CuTe, MLIR/LLVM, XLA), GPU libraries (e.g., CUTLASS) and features (e.g., CUDA Graph, Tensor Cores).
Experience with speculative decoding training and runtime features: tree-structured drafting, parallel drafting, diffusion LLMs, DFlash, EAGLE.
Contributions to open-source projects and/or publications; please include links to GitHub pull requests, published papers and artifacts.
At NVIDIA, we believe artificial intelligence (AI) will fundamentally transform how people live and work. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential.

Our team consists of experts in AI, systems and performance optimization. Our leadership includes world-renowned experts in AI systems who have received multiple academic and industry research awards. If you’re excited to build systems, kernels, and tools that make large-scale AI faster, more efficient, and easier to deploy, we’d love to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 10, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Apply About employer

More about this job

Responsibilities

Architect and implement high-performance inference software and optimize GPU kernels to serve large-scale models efficiently. Collaborate with cross-functional teams to integrate research techniques into production-grade, open-source inference frameworks like vLLM.

Requirements

Requires a degree in Computer Science, Computer Engineering, or Software Engineering with at least 5 years of industry experience. Candidates must possess strong programming skills in Python and C/C++, Go, or Rust, along with deep knowledge of GPU programming and ML inference engines.

Skills

Python
C++
Rust
Go
CUDA
GPU Programming
LLM Inference
vLLM
PyTorch
Performance Engineering
Distributed Systems
Computer Architecture
Algorithms
Data Structures
Machine Learning Systems
Kernel Optimization

Benefits

Equity
Health benefits

Visa sponsorship

Not detected in the job text

Keywords

LLM
Inference
GPU
CUDA
vLLM
SGLang
PyTorch
Performance Engineering
Kernel Optimization
Distributed Systems
Speculative Decoding
Triton
MLIR
LLVM
XLA
CUTLASS
CUDA Graph
Tensor Cores
Parallel Programming
Software Engineering
Machine Learning
Artificial Intelligence
Algorithms
Data Structures
Operating Systems
Computer Architecture
Profiling
Debugging
Open Source
Research

Report this job