Software development jobs in Toronto, ON and nearby

Software development jobs within 25 km of Toronto, ON, Canada. Nearby towns and cities are included. Distances are straight-line, not driving distances.

Counted Sep 22, 2026

Hiring at a glance

View jobs

Open jobs: 1,632
Employers: 574

Advertised starting pay

Average starting payCAD / year: $118,516Across 153 listings
Average starting payUSD / year: $147,732Across 50 listings
Average starting payCAD / hour: $63.30Across 40 listings

Employer-advertised starting pay, not employee salaries. Currencies and pay periods stay separate.

Where work happens

Remote: 0%0 listings
Hybrid: 49%806 listings
On-site: 49%804 listings

Not specified: 1% (22 listings)

Employers hiring include RBC (51), Amazon (50), Royal Bank of Canada (43).

Sources & calculation notes

These figures describe the listings on this role page at the date shown, not the whole job market. Listings can change.

Employer-listed minimums from at least 10 listings per currency and pay period. These are advertised starting amounts, not employee salaries. Jobs without a minimum and unusual amounts are excluded.

Hybrid and on-site classifications may be inferred from descriptions. Check the original ad. How we count

Software development jobs in Toronto, ON and nearby

Within 25 km

Save this search

Added 1 month ago
Software Developer - Internal Automation
YuJa Inc.
Toronto, ON
$80,000 to $90,000 CAD / year
Full-time
Added 14 days ago
Principal Software Engineer
Morningstar
Toronto, ON
Full-time
As a Principal Software Engineer on our Data Feed Platform team (Direct – Data & Research), you will partner with product owners and engineering teams to shape the technical direction of…
Added 1 month ago
Java Full Stack Developer
J&M Group
Toronto, ON
Full-time
8+ years of full-stack software development experience.
Added 1 month ago
Java Full Stack Developer - Assistant Vice President
Citi
Mississauga, ON
Full-time
The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application…
Added 1 month ago
Senior Frontend developer
Royal Bank of Canada
Toronto, ON
Full-time
RBC's Investment Mega Journey (IMJ) application development team is responsible for developing, enhancing, and maintaining web applications & microservices to enable and empower RBC online…
Added 1 month ago
Senior Frontend developer
RBC
Toronto, ON
Full-time
RBC's Investment Mega Journey (IMJ) application development team is responsible for developing, enhancing, and maintaining web applications & microservices to enable and empower RBC online…
Added 18 days ago
Software Engineer, Observability
Lyft
Toronto, ON
…thrive. Our Infrastructure team is passionate about building software to solve problems at massive scale. We do this often, and when we believe our solution is worth sharing with the…
Added 1 month ago
Software Engineer (Python) - PricingCenter
Guidewire Software
Mississauga, ON
Full-time
As part of Guidewire’s Product Development & Operations (PDO) organization, you’ll join the PricingCenter team that designs and builds the pricing engine at the heart of how P&C insurers…
Added 2 months ago
Principal Software Engineer, Productivity (Golang)
Okta
Toronto, ON
$177,000 to $265,000 CAD / year
Full-time
Added 1 month ago
Senior Software Engineer, AI Inference Systems
NVIDIA
Toronto, ON
Full-time
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and…
Added 28 days ago
Software Engineer II - Agentic AI Foundations
Socure
Toronto, ON
$135,000 to $175,000 CAD / year
Full-time
Added 1 month ago
Senior Full Stack Developer
LifeWorks
Toronto, ON
Full-time
Added 1 month ago
Senior/Staff Software Engineer
Senpilot
Toronto, ON
Full-time
Added 2 months ago
Embedded Systems Software Engineer
indie.inc
Toronto, ON
Full-time
Added 1 month ago
Software Developer
Turner Fleischer
Toronto, ON
Full-time
Added 12 days ago
Lead Software Engineer - Enterprise Applications
Citi
Mississauga, ON
Full-time
Citi’s Banking Technology organization is seeking a highly hands-on Lead Software Engineer to design, build, and deploy cutting‑edge AI solutions for Investment, Corporate, and Commercial…
Added 1 month ago
Sr. Software Engineer II, Linux Sensor - CTIO (Hybrid)
CrowdStrike
Toronto, ON
Full-time
Added 1 month ago
Sr. Software Engineer II, MacOS Sensor - CTIO (Hybrid)
CrowdStrike
Toronto, ON
Full-time
Added 1 month ago
Senior Software Engineer
Broadridge
Toronto, ON
Full-time
We’re looking for an experienced and adaptable Software Engineer to join our Securities Finance and Collateral Management (SFCM) engineering team at Broadridge. You’ll contribute to…
Added 1 month ago
Sr. Full-Stack Developer, AI Design-to-Dev
Appnovation Technologies
Toronto, ON
Added 1 month ago
Software Development Engineer, Personnel Resource Manager
Amazon
Toronto, ON
The Worblehat team is looking for a Software Development Engineer to join our mission-critical platform that automates operational compliance across Amazon's global fulfillment network.…
Added 1 month ago
Senior Software Engineer, Data Engineering
NationGraph
Toronto, ON
$150,000 to $200,000 CAD / year
Full-time
Added 1 month ago
Staff Software Developer, Front End
Intuit
Toronto, ON
Full-time
Added 1 month ago
Staff Software Engineer, Financial Platform
Credit Genie
Toronto, ON
Full-time
Added 1 month ago
Senior Software Engineer, Trust Platform
Credit Genie
Toronto, ON
Full-time

NVIDIA

Senior Software Engineer, AI Inference Systems

Toronto, ON, Canada
Canada, Toronto, Canada

Pay: The base salary range is 170,000 CAD - 220,000 CAD for Level 4, and 225,000 CAD - 275,000 CAD for Level 5.
Job type: Full-time
Posting language: English
Posted: Aug 14, 2026

Apply About employer

Applications open in a new tab.

Original job description

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across multi-GPU, multi-node, and multi-cloud environments. You’ll collaborate across inference, compiler, scheduling, and performance teams to push the frontier of accelerated computing for AI.

What you’ll be doing:

Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework (vLLM) with methods like speculative decoding, data/tensor/expert/pipeline-parallelism, prefill-decode disaggregation.
Develop, optimize, and benchmark GPU kernels (hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization; build and extend high-level DSLs and compiler infrastructure to boost kernel developer productivity while approaching peak hardware utilization.
Define and build inference benchmarking methodologies and tools; contribute both new benchmark and NVIDIA’s submissions to the industry-leading MLPerf Inference benchmarking suite.
Architect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds.
Conduct and publish original research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into NVIDIA’s software products.

What we need to see:

Bachelor’s degree (or equivalent experience) in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE) with 7+ years of experience; alternatively, Master’s degree in CS/CE/SE with 5+ years of experience; or PhD degree with the thesis and top-tier publications in ML Systems, GPU architecture, or high-performance computing.
Strong programming skills in Python and C/C++; experience with Go or Rust is a plus; solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, distributed systems, deep learning theories.
Knowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and model serving systems (e.g., vLLM and SGLang).
Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute).
Experience with containers and orchestration (Docker, Kubernetes, Slurm); familiarity with Linux namespaces and cgroups.
Excellent debugging, problem-solving, and communication skills; ability to excel in a fast-paced, multi-functional setting.

Ways to stand out from the crowd

Experience building and optimizing LLM inference engines (e.g., vLLM, SGLang).
Hands-on work with ML compilers and DSLs (e.g., Triton, TorchDynamo/Inductor, MLIR/LLVM, XLA), GPU libraries (e.g., CUTLASS) and features (e.g., CUDA Graph, Tensor Cores).
Experience contributing to containerization/virtualization technologies such as containerd/CRI-O/CRIU.
Experience with cloud platforms (AWS/GCP/Azure), infrastructure as code, CI/CD, and production observability.
Contributions to open-source projects and/or publications; please include links to GitHub pull requests, published papers and artifacts.

At NVIDIA, we believe artificial intelligence (AI) will fundamentally transform how people live and work. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential. Our team consists of experts in AI, systems and performance optimization. Our leadership includes world-renowned experts in AI systems who have received multiple academic and industry research awards. If you’re excited to build systems, kernels, and tools that make large-scale AI faster, more efficient, and easier to deploy, we’d love to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 170,000 CAD - 220,000 CAD for Level 4, and 225,000 CAD - 275,000 CAD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 18, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Apply About employer

More about this job

Responsibilities

You will architect and implement high-performance AI inference stacks and optimize GPU kernels to serve large-scale models efficiently. Additionally, you will contribute to benchmarking methodologies and orchestrate containerized inference deployments across multi-cloud environments.

Requirements

Candidates must possess a degree in Computer Science, Computer Engineering, or Software Engineering with at least 5 to 7 years of relevant experience. Strong proficiency in C++, Python, and GPU programming, along with deep knowledge of ML systems and performance optimization, is required.

Skills

Python
C++
CUDA
GPU Programming
Machine Learning Systems
Performance Engineering
PyTorch
vLLM
Distributed Systems
Containerization
Kubernetes
Compiler Design
Algorithms
Data Structures
Parallel Programming
Benchmarking

Benefits

Equity
Health benefits

Visa sponsorship

Not detected in the job text

Keywords

AI Inference
Large-scale Models
GPU Kernels
Compilers
vLLM
Speculative Decoding
Tensor Parallelism
Pipeline Parallelism
DSL
MLPerf
Orchestration
Docker
Kubernetes
Slurm
Linux
Nsight
Triton
LLVM
XLA
CUTLASS
CUDA Graph
Tensor Cores
Cloud Platforms
CI/CD
Performance Engineering

Report this job