Jobs in Canada

Email me new jobs Save this search

Added 3 months ago
MF
Practice Manager, Forward Deployment Engineer
McCain Foods
Toronto, ON
- Full-time
Position Title: Practice Manager, Forward Deployment Engineer
Added 3 months ago
T
Founding Technical Recruiter
Terminal
Toronto, ON
- $115,000 to $152,000 CAD / year
- Full-time
Terminal builds telematics data infrastructure for the commercial fleet industry. Commercial auto insurers and fleet software companies, including industry leaders like Intact Insurance,…
Added 3 months ago
P
Inference Optimization Engineer
PolarGrid
Remote, Canada
- Full-time
- Remote
PolarGrid is building the infrastructure layer for real-time AI inference. We're looking for an Inference Optimization Engineer to squeeze every bit of performance out of our stack. You'll…
Added 3 months ago
H
Senior Frontend Engineer
Hiive
Vancouver, BC
- $150,000 to $200,000 CAD / year
- Full-time
As a Senior Frontend Engineer, you will be a hands-on contributor within a product pod, building client-facing product experiences on our main platform. You will collaborate with technical…
Added 3 months ago
Q-
DevOps - MLOps engineer
QUANTEAM - North America (RAINBOW PARTNERS Group)
Montreal, QC · Greater Montreal Metropolitan Area
- Full-time
We are looking for a DevOps - MLOps engineer for one of our clients.
Added 3 months ago
ES
Machine Learning Engineer - EA Sports FC
EA SPORTS
Vancouver, BC
- Full-time
Reporting to the Senior Data Science Manager, we are seeking a full-stack Machine Learning Engineer to operationalize, deploy, and scale high-impact machine learning solutions and…
Added 3 months ago
J
Forward Deployed Engineer, Supply Chain
Jetson
Kitchener, ON
- Full-time
Become a rare kind of engineer. Few people can connect a messy real-world domain, the data under it, and software people actually adopt. You'll build exactly that profile, which is one of…
Added 3 months ago
J
Forward Deployed Engineer, Finance
Jetson
North Vancouver, BC
- Full-time
Become a rare kind of engineer. Few people can connect a messy real-world domain, the data under it, and software people actually adopt. You'll build exactly that profile, which is one of…
Added 3 months ago
J
Forward Deployed Engineer, Supply Chain
Jetson
North Vancouver, BC
- Full-time
Become a rare kind of engineer. Few people can connect a messy real-world domain, the data under it, and software people actually adopt. You'll build exactly that profile, which is one of…
Added 3 months ago
T(
Principal Data Engineer
Tilt (f.k.a. Delphia)
Remote, Canada
- $210,000 to $270,000 CAD / year
- Full-time
- Remote
We're looking for a Principal Data Engineer who thrives in ambiguity, enjoys building large-scale data platforms, and wants to define how AI-native investing is powered behind the scenes.
Added 3 months ago
AI
Senior Full Stack Developer
Aversan Inc.
Mississauga, ON
- Full-time
We are seeking a qualified Senior Full Stack Software Engineer to join our team. In this role, you will lead the design, development, and validation of ground control software, simulators,…
Added 2 months ago
TT
AI/ML Engineer
TC Transcontinental
Mississauga, ON
- Full-time
We are looking for an AI/ML Engineer to work on building a multi-tenant, AI-driven promotional content platform for our customers.
Added 2 months ago
Lead Developer, Tools
2K
Montreal, QC
A Lead Developer focused on pipeline products and data systems. You are a multi-functional engineer who loves building software across all tech stacks. You might develop a data warehouse…
Added 2 months ago
SS
Full Stack Software Engineer, Officer
State Street
Toronto, ON
- Full-time
Proficiency in Java and/or JavaScript, with strong fundamentals in data structures, algorithms, and relational databases (SQL)
Added 2 months ago
R
Staff Engineer – Software Development, Architecture, Security & Governance
RBC
Toronto, ON
- Full-time
We are seeking a highly skilled and experienced Staff Engineer to join our Enterprise Architecture team, leveraging their expertise in full-stack development, backend engineering, API…
Added 2 months ago
R
Senior Machine Learning Engineer
Remitly
Burnaby, BC
- Full-time
As a Senior Machine Learning Engineer in Remitly's Core AI/ML team, you'll work at the heart of our AI strategy. The Core AI/ML team is responsible for building the foundational machine…
Added 2 months ago
IE
Senior Manufacturing Engineer
Industrial Electric Manufacturing
Surrey, BC
- $45.67 to $56.25 CAD / hour
IEM is currently seeking a Senior Manufacturing Engineer (Manufacturing Engineer, E3) for our Surrey, B.C. locations and will report into the Senior Manager of Manufacturing Engineering.…
Added 2 months ago
IE
Manufacturing Engineer
Industrial Electric Manufacturing
Surrey, BC
- $38.94 to $46.63 CAD / hour
IEM is currently seeking a Manufacturing Engineer (Manufacturing Engineer, E2) for our Surrey, B.C. locations and will report into the Senior Manager of Manufacturing Engineering. We are…
Added 2 months ago
J
Sales Engineer
Saskatoon, SK
- Full-time
The mission of the Sales Engineer is to bridge the gap between technical expertise and revenue generation - accelerating sales through tailored solution design, strategic product…
Added 2 months ago
Senior Application Security Engineer
TripleLift
Toronto, ON
…through beautiful creative, quality publishers, actionable data and smart targeting. Through over 1 trillion monthly ad transactions, we help publishers and platforms monetize their…
Added 2 months ago
NP
Enterprise AI Engineer
Northland Power Inc.
Toronto, ON
- Full-time
The Enterprise AI Engineer is responsible for driving the adoption, governance, development, and operationalization of Artificial Intelligence across Northland Power. This role serves as…
Added 2 months ago
Physical Design Engineer, AI Accelerator IP
Tenstorrent
Toronto, ON
A hands-on physical design engineer who owns blocks end to end, with a track record of block-level and IP tapeouts on advanced nodes.
Added 2 months ago
Backend Software Product Developer, Ops Planning
HelloFresh
Toronto, ON
We are looking for a midlevel engineer to help implement solutions & write beautiful code, working with various team members as we build out our operation planning infrastructure that…
Added 2 months ago
NP
Data Engineer/Architect
Northland Power Inc.
Toronto, ON
- Full-time
The Data Architect / Data Engineer is responsible for designing, developing, and managing Northland Power’s enterprise data platform. This role will own the organization’s Azure-based data…
Added 2 months ago
C
Senior Data Engineer
CarePartners
London, ON · Waterloo, ON
- Full-time
The Senior Data Engineer is responsible for the design, governance, and ongoing evolution of the organization's enterprise data environment. This role provides leadership in data…

PolarGrid

Inference Optimization Engineer

Remote, Canada

Remote

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Remote
Posting language: English
Posted: Jul 28, 2026

Original job description

About the Role PolarGrid is building the infrastructure layer for real-time AI inference. We're looking for an Inference Optimization Engineer to squeeze every bit of performance out of our stack. You'll work directly on the systems that serve inference to our customers, making them faster, cheaper, and more efficient. This is a deep technical, systems-focused role. You'll own latency, throughput, and cost per token as real metrics you're responsible for improving. You'll build the repeatable benchmarking and optimization process that takes new models and hardware from an initial baseline to a validated production configuration. What You'll Do Profile and optimize inference pipelines end to end using representative customer workloads, from request handling and scheduling through distributed GPU execution Tune serving frameworks such as vLLM, TensorRT-LLM, and SGLang for specific latency, throughput, and cost targets Build automated benchmarking and performance regression tooling across models, frameworks, precisions, hardware, and workload profiles Characterize customer workloads and translate TTFT, ITL, concurrency, and context-length requirements into deployment configurations Implement and evaluate quantization strategies across model families, measuring both performance gains and model-quality regressions Work with hardware teams to match model configurations and parallelism strategies to GPU topology, NVLink, and interconnect bandwidth Benchmark new hardware such as RTX Pro 6000s and B300s, identifying the best engine, precision, parallelism, and deployment configuration for each workload Bring new model architectures into production, including checkpoint conversion, framework support, distributed configuration, and correctness validation Contribute to continuous batching, speculative decoding, KV-cache optimization, prefill/decode disaggregation, and request-scheduling work Read, debug, and modify inference framework internals when configuration-level tuning is not enough Work with the platform team to canary performance improvements, measure them under production traffic, and turn successful configurations into repeatable deployment recipes What We're Looking For Strong GPU systems fundamentals, with the ability to work across Python, C++, CUDA, or Triton when optimization requires going below framework configuration Hands-on experience with at least one major inference serving framework such as vLLM, TGI, TensorRT-LLM, or SGLang ⁠Deep understanding of transformer architecture and where inference bottlenecks actually live Ability to read, debug, and modify inference framework internals rather than treating them as black boxes Experience building benchmarking, load-generation, or performance-regression infrastructure Comfortable profiling with Nsight Systems, Nsight Compute, PyTorch Profiler, or similar tools Experience with quantization and precision tradeoffs in production, including validating numerical correctness and model quality Experience optimizing multi-GPU or multi-node inference across high-speed interconnects Understanding of distributed inference, NCCL, GPU topology, and communication bottlenecks ⁠You care about numbers: TTFT, ITL, P95/P99 latency, throughput, GPU utilization, and tokens/sec/dollar Bonus Points Experience writing custom CUDA or Triton kernels Familiarity with speculative decoding, MoE routing optimizations, or prefill/decode disaggregation Experience with inference request routing, scheduling, or admission control ⁠Experience upstreaming performance improvements to vLLM, SGLang, TensorRT-LLM, or related projects ⁠Open-source contributions to inference or ML systems projects Why PolarGrid You'll work on real hardware at scale, not toy benchmarks. The performance improvements you ship go directly to customers and directly affect our unit economics. Small team, real ownership.

Apply About employer

More about this job

Responsibilities

Optimize real-time AI inference pipelines to improve latency, throughput, and cost per token. Build automated benchmarking tools and implement quantization strategies to move models from baseline to production configurations.

Requirements

Requires strong GPU systems fundamentals and hands-on experience with inference serving frameworks like vLLM or TensorRT-LLM. Candidates must be proficient in profiling tools and have a deep understanding of transformer architectures and distributed inference.

Skills

GPU Optimization
vLLM
TensorRT-LLM
SGLang
CUDA
Triton
C++
Python
Quantization
Distributed Inference
PyTorch Profiler
Nsight Systems
Transformer Architecture
Benchmarking
NCCL
GPU Topology

Visa sponsorship

Not detected in the job text

Keywords

Inference Optimization
GPU
vLLM
TensorRT-LLM
SGLang
CUDA
Triton
C++
Python
Quantization
Transformer Architecture
TTFT
ITL
KV-cache
Speculative Decoding
Distributed GPU
NVLink
NCCL
Nsight Systems
Nsight Compute
PyTorch Profiler
B300
RTX Pro 6000
Multi-node Inference
Checkpoint Conversion
Load Generation
Performance Regression
MoE Routing
Prefill/Decode Disaggregation
AI Infrastructure

Report this job