Jobs in Canada

Email me new jobs Save this search

Added 3 months ago
PI
Senior Snowflake Engineer
Princeton IT Services, Inc
Toronto, ON
- Full-time
Data Engineer with strong expertise in ETL development, building Snowflake data pipelines, SQL, Python, and scalable data engineering solutions.
Added 3 months ago
PI
Java Lead Engineer / Architect - Agentic AI
Princeton IT Services, Inc
Toronto, ON
- Full-time
We are seeking a highly experienced Java Lead Engineer / Architect to design and build next-generation distributed platforms focused on edge computing, backend services, and AI/ML…
Added 2 months ago
CP
Databricks Architect | Canada
Cuesta Partners
Remote, Canada
- $180,000 to $225,000 USD / year
- Full-time
- Remote
…engineering solutions in a client-facing environment. This is a hands-on leadership role where you will work directly with clients - including C-level stakeholders - to design, build, and…
Added 2 months ago
L
Director of Engineering
Lazer
Remote, Canada
- Full-time
- Remote
Still hands-on technically: you can read an architecture, spot the flaw, and propose a better approach.
Added 2 months ago
ML Engineer
Tigera
Vancouver, BC
Hands-on experience using LLMs for applied tasks beyond chatbots - function calling, retrieval-augmented generation, prompt engineering, fine-tuning, evaluation
Added 2 months ago
F
Expert Observability Engineer
Finastra
Mississauga, ON
- Full-time
We are seeking a highly skilled and experienced Observability Engineer to lead and evolve our monitoring and observability capabilities across complex, hybrid environments. This role…
Added 1 month ago
Senior GCP Data Engineer
Capgemini
Mississauga, ON
Proficiency in SQL, Python, Java/Scala, and distributed systems (Spark, Beam). GCP Expertise: Hands-on with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow), and Terraform. DevOps:…
Added 1 month ago
GS
Senior Software Engineer
Guidewire Software
Mississauga, ON · Toronto, ON
- Full-time
Hands-on experience with JavaScript or TypeScript on the front end; experience with Python is a plus for tooling, automation, or data-related tasks.
Added 3 months ago
E
Senior Backend Engineer, Entities
EvenUp
Toronto, ON
- $184,728 to $249,926 USD / year
- Full-time
This role operates at the intersection of backend engineering, LLM integration, and hands-on experimentation. You will collaborate with a multidisciplinary team of Data Scientists,…
Added 3 months ago
P
Inference Optimization Engineer
PolarGrid
Remote, Canada
- Full-time
- Remote
PolarGrid is building the infrastructure layer for real-time AI inference. We're looking for an Inference Optimization Engineer to squeeze every bit of performance out of our stack. You'll…
Added 3 months ago
ES
Machine Learning Engineer - EA Sports FC
EA SPORTS
Vancouver, BC
- Full-time
Reporting to the Senior Data Science Manager, we are seeking a full-stack Machine Learning Engineer to operationalize, deploy, and scale high-impact machine learning solutions and…
Added 3 months ago
J
Forward Deployed Engineer, Supply Chain
Jetson
Kitchener, ON
- Full-time
A builder who ships. Strong engineering fundamentals, good judgment, and a drive to get things into people's hands. You're fluent in TypeScript, Python, or other high-level language,…
Added 3 months ago
J
Forward Deployed Engineer, Finance
Jetson
North Vancouver, BC
- Full-time
A builder who ships. Strong engineering fundamentals, good judgment, and a drive to get things into people's hands. You're fluent in TypeScript, Python, or other high-level language,…
Added 3 months ago
J
Forward Deployed Engineer, Supply Chain
Jetson
North Vancouver, BC
- Full-time
A builder who ships. Strong engineering fundamentals, good judgment, and a drive to get things into people's hands. You're fluent in TypeScript, Python, or other high-level language,…
Added 2 months ago
TT
AI/ML Engineer
TC Transcontinental
Mississauga, ON
- Full-time
We are looking for an AI/ML Engineer to work on building a multi-tenant, AI-driven promotional content platform for our customers.
Added 1 month ago
Lead Developer, Tools
2K
Montreal, QC
A Lead Developer focused on pipeline products and data systems. You are a multi-functional engineer who loves building software across all tech stacks. You might develop a data warehouse…
Added 2 months ago
R
Senior Machine Learning Engineer
Remitly
Burnaby, BC
- Full-time
As a Senior Machine Learning Engineer in Remitly's Core AI/ML team, you'll work at the heart of our AI strategy. The Core AI/ML team is responsible for building the foundational machine…
Added 2 months ago
Senior Application Security Engineer
TripleLift
Toronto, ON
The Senior Application Security Engineer plays a critical role in driving secure software development and application security maturity within TripleLift's Engineering and Security…
Added 2 months ago
Physical Design Engineer, AI Accelerator IP
Tenstorrent
Toronto, ON
A hands-on physical design engineer who owns blocks end to end, with a track record of block-level and IP tapeouts on advanced nodes.
Added 2 months ago
Backend Software Product Developer, Ops Planning
HelloFresh
Toronto, ON
We are looking for a midlevel engineer to help implement solutions & write beautiful code, working with various team members as we build out our operation planning infrastructure that…
Added 3 months ago
L
Principal AI/ML Engineer
lululemon
Vancouver, BC
- Full-time
As a Principal AI/ML Engineer, you will define and drive implementation approaches for enterprise-scale AI initiatives that transform how lululemon operates and delivers value. You will…
Added 3 months ago
D
Staff Software Engineer
Dialpad
Vancouver, BC
- Full-time
…work every day. We put powerful AI tools in every employee’s hands so they can move faster, think bigger, and achieve…
Added 4 months ago
A
Intermediate Full Stack Software Engineer
AltaML
Edmonton, AB
- $90,000 to $110,000 CAD / year
- Full-time
We are looking for a Full Stack Software Engineer who builds software in an AI-native way - someone who treats Claude and the latest agentic coding tools as a core part of their craft, not…
Added 3 months ago
A
Senior Platform Engineer
AutoTrader.ca
Toronto, ON
- Full-time
…What we care about is a faster, smoother day-to-day for every engineer, and AI is the biggest lever we…
Added 2 months ago
PA
AI Infrastructure Engineer
Palona AI
Toronto, ON
- Full-time
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona’s AI…

PolarGrid

Inference Optimization Engineer

Remote, Canada

Remote

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Remote
Posting language: English
Posted: Jul 28, 2026

Original job description

About the Role PolarGrid is building the infrastructure layer for real-time AI inference. We're looking for an Inference Optimization Engineer to squeeze every bit of performance out of our stack. You'll work directly on the systems that serve inference to our customers, making them faster, cheaper, and more efficient. This is a deep technical, systems-focused role. You'll own latency, throughput, and cost per token as real metrics you're responsible for improving. You'll build the repeatable benchmarking and optimization process that takes new models and hardware from an initial baseline to a validated production configuration. What You'll Do Profile and optimize inference pipelines end to end using representative customer workloads, from request handling and scheduling through distributed GPU execution Tune serving frameworks such as vLLM, TensorRT-LLM, and SGLang for specific latency, throughput, and cost targets Build automated benchmarking and performance regression tooling across models, frameworks, precisions, hardware, and workload profiles Characterize customer workloads and translate TTFT, ITL, concurrency, and context-length requirements into deployment configurations Implement and evaluate quantization strategies across model families, measuring both performance gains and model-quality regressions Work with hardware teams to match model configurations and parallelism strategies to GPU topology, NVLink, and interconnect bandwidth Benchmark new hardware such as RTX Pro 6000s and B300s, identifying the best engine, precision, parallelism, and deployment configuration for each workload Bring new model architectures into production, including checkpoint conversion, framework support, distributed configuration, and correctness validation Contribute to continuous batching, speculative decoding, KV-cache optimization, prefill/decode disaggregation, and request-scheduling work Read, debug, and modify inference framework internals when configuration-level tuning is not enough Work with the platform team to canary performance improvements, measure them under production traffic, and turn successful configurations into repeatable deployment recipes What We're Looking For Strong GPU systems fundamentals, with the ability to work across Python, C++, CUDA, or Triton when optimization requires going below framework configuration Hands-on experience with at least one major inference serving framework such as vLLM, TGI, TensorRT-LLM, or SGLang ⁠Deep understanding of transformer architecture and where inference bottlenecks actually live Ability to read, debug, and modify inference framework internals rather than treating them as black boxes Experience building benchmarking, load-generation, or performance-regression infrastructure Comfortable profiling with Nsight Systems, Nsight Compute, PyTorch Profiler, or similar tools Experience with quantization and precision tradeoffs in production, including validating numerical correctness and model quality Experience optimizing multi-GPU or multi-node inference across high-speed interconnects Understanding of distributed inference, NCCL, GPU topology, and communication bottlenecks ⁠You care about numbers: TTFT, ITL, P95/P99 latency, throughput, GPU utilization, and tokens/sec/dollar Bonus Points Experience writing custom CUDA or Triton kernels Familiarity with speculative decoding, MoE routing optimizations, or prefill/decode disaggregation Experience with inference request routing, scheduling, or admission control ⁠Experience upstreaming performance improvements to vLLM, SGLang, TensorRT-LLM, or related projects ⁠Open-source contributions to inference or ML systems projects Why PolarGrid You'll work on real hardware at scale, not toy benchmarks. The performance improvements you ship go directly to customers and directly affect our unit economics. Small team, real ownership.

Apply About employer

More about this job

Responsibilities

Optimize real-time AI inference pipelines to improve latency, throughput, and cost per token. Build automated benchmarking tools and implement quantization strategies to move models from baseline to production configurations.

Requirements

Requires strong GPU systems fundamentals and hands-on experience with inference serving frameworks like vLLM or TensorRT-LLM. Candidates must be proficient in profiling tools and have a deep understanding of transformer architectures and distributed inference.

Skills

GPU Optimization
vLLM
TensorRT-LLM
SGLang
CUDA
Triton
C++
Python
Quantization
Distributed Inference
PyTorch Profiler
Nsight Systems
Transformer Architecture
Benchmarking
NCCL
GPU Topology

Visa sponsorship

Not detected in the job text

Keywords

Inference Optimization
GPU
vLLM
TensorRT-LLM
SGLang
CUDA
Triton
C++
Python
Quantization
Transformer Architecture
TTFT
ITL
KV-cache
Speculative Decoding
Distributed GPU
NVLink
NCCL
Nsight Systems
Nsight Compute
PyTorch Profiler
B300
RTX Pro 6000
Multi-node Inference
Checkpoint Conversion
Load Generation
Performance Regression
MoE Routing
Prefill/Decode Disaggregation
AI Infrastructure

Report this job