Find work in Canada.

484,786 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 15 days ago
Senior Data Engineer
Livingston International
Toronto, ON
…and optimize that movement. We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure that powers logistics operations, transportation analytics,…
Added 15 days ago
MC
Mechanical Commissioning Associate
Mission Critical Engineers | Mission Critical Forensics
Regina, SK
- Full-time
…Associate will work alongside the Lead Data Centre Commissioning Engineer & Project Manager and the commissioning team during system startup, test preparation, functional testing,…
Added 15 days ago
MC
Mechanical Commissioning Associate
Mission Critical Engineers | Mission Critical Forensics
Regina, SK
- Full-time
…Associate will work alongside the Lead Data Centre Commissioning Engineer & Project Manager and the commissioning team during system startup, test preparation, functional testing,…
Added 15 days ago
KA
Aircraft Maintenance Engineer - Structures Licensed
KF Aerospace
Kelowna, BC
- $38.03 to $45.65 CAD / hour
- Full-time
Ability to learn and understand KF organizational systems and workflow
Added 15 days ago
E
Senior Execution Engineer
Enbridge
Regina, SK · Sherwood Park, AB · Calgary, AB
- Full-time
…while driving operational excellence, innovation, and asset reliability. We are seeking a Senior Execution Engineer to join our…
Added 15 days ago
A
Software Dev Engineer, AFFS - ARS (Amortization Runtime Subledger)
Amazon
Vancouver, BC
- Full-time
…Services (AFFS), where we build mission-critical financial systems powering Amazon's global operations. Our team owns USL (Universal Subledger) and rACE (replayable Amortization Calculation…
Added 15 days ago
KG
DevOps Platform Engineer | AI & LLMOps Infrastructure
K&K Global Talent Solutions INC.
ON · Ontario, Canada
- Full-time
LLMOps & Platform Observability: Build the guardrails for production AI workloads, implementing systems for prompt management, tool execution, model evaluation, observability (CloudWatch),…
Added 15 days ago
I
Senior Mechanical Engineer (Semiconductor Packaging)
Inpho
Ottawa, ON · Kanata, ON
- Full-time
…solutions for next-generation communications, and photonic systems. Our multidisciplinary team is pushing the boundaries of innovation in integrated photonics and semiconductor…
Added 15 days ago
O(
Quality Engineer - 6-month contract
OTIP (Ontario Teachers Insurance Plan)
Waterloo, ON
- Contract
Reporting to the Senior Manager, DevOps & System Integration, the Quality Engineer is responsible for creating, reviewing, executing, and documenting the tests necessary to ensure that…
Added 15 days ago
B
Power Engineer - 3rd Class
BGIS
Peace River, AB
- Full-time
The 3rd Class Power Engineer performs operational work in a central heating and cooling plant or central heating plant and reports to the Maintenance Team Leader - MTL. BGIS functions to…
Added 15 days ago
SE
Lead RTL Engineer
Schweitzer Engineering Laboratories (SEL)
Burnaby, BC · Canada - Burnaby
- $105,600 to $158,400 CAD / year
- Full-time
Schweitzer Engineering Laboratories (SEL) is hiring a Lead Engineer with a focus in VHDL Register-Transfer Level (RTL) Digital Logic design for our R&D Communications product group. In this…
Added 15 days ago
Senior Backend Engineer II - Patient Experience
Prenuvo
Vancouver, BC
We're looking for a Senior Backend Engineer II to join our Patient Experience team and own the communications platform that keeps patients informed throughout their journey: booking…
Added 15 days ago
Sr. Staff Engineer, IP Runtime
Tenstorrent
Toronto, ON
An expert C or C++ engineer with a track record of designing and delivering complex, performance-critical systems.
Added 15 days ago
C
Software Engineer, GPU Inference
Cerebras
Toronto, ON
- Full-time
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times…
Added 15 days ago
S
Site Reliability Engineer
SMARTFOX
Canada
- Full-time
Senior SRE - 5+ years : Architecting resilient systems, setting reliability standards, leading cross-team initiatives, shaping on-call and incident culture
Added 15 days ago
A
Staff Software Engineer - Open Source Data Platform (ODP)
Acceldata
Kitchener, ON
- Full-time
We are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for…
Added 15 days ago
RL
Lead, Manufacturing Engineer
Rocket Lab
Toronto, ON
- Full-time
At Rocket Lab, we’re not just launching rockets - we're building the future of space. Our Space Systems team builds everything from complete spacecraft and precision payloads to the…
Added 15 days ago
R
SCADA Transmission Engineer
Raise
Burnaby, BC
- Full-time
The SCADA Transmission Engineer to join our clients team and play a key role in delivering complex, multi-discipline capital projects. In this role, your primary focus will be delivering…
Added 15 days ago
T
Site Reliability Engineer
TechDoQuest
Calgary, AB
- Full-time
The Wealth Management Production Management Site Reliability Engineer position is a highly visible/critical role, which will be a team member of technical SMEs managing the stability and…
Added 15 days ago
DC
Ingénieur principal en solutions PLC
Distech Controls
Brossard, QC
- Full-time
…delivering technologies and services that optimize performance, reliability, resiliency, and operational efficiency. We connect people with intelligent solutions through our passion for…
Added 15 days ago
CE
Engineering Specialist Optics
CMC Electronics
Montreal, QC
- Full-time
The technical specialist engineering class 4 works under the supervisor of an engineer or his delegate. Performs a variety of functions associate with the optical, electrical, electronic,…
Added 15 days ago
FI
Artificial Intelligence Engineer
Flexstaf I.T. Inc.
Canada
- Contract
Integrate AI applications with client systems, APIs, databases, document repositories, and business platforms.
Added 15 days ago
LC
Programming Engineer
Linamar Corporation
Guelph, ON
- Full-time
The Programming Engineer is responsible for designing, developing, and supporting software and system solutions that enhance manufacturing and engineering operations. This role owns key…
Added 15 days ago
AC
Mechanical Designer
Allnorth Consultants Limited
Regina, SK · Saskatoon, SK
- Full-time
Lead and contribute to the design and development of mechanical systems for industrial, commercial, and infrastructure projects.
Added 15 days ago
AC
Senior Mechanical Engineer
Allnorth Consultants Limited
Regina, SK · Saskatoon, SK
- Full-time
We are seeking a Senior Mechanical Engineer to join our team in either our Saskatoon or Regina office. Our work combines technical excellence with innovative problem-solving to deliver…

Cerebras

Software Engineer, GPU Inference

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 8, 2026
Experience: 5+ years of software engineering experience, including substantial individual-contributor ownership of complex production systems.
Posting language: English
Posted: Oct 9, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

Cerebras is building a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine.

We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime, the AMD ROCm software stack, and rack-scale AMD GPU infrastructure, to make this new serving path reliable, numerically correct, observable, and exceptionally performant.

You will write production code, establish operational practices for a new accelerator fleet, and drive improvements in time to first token, throughput, tail latency, and capacity efficiency. This is a hands-on role requiring deep debugging and optimization across application, runtime, distributed systems, and hardware layers.

Responsibilities

Productionize the GPU inference stack. Design, build, deploy, and maintain the complete GPU prefill path, spanning API services, model-serving workers, vLLM, PyTorch, ROCm, GPU nodes, networking, and rack-scale infrastructure.
Own GPU operational readiness. Establish deployment, upgrade, rollback, health-checking, capacity-management, and failure-recovery practices for the AMD GPU fleet. Build automation that makes driver, firmware, runtime, model, and container compatibility explicit and reproducible.
Drive reliability in production. Define service-level indicators and objectives for GPU-backed inference. Improve fault isolation, graceful degradation, automated recovery, incident response, and post-incident remediation across the serving stack.
Improve inference performance. Profile and optimize time to first token, request throughput, tokens per second per GPU, tail latency, GPU utilization, memory efficiency, and rack-level capacity under representative production workloads.
Optimize model-serving behavior. Tune and improve scheduling, continuous batching, prefix caching, KV-cache management, tensor and expert parallelism, request admission, quantization, graph execution, and distributed communication.
Debug across system layers. Diagnose complex failures and performance regressions across application code, vLLM, PyTorch, ROCm/HIP, collective communication libraries, kernels, drivers, firmware, networking, and hardware.
Ensure numerical correctness. Build validation and regression infrastructure for model quality, numerical accuracy, precision changes, quantization, determinism, and compatibility across software and hardware releases.
Build performance and correctness infrastructure. Develop representative benchmarks, workload replay tools, profiling automation, release qualification, dashboards, and regression gates. Turn one-off investigations into repeatable engineering systems.

Minimum Qualifications

5+ years of software engineering experience, including substantial individual-contributor ownership of complex production systems.
Experience building, operating, or optimizing production inference systems for large language models, multimodal models, or similarly demanding GPU workloads.
Strong programming ability in C++ and Python, including experience with multithreading, concurrency, memory management, and performance-sensitive software.
Hands-on experience with a high-performance model-serving framework such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or an equivalent internally developed system.
Strong understanding of GPU execution and performance, including asynchronous execution, memory movement, synchronization, kernel launches, communication overhead, and profiling methodology.
Experience debugging distributed systems across multiple layers rather than treating the serving framework or accelerator runtime as a black box.
Experience with Linux, containers, Kubernetes or comparable orchestration systems, observability, CI/CD, and operating latency-sensitive services in production.
Ability to design rigorous benchmarks, interpret noisy performance results, identify bottlenecks, and translate findings into production improvements.
Strong communication and technical leadership skills, with a demonstrated ability to drive ambiguous cross-functional projects to completion.
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related discipline, or equivalent practical experience.

Preferred Qualifications

Experience with AMD Instinct accelerators and the ROCm ecosystem, including HIP, RCCL, rocprofiler, AMD SMI, AITER, hipBLASLt, Composable Kernel, or related libraries and tools.
Deep CUDA experience that demonstrates an ability to transfer GPU systems knowledge across accelerator platforms.
Experience modifying or contributing to vLLM, SGLang, PyTorch, Triton, TensorRT-LLM, or another open-source ML systems project.
Experience optimizing prefill-heavy or disaggregated prefill/decode inference architectures.
Understanding of KV-cache transfer, prefix caching, continuous batching, chunked prefill, request scheduling, and memory-aware admission control.
Experience with multi-GPU and multi-node inference, including tensor parallelism, pipeline parallelism, expert parallelism, RDMA, collective communication, and failure handling.
Experience optimizing Mixture-of-Experts or multimodal models.
Knowledge of GPU kernel optimization, operator fusion, graph capture, attention kernels, GEMM tuning, and communication/computation overlap.
Experience with reduced-precision inference and quantization formats such as BF16, FP8, FP4, INT8, or INT4, including validation of their numerical and model-quality effects.
Experience building numerical-comparison, determinism, model-validation, or performance-regression test systems.
Experience collaborating directly with accelerator vendors, framework maintainers, or open-source communities.

Why Join Cerebras

About

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Apply About employer

More about this job

Responsibilities

Productionize and operate the GPU prefill serving stack across APIs, vLLM, PyTorch, ROCm, GPU nodes, and rack-scale infrastructure, establishing deployment, reliability, and recovery practices. Optimize inference performance and capacity, debug issues across software and hardware layers, and build repeatable benchmarking, correctness, observability, and release-qualification systems.

Requirements

Requires at least five years of software engineering experience, substantial ownership of production systems, experience with production LLM or comparable GPU inference, strong C++ and Python skills, and hands-on experience with a high-performance serving framework. Candidates should understand GPU execution and distributed systems, have experience operating latency-sensitive services with Linux, containers, orchestration, observability, and CI/CD, and hold a bachelor’s degree in a related discipline or equivalent practical experience.

Skills

C++
Python
GPU Inference
vLLM
AMD ROCm
GPU Performance Optimization
Distributed Systems
Kubernetes
Linux
Model Serving
Performance Profiling
Continuous Batching
KV-Cache Management
Quantization
Numerical Validation
Production Reliability

Visa sponsorship

Not detected in the job text

Keywords

Cerebras Systems
GPU Inference
AMD Instinct
AMD ROCm
HIP
RCCL
vLLM
PyTorch
SGLang
TensorRT-LLM
Triton Inference Server
C++
Python
Kubernetes
Linux
Distributed Systems
Rack-Scale Infrastructure
Continuous Batching
Prefix Caching
KV-Cache
Tensor Parallelism
Expert Parallelism
RDMA
Quantization
BF16
FP8
GPU Kernel Optimization
Performance Profiling
Numerical Correctness
Inference Reliability

Report this job