Jobs in Canada

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 19 mins ago
SC
SAP Delivery Executive | Northeast-Canada Market Unit
SAP Careers
Toronto, ON
- $260,000 to $310,000 CAD / year
- Full-time
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At…
Added 2 hours ago
W
Associate Technical Consultant, Geotechnical Engineer
Worley
Oakville, ON · Markham, ON · Vancouver, BC · Calgary, AB
- Full-time
Worley Consulting, the specialist consulting business of Worley, provides technical and advisory solutions across the energy, resources and infrastructure sectors. We deliver safe,…
Added 2 hours ago
SG
Associate Director, North America Regulated Utilities, Infrastructure Ratings
S&P Global
Toronto, ON
- Full-time
Partner with stakeholders to identify high-impact analytical use cases and support testing, adoption, and rollout with appropriate governance, controls, and change management.
Added 2 hours ago
AG
Director of Talent Acquisition and Development
AD Group of Companies
Burnaby, BC
- Full-time
You will work directly with the President and senior leadership team to align talent strategy with business objectives. Your work will have a direct impact on our ability to scale, enter…
Added 2 hours ago
RP
Advisor, Employee Relations
Rexall Pharmacy Group Ltd.
Mississauga, ON
- $65,857.6 to $86,438.1 CAD / year
- Full-time
Warm and fuzzy feelings knowing you have helped your community, your team, the business and social causes through the Rexall Care Network
Added 3 hours ago
CC
Part-Time General Labourer, Warehouse
Coca-Cola Canada Bottling Limited
Barrie, ON
- Part-time
Advancing a high-performing, collaborative and inclusive culture is at the core of our vision to be the World’s Greatest Bottler, Built by the Best People, and we’re looking for exceptional…
Added 3 hours ago
RP
HR Business Partnerships Manager
Rexall Pharmacy Group Ltd.
Mississauga, ON
- $80,452.8 to $105,594.3 CAD / year
- Full-time
Act as business partner to client groups; providing full support in the areas of HR, change management and organizational planning.
Added 3 hours ago
CC
Operational Technology Specialist
Coca-Cola Canada Bottling Limited
Montreal, QC
- Full-time
Advancing a high-performing, collaborative and inclusive culture is at the core of our vision to be the World’s Greatest Bottler, Built by the Best People, and we’re looking for exceptional…
Added 3 hours ago
CC
Safety Coordinator
Coca-Cola Canada Bottling Limited
Brampton, ON
- Full-time
Advancing a high-performing, collaborative and inclusive culture is at the core of our vision to be the World’s Greatest Bottler, Built by the Best People, and we’re looking for exceptional…
Added 3 hours ago
SE
Senior Design Firms Sales Representative
Schneider Electric
Richmond, BC
- $129,600 to $172,800 CAD / year
- Full-time
When you are thinking about joining a new team, culture matters. At Schneider Electric, our values and behaviors are the foundation for creating a great culture to support business success.…
Added 3 hours ago
RT
Senior Principal Engineer
Raising The Village
Remote, Canada
- Full-time
- Remote
…stakeholders, and delivery teams to ensure solutions align with RTV's business objectives, architectural standards, and long-term operating…
Added 3 hours ago
M
Senior Leader, Employee & Individual Benefits
Marsh
Ottawa, ON · Mississauga, ON
- Other
Foster a client-centric and innovation-oriented culture focused on service excellence, operational efficiency, and measurable business impact.
Added 3 hours ago
CM
Marketing Science Lead
Critical Mass
Toronto, ON
- Full-time
Cross-Functional Collaboration: Partner with client teams and internal stakeholders to identify, prioritize, and address complex business needs, translating raw data into actionable…
Added 4 hours ago
Customer Support Representative
Zen Educate
Vancouver, BC
Location: Hybrid, Vancouver, BC (3 days in office/week)
Added 4 hours ago
WA
Associate Director, Content & Community
We Are Social
Toronto, ON
- $95,000 to $115,000 CAD / year
- Full-time
This is a client-facing role for someone who loves turning business challenges into compelling social-first strategies and creative opportunities. They know their platforms, keep their…
Added 4 hours ago
HT
Director, Finance (CSM)
Husky Technologies
Bolton, ON
- Full-time
Husky TechnologiesTM has a strong foundation built on innovation, close customer relationships and a unique culture and values. We are dedicated to offering our customers the highest…
Added 4 hours ago
HT
Director, Global Marketing & Sales Enablement
Husky Technologies
Bolton, ON
- Full-time
…customer relationships, a strong sense of community and a unique culture and values. We are looking for people with the inspiration and talent to develop with us as we pursue our ambitious…
Added 4 hours ago
FI
Technical Editor
Fleetway Inc.
Dartmouth, NS
- Full-time
…integrity and are passionate about delivering results. With a culture that nurtures talent and creates an inclusive workplace, you can grow your career across our various operating…
Added 4 hours ago
QE
Strategic Sourcing Specialist
Quadro Engineering
Waterloo, ON
- Full-time
Identify, evaluate, negotiate with, and qualify best-in-class suppliers capable of supporting current and future business requirements.
Added 4 hours ago
C
Engineering Manager, Inference Router
Cerebras
Toronto, ON
- Full-time
Partner with inference runtime, cloud/platform, hardware, and ML teams to optimize end-to-end performance.
Added 4 hours ago
HT
Payroll Manager, Americas
Husky Technologies
Bolton, ON
- Full-time
…customer relationships, a strong sense of community and a unique culture and values. We are looking for people with the inspiration and talent to develop with us as we pursue our ambitious…
Added 4 hours ago
HT
Financial Manager - PLM (Product Line Mgmt)
Husky Technologies
Bolton, ON
- Full-time
…customer relationships, a strong sense of community and a unique culture and values. We are looking for people with the inspiration and talent to develop with us as we pursue our ambitious…
Added 4 hours ago
AL
Customer Care Coordinator
Air Liquide
Mississauga, ON
- Full-time
Air Liquide Home Healthcare Canada is a leading provider of sleep apnea tests, treatments, and home oxygen services. We partner closely with the healthcare community to deliver an…
Added 4 hours ago
A
Conference Services & Event Sales Manager
AccorHotel
Calgary, AB
- Full-time
At Fairmont, we want to bring out your highest potential. Shortly after applying, you will receive an email from our partner AssessFirst prompting you to create a profile and complete a…
Added 4 hours ago
WA
Associate Director, Content & Community
We Are Social
Remote, Canada
- $95,000 to $115,000 CAD / year
- Remote
This is a client-facing role for someone who loves turning business challenges into compelling social-first strategies and creative opportunities. They know their platforms, keep their…

Cerebras

Engineering Manager, Inference Router

Toronto, ON, Canada

Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Dec 12, 2026
Posting language: English
Posted: Nov 12, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

The Inference Router team at Cerebras builds the systems that decide where every inference request runs. We route traffic across all of Cerebras’ data centers and third-party integrations, balancing heterogeneous compute, maximizing cache utilization, and delivering the industry’s lowest time-to-first-token (TTFT) at massive scale.

As an Engineering Manager, Inference Router, you will lead the team responsible for the intelligent control plane of the fastest generative AI inference platform in the world. Your team owns global request routing, prefill/decode (P/D) disaggregation, prefix-aware routing for high cache hit rates, autoscaling, and the high-availability infrastructure that keeps the platform fast and reliable under real-time, bursty load.

This role operates at the intersection of distributed systems, Kubernetes-based infrastructure, routing-algorithm design, and machine learning. It combines technical leadership, people management, and execution ownership, with direct impact on the latency, throughput, and reliability experienced by every Cerebras inference customer.

What You’ll Do

Technical Leadership

Own the architecture and evolution of the inference routing layer across all Cerebras data centers and third-party inference integrations.
Guide the design of:
- global, multi-region request routing and load balancing;
- routing for heterogeneous compute, including prefill/decode (P/D) disaggregated serving;
- prefix-aware / cache-aware routing to maximize KV-cache reuse and utilization;
- low-TTFT, high-throughput request scheduling under concurrent, bursty workloads.
Drive the routing algorithms that trade off cache locality, queueing, load, and latency in real time.
Invest in simulation: build high-fidelity models of the fleet and its workloads so the team can validate routing policies, failover behavior, and scaling decisions under a wide range of conditions without tying up precious accelerator capacity.
Partner with inference runtime, cloud/platform, hardware, and ML teams to optimize end-to-end performance.

Team Leadership

Build, manage, and grow a team of distributed systems, infrastructure, and ML systems engineers.
Provide technical direction, mentorship, and career development.
Foster a culture of ownership, velocity, and operational excellence.
Recruit top talent in distributed systems, Kubernetes/infrastructure, and routing/ML systems.

Execution & Delivery

Drive execution of complex, cross-functional initiatives spanning inference runtime, cloud/infrastructure, and ML teams.
Own delivery of capabilities such as:
- prefix- and cache-aware routing policies;
- P/D-disaggregation-aware scheduling and placement;
- autoscaling and capacity management across heterogeneous fleets;
- high availability, failover, and graceful degradation;
- simulation and load-generation frameworks that exercise the router under diverse traffic patterns, failure modes, and fleet topologies - without consuming scarce production compute;
- observability, SLOs, and reliability across the routing stack.
Ensure high-quality releases through strong testing, load/chaos validation, and operational rigor.

Platform & Performance Ownership

Scale the routing layer to handle very large volumes of concurrent requests at the lowest possible latency.
Drive improvements in TTFT, throughput, cache-hit rate, and compute efficiency across the fleet.
Design for reliability and high availability: failover, redundancy, scale-out, and fail-closed behavior under partial outages.
Identify and prioritize technical debt and system bottlenecks.
Maintain Cerebras’ industry-leading inference speed advantage.

Cross-Functional Collaboration

Partner with:
- inference runtime teams (execution and serving);
- cloud/platform and SRE teams (deployment, scaling, reliability);
- ML researchers and engineers (model enablement, routing signals);
- third-party integration partners.
Act as a bridge between infrastructure, routing, and production systems.

What You Bring

8+ years of experience in large-scale software engineering, distributed systems, or infrastructure.
2+ years of engineering management experience.
Strong programming skills in C++ and/or Go for performance-critical, concurrent production systems.
Deep experience operating production services on Kubernetes: deployments, autoscaling, rollout strategies, and multi-cluster/multi-region topologies.
Proven track record building and operating highly available, scalable systems: load balancing, failover, scale-out, and reliability engineering.
Experience designing or operating request routing, load balancing, scheduling, or traffic-management systems at scale.
Experience with cloud infrastructure and best practices for building scalable microservices.

Preferred Skills

Experience with large-scale LLM/inference serving and the systems around it (e.g. vLLM, TensorRT-LLM, SGLang, or comparable).
Familiarity with prefill/decode (P/D) disaggregation, KV-cache management, and prefix/cache-aware routing.
ML background: understanding of inference workloads, batching, and the performance characteristics of serving LLMs and multimodal models.
Experience with autoscaling and capacity management across heterogeneous compute.
Experience building simulation, modeling, or load-testing frameworks for distributed systems to validate behavior cost-effectively at scale.
Strong grounding in observability (metrics, tracing, SLOs) and incident response for high-traffic production systems.

Why This Role Matters

The Inference Router is the control plane behind Cerebras’ core promise: the fastest AI inference in the world. The routing decisions your team makes - across data centers, across heterogeneous compute, with cache-awareness and high availability - directly determine the latency, throughput, and reliability every customer experiences. Your work keeps real-time AI applications fast and dependable, and unlocks new capabilities across enterprise and frontier AI use cases.

Why Join Cerebras

About

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Apply on LinkedIn About employer

More about this job

Responsibilities

Lead the architecture, development, and operation of Cerebras’ global inference routing platform, including cache-aware routing, prefill/decode scheduling, autoscaling, simulation, and high availability. Manage and grow an engineering team while coordinating cross-functional delivery and improving latency, throughput, cache utilization, and reliability.

Requirements

Requires at least 8 years of experience in software engineering, distributed systems, or infrastructure, including at least 2 years of engineering management experience. Candidates should have strong C++ and/or Go skills, deep Kubernetes production experience, and a track record building scalable, highly available routing or traffic-management systems; LLM inference experience is preferred.

Skills

Distributed Systems
Engineering Management
C++
Go
Kubernetes
Request Routing
Load Balancing
Inference Serving
Prefill/Decode Disaggregation
KV-Cache Management
Autoscaling
High Availability
Simulation and Load Testing
Observability
Reliability Engineering
Cloud Infrastructure

Visa sponsorship

Not detected in the job text

Keywords

Cerebras Systems
AI Inference
Inference Router
Distributed Systems
C++
Go
Kubernetes
Multi-Region Routing
Load Balancing
Prefill/Decode Disaggregation
KV Cache
Cache-Aware Routing
Request Scheduling
Autoscaling
Heterogeneous Compute
High Availability
Failover
Graceful Degradation
Simulation Frameworks
Load Testing
Chaos Testing
Observability
Metrics
Tracing
Service-Level Objectives
Incident Response
LLM Serving
vLLM
TensorRT-LLM
SGLang

Report this job

Work requirements

Jobs in Canada