Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 9 hours ago
PG
Manager, Media Planning
Publicis Groupe Holdings B.V
Toronto, ON
- Full-time
…However, it is an art that is always best when backed by the science of empirical…
Added 9 hours ago
ET
Braze Lead Developer
EXL Talent Acquisition Team
Canada
- Hybrid
We are seeking a hands-on Braze Lead Developer to build, integrate, and scale Braze solutions for enterprise clients. You will lead a team of developers while remaining deeply hands-on:…
Added 9 hours ago
Director, Data Science (Investments)
Mackenzie Financial Corporation
Toronto, ON
…seeking a Director, Investment Research to build and run the data, quantitative and AI capabilities that support our boutique investment teams. Working closely with the AI platform lead,…
Added 9 hours ago
TO
Patent Agent
Type One Energy Group, Inc.
Vancouver, BC
- Full-time
- On-site
Bachelor's degree in engineering, physics, chemistry, materials science, computer science, or a related technical field.
Added 9 hours ago
CS
Senior Software Engineer, ML API – AI Inference
Cerebras Systems
Toronto, ON
- Full-time
- Hybrid
- Improve customer and developer experience. Partner with product, support, and solutions teams to understand user needs and make practical tradeoffs. Improve configuration, documentation,…
Added 9 hours ago
O
Application Engineer - Partial Discharge Diagnostics, Level III / IV, NA Region (f/m/x)
OMICRON
Toronto, ON
- Full-time
Plan and perform PD measurements, interpret results, assess data quality, and provide clear, technically sound recommendations to customers.
Added 9 hours ago
CR
Formulations Specialist
Charles River
QC
- $28.5 CAD / hour
- On-site
College diploma (DEC) in Laboratory Science, Biotechnology, or another related field.
Added 9 hours ago
Directeur(trice) Associé(e), Construction Régionale / Associate Director, Regional Construction
Pure Industrial
Montréal, QC
Added 9 hours ago
CR
Certified Technician, OPTMQ - Clinical Laboratories
Charles River
QC
- $28.25 CAD / hour
- On-site
Use a computer system for accurate and detailed data collection.
Added 9 hours ago
Raw Material Compliance Review Associate Consultant
ClinChoice
Canada
Assist with maintaining regulatory compliance of raw material dossiers by reviewing data on file, performing data gap analysis and communicating with suppliers, as needed.
Added 9 hours ago
Analyst- Data & Automation / Data specialist (
Deloitte
Toronto, ON
We are looking for an Analyst – Data & Automation who is comfortable working at the intersection of technology, data and business.
Added 9 hours ago
TB
Industrial Sales and Market Development Representative
Tolko Brand - External
Vernon, BC
- $95,000 to $125,000 CAD / year
- Full-time
Post-secondary education in business, engineering, forestry, wood science, or another related discipline.
Added 9 hours ago
A
IT Auditor
Altis
Ottawa, ON
- Full-time
You'll advance audit practices through data analytics, emerging technologies, mentorship and continuous improvement.
Added 9 hours ago
AC
Senior Project Geologist
ALS Canada Ltd.
Vancouver, BC · Calgary, AB · Toronto, ON
- Full-time
When you join us, you’ll be part of a global team harnessing the power of scientific testing and data-driven insights to build a healthier future.
Added 9 hours ago
FH
Radiological technologist
Fraser Health Authority
Langley, BC
- $40.19 to $50.2 CAD / hour
…include receiving and completing requisitions, entering relevant data into the Radiology Information System (RIS), preparing patients for examination, operating radiographic and…
Added 9 hours ago
Seed Science Operations Agronomy Manager
BASF SE
Saskatoon, SK
We are looking for a Seed Science Operations Agronomy Manager to join our Agricultural Solutions team in Saskatoon, SK. In this role, you will provide leadership and operational support for…
Added 9 hours ago
Manager - Technology Strategy-24 Month Secondment, Deloitte Global E&A
Deloitte
Toronto, ON
Bachelor's degree in Computer Science, Engineering, Data/Information Systems, or a related technical field required; Master's degree or MBA preferred.
Added 9 hours ago
GO
Plant Health Technologist
Government of Saskatchewan
Regina, SK
- On-site
Coordination of the provincial pest survey program including scheduling, communications, progress tracking, data flow and follow up across the annual program.
Added 9 hours ago
GP
Category Manager, Raw Materials
Galderma Prod Canada Inc.
Baie-D'Urfé, QC
- Full-time
…pays. Nous proposons un portefeuille innovant, basé sur la science, de marques phares haut de gamme et de services qui couvrent l'ensemble du spectre du marché de la dermatologie en pleine…
Added 9 hours ago
Manager, Enterprise Data Platform & Governance
Vacances Air Canada / Air Canada Vacations
Mississauga, ON · Montréal, QC
Hybrid work model: Corporate Mandate of 4 days in office (Tuesday, Wednesday, Thursday + 4th day of your choice) and 1 day from home
Added 9 hours ago
IG
Integration Developer
Insight Global
Thunder Bay, ON
- From $131 CAD / hour
- Contract
Degree or diploma in Computer Science, Software Engineering, Information Technology, Health Informatics, or a related discipline, or an equivalent combination of education and relevant…
Added 9 hours ago
LH
DRCC Radiation Therapist
Lakeridge Health
ON
- $40.48 to $56.42 CAD / hour
* Must have a satisfactory performance record;
Added 9 hours ago
Manager, IT Business Solutions
The Town of East Gwillimbury
Sharon, ON
The ideal candidate will have a university degree in Computer Science with emphasis on data management and software development, GIS, or related discipline.
Added 9 hours ago
CN
Director, Digital Safety
Canadian Nuclear Laboratories LTD
Chalk River, ON
- Full-time
Data protection and asset lifecycle management
Added 9 hours ago
P-
Site Supervisor S2 Up to 8 FTE
PHSA - Provincial Health Services Authority
Whistler, BC
- $43.48 to $54.28 CAD / hour
- Full-time
…informed of the equipment needs for the site/area and provides data such as test volumes and maintenance documents as required. Informs; Operations Manager, Technical Practice Lead, or…

Cerebras Systems

Senior Software Engineer, ML API – AI Inference

Toronto, ON, Canada

Hybrid

Full-time

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Hybrid
Experience: 5+ years of software engineering experience, including independent ownership of production services, distributed systems, or substantial software components.
Posting language: English
Posted: Oct 27, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the Role

Cerebras is building a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine.

We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving system accessible, reliable, and easy to use. You will own significant features and components across our inference APIs, model integration layer, and request-routing services, delivering a consistent experience across models and accelerator backends.

This role sits at the intersection of machine learning systems, API design, model serving, and distributed systems. You will translate evolving model capabilities and customer requirements into clear designs, lead implementation across multiple components, and carry features through validation, rollout, and production operation. Your work will help ensure that streaming, sampling, tool use, structured outputs, multimodal inputs, and model configuration behave correctly and consistently.

You will work closely with model enablement, compiler, runtime, cloud infrastructure, product, and customer-facing teams, as well as customers directly. This is a hands-on individual-contributor role with opportunities to lead small project teams, mentor engineers, and improve the quality and reliability of production inference software.

Responsibilities

Own features end to end. Design, implement, test, and operate features for chat completions, text generation, streaming, model configuration, tool calling, structured outputs, multimodal inputs, and emerging inference capabilities.

Lead multi-component delivery. Write clear design documents, evaluate technical tradeoffs, break projects into deliverable milestones, and coordinate implementation with a small group of engineers and partner teams.

Deliver consistent API behavior. Implement clear request and response semantics across GPU prefill, Cerebras decode, and other inference backends. Maintain compatibility with widely adopted inference interfaces and evolve owned APIs through validation, versioning, and deprecation best practices.

Enable new models and capabilities. Integrate foundation models, tokenizers, chat templates, generation configuration, sampling methods, and model-specific features into the serving platform.

Integrate serving components. Extend inference services and their integration with frameworks and runtimes such as vLLM, PyTorch, Hugging Face libraries, LLGuidance, and Cerebras runtime components.

Support disaggregated inference. Implement routing, state-transfer integration, error handling, retries, cancellation, and request lifecycle management to coordinate GPU prefill with Cerebras decode.

Deliver measurable performance improvements. Diagnose bottlenecks and improve time to first token, streaming latency, throughput, and resource efficiency through changes to tokenization, serialization, batching, scheduling, and communication.

Own correctness and release quality. Build conformance tests, model-validation suites, numerical comparisons, integration tests, and performance benchmarks that catch regressions in owned features and support safe releases.

Strengthen production reliability. Improve service metrics, tracing, logging, alerts, and diagnostic tools. Investigate production incidents, resolve root causes, and follow through on improvements to resilience and incident response.

Improve customer and developer experience. Partner with product, support, and solutions teams to understand user needs and make practical tradeoffs. Improve configuration, documentation, examples, and debugging workflows.

Raise the engineering quality bar. Provide thoughtful design and code reviews, mentor less-experienced engineers, share domain knowledge, and proactively remove delivery roadblocks.

Minimum Qualifications

5+ years of software engineering experience, including independent ownership of production services, distributed systems, or substantial software components.

Strong programming ability in Python and proficiency in Go, C++, Rust, or another language used to build production services.

Experience designing and delivering features that span multiple components, including documenting designs, evaluating tradeoffs, and coordinating implementation with other engineers.

Experience building and evolving production APIs, with sound practices for validation, error handling, compatibility, and testing. Familiarity with REST, gRPC, or streaming protocols.

Experience integrating software across service, framework, runtime, or infrastructure boundaries.

Experience operating services on Linux using containers, Kubernetes or comparable orchestration systems, and CI/CD.

Ability to diagnose correctness, reliability, and performance issues across distributed components and deliver measurable improvements.

Strong communication and collaboration skills, including experience leading technical delivery for a small project and supporting other engineers through reviews or mentorship.

Ability to turn ambiguous requirements into maintainable software while balancing customer needs, delivery timelines, and operational quality.

Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related discipline, or equivalent practical experience.

Preferred Qualifications

Experience building or operating production ML or LLM inference APIs, including OpenAI-compatible interfaces.

Experience extending or contributing to vLLM, SGLang, PyTorch, Hugging Face Transformers, Triton, TensorRT-LLM, or another ML systems project.

Understanding of tokenization, chat templates, generation configuration, logits processing, stopping criteria, tool calling, structured generation, or constrained decoding.

Experience with disaggregated prefill/decode architectures, KV-cache transfer, prefix caching, chunked prefill, or inference request scheduling.

Experience building API conformance, model-quality, numerical-comparison, determinism, or performance-regression test systems.

Experience with multi-model or multi-tenant serving, including routing, admission control, quotas, rate limiting, or capacity-aware scheduling.

Experience developing performance-sensitive or highly concurrent services in Go, C++, Rust, or a similar language.

Familiarity with GPU inference, AMD Instinct accelerators, ROCm, CUDA, collective communication, or multi-node model serving.

Familiarity with reduced-precision inference and quantization formats such as BF16, FP8, FP4, INT8, or INT4.

Experience building SDKs, developer tools, configuration systems, or self-service ML workflows, or collaborating directly with customers and open-source communities.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Apply on jobs.ashbyhq.com About employer

More about this job

Responsibilities

The Senior Software Engineer at Cerebras Systems will design, build and operate inference API features, lead projects across several engineers, and improve speed and reliability of AI model serving.

Requirements

Candidates need 5+ years of software engineering experience, strong Python and a production language such as Go, C++ or Rust, and experience building production APIs and operating services on Linux with containers and Kubernetes.

Skills

Python
Go
C++
Rust
vLLM
PyTorch
Hugging Face Transformers
LLGuidance
Triton
TensorRT-LLM
SGLang
REST
gRPC
Streaming protocols
Kubernetes
Docker
Linux
CI/CD
GPU inference
CUDA
ROCm
Distributed systems
Tokenization
Chat templates
Constrained decoding

Keywords

Senior Software Engineer
ML API
AI inference
LLM inference
chat completions
streaming
tool calling
structured outputs
multimodal inputs
vLLM
PyTorch
Hugging Face
Python
Go
C++
Rust
Kubernetes
Docker
CI/CD
distributed systems

Seniority

Senior

Tools

Kubernetes
vLLM
PyTorch
Hugging Face Transformers
LLGuidance
CUDA

Languages

English

Fields of study

Computer Science
Computer Engineering
Electrical Engineering

Report this job

Work requirements

Jobs in Canada