Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 14 hours ago
Director, Data Science (Investments)
Mackenzie Financial Corporation
Toronto, ON
…teams’ priorities and communicating plans and trade-offs to senior…
Added 14 hours ago
M
Senior DevOPS/Cloud Engineer
modis
Toronto, ON
- Contract
- Temporary
Akkodis is seeking an experienced Senior DevOps / Cloud Engineer to support enterprise cloud integration platforms and AWS-based application environments. The successful consultant will…
Added 14 hours ago
CS
Senior Software Engineer, ML API – AI Inference
Cerebras Systems
Toronto, ON
- Full-time
- Hybrid
We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving system accessible, reliable, and easy to use. You will own significant…
Added 14 hours ago
S&
Senior Grid Interconnection Consultant
Sargent & Lundy
Canada
- Full-time
Experience in Python, Java Script, or other scripting languages
Added 14 hours ago
A
IT Auditor
Altis
Ottawa, ON
- Full-time
…strengthen risk management practices and provide trusted insights to senior…
Added 14 hours ago
IG
Software Architect
Insight Global
Vancouver, BC
- Contract
Hands-on knowledge of various backend development languages like Java, Go and Python.
Added 14 hours ago
UO
Integrated Planning Faculty Analyst
University of Waterloo
Waterloo, ON
- Full-time
Develops reusable scripts and tools (Python, R, SQL, etc.) to support data preparation, integration, and analysis
Added 14 hours ago
E
EverCommerce - Staff Engineer
Evercommerce
ON
- $160,000 to $190,000 CAD / year
- Full-time
…event-driven Java/Spring Boot microservice in the morning, mentor a senior engineer on system design in the afternoon, and deploy generative AI / agentic workflows (AWS Bedrock) to…
Added 14 hours ago
IG
QE Lead, Functional
Insight Global
Vancouver, BC
- $113,000 to $140,000 CAD / year
- Contract
- Experience operating as a senior technical contributor or SDET
Added 14 hours ago
DL
Senior Analyst, Private Corporate Credit
DBRS Limited - Canada Legal Entity
Toronto, ON
- Full-time
Morningstar DBRS is seeking a Senior Analyst to join its Private Corporate Credit team. This role combines financial data analytics, leveraged finance research, and credit analysis, with an…
Added 14 hours ago
AU
Software Dev Engineer, Pricing Shared Platform
Amazon.com.ca, ULC
Vancouver, BC
- Full-time
- Contribute ideas to technical designs, ask good questions, and grow your scope and autonomy over time with support from senior engineers and mentors.
Added 14 hours ago
M
Senior Data Architect
Miratech
ON
- Full-time
- Hybrid
Working Model: This is a hybrid role requiring 2 days per week in a downtown Toronto office
Added 14 hours ago
HW
Senior AI Developer (RAG, Agents & Microservices) | Onsite | Salary in Euros | Ontario Canada
HR Ways
ON
- Full-time
Job Title: Lead / Senior AI Developer (RAG, Agents & Microservices)
Added 14 hours ago
Senior Customer Engineer - Calgary, AB
Cloudflare
Calgary, AB
Added 14 hours ago
RC
Senior Data Architect/Modeller
Randstad Canada
Toronto, ON
- Contract
We are seeking an experienced Senior Data Architect/Modeller to lead the review, analysis, and design of robust data architectures within complex, distributed application environments. In…
Added 14 hours ago
S
Staff Software Engineer
Senpilot
Toronto, ON
- Full-time
- Hybrid
What you will find in our current tech stack: TypeScript, Python, Node.js, GCP, Kubernetes, React, PostgreSQL and Temporal.
Added 14 hours ago
IG
Senior Financial Analyst / Associate Finance Manager Potential – Direct Fulfillment
Insight Global
Kleinburg, ON
- $95,000 to $105,000 CAD / year
- Contract
We are seeking a Senior Financial Analyst / Associate Finance Manager-level professional to support a Direct Fulfillment and customer delivery organization.
Added 14 hours ago
IG
CONFIDENTIAL: AI Engineer
Insight Global
Vancouver, BC
- $100,000 to $300,000 CAD / year
- Contract
5+ years of software engineering experience with strong Python development skills.
Added 14 hours ago
Senior AI Automation Engineer
Later
Vancouver, BC
…Later Social, and Later Creator), with regular exposure to senior leadership and broad visibility into how the company actually…
Added 14 hours ago
IG
Sr. Python Developer
Insight Global
Toronto, ON
- From $68 CAD / hour
- Contract
Our client is seeking two Senior Python Developers to support a strategic initiative focused on modernizing and migrating existing SAS-based analytics processes into Python. This individual…
Added 14 hours ago
R
Senior Front End Engineer
ReBlink
Toronto, ON
- $90,000 to $163,000 USD / year
- Full-time
- On-site
Added 14 hours ago
SS
Senior Software Engineer
Solid State AI
Toronto, ON
- Full-time
- Hybrid
We’re looking for a Senior Python developer to join our team (company headquarters are in Toronto, Canada). You should think about joining us if you have passion for architecting software…
Added 14 hours ago
SS
Senior ML Engineer
Solid State AI
Toronto, ON
- $120,000 to $160,000 CAD / year
- Full-time
- Hybrid
Added 14 hours ago
RC
Senior Systems Testing/QA Specialist
Randstad Canada
Toronto, ON
- Contract
We are seeking an experienced Senior Systems Testing/QA Specialist to lead and execute comprehensive quality assurance across enterprise software solutions and Commercial Off-the-Shelf…
Added 14 hours ago
CQ
AI Engineer - Junior (BC)
Canada Quant Labs
Victoria, BC
- $85,000 to $115,000 CAD / year
- Full-time
…pipelines, inference benchmarks, and model cards, mentored by senior engineers. Full-time, permanent, hybrid from our Victoria, BC office. CAD $85,000–$115,000 per year plus equity,…

Cerebras Systems

Senior Software Engineer, ML API – AI Inference

Toronto, ON, Canada

Hybrid

Full-time

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Hybrid
Experience: 5+ years of software engineering experience, including independent ownership of production services, distributed systems, or substantial software components.
Posting language: English
Posted: Oct 27, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the Role

Cerebras is building a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine.

We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving system accessible, reliable, and easy to use. You will own significant features and components across our inference APIs, model integration layer, and request-routing services, delivering a consistent experience across models and accelerator backends.

This role sits at the intersection of machine learning systems, API design, model serving, and distributed systems. You will translate evolving model capabilities and customer requirements into clear designs, lead implementation across multiple components, and carry features through validation, rollout, and production operation. Your work will help ensure that streaming, sampling, tool use, structured outputs, multimodal inputs, and model configuration behave correctly and consistently.

You will work closely with model enablement, compiler, runtime, cloud infrastructure, product, and customer-facing teams, as well as customers directly. This is a hands-on individual-contributor role with opportunities to lead small project teams, mentor engineers, and improve the quality and reliability of production inference software.

Responsibilities

Own features end to end. Design, implement, test, and operate features for chat completions, text generation, streaming, model configuration, tool calling, structured outputs, multimodal inputs, and emerging inference capabilities.

Lead multi-component delivery. Write clear design documents, evaluate technical tradeoffs, break projects into deliverable milestones, and coordinate implementation with a small group of engineers and partner teams.

Deliver consistent API behavior. Implement clear request and response semantics across GPU prefill, Cerebras decode, and other inference backends. Maintain compatibility with widely adopted inference interfaces and evolve owned APIs through validation, versioning, and deprecation best practices.

Enable new models and capabilities. Integrate foundation models, tokenizers, chat templates, generation configuration, sampling methods, and model-specific features into the serving platform.

Integrate serving components. Extend inference services and their integration with frameworks and runtimes such as vLLM, PyTorch, Hugging Face libraries, LLGuidance, and Cerebras runtime components.

Support disaggregated inference. Implement routing, state-transfer integration, error handling, retries, cancellation, and request lifecycle management to coordinate GPU prefill with Cerebras decode.

Deliver measurable performance improvements. Diagnose bottlenecks and improve time to first token, streaming latency, throughput, and resource efficiency through changes to tokenization, serialization, batching, scheduling, and communication.

Own correctness and release quality. Build conformance tests, model-validation suites, numerical comparisons, integration tests, and performance benchmarks that catch regressions in owned features and support safe releases.

Strengthen production reliability. Improve service metrics, tracing, logging, alerts, and diagnostic tools. Investigate production incidents, resolve root causes, and follow through on improvements to resilience and incident response.

Improve customer and developer experience. Partner with product, support, and solutions teams to understand user needs and make practical tradeoffs. Improve configuration, documentation, examples, and debugging workflows.

Raise the engineering quality bar. Provide thoughtful design and code reviews, mentor less-experienced engineers, share domain knowledge, and proactively remove delivery roadblocks.

Minimum Qualifications

5+ years of software engineering experience, including independent ownership of production services, distributed systems, or substantial software components.

Strong programming ability in Python and proficiency in Go, C++, Rust, or another language used to build production services.

Experience designing and delivering features that span multiple components, including documenting designs, evaluating tradeoffs, and coordinating implementation with other engineers.

Experience building and evolving production APIs, with sound practices for validation, error handling, compatibility, and testing. Familiarity with REST, gRPC, or streaming protocols.

Experience integrating software across service, framework, runtime, or infrastructure boundaries.

Experience operating services on Linux using containers, Kubernetes or comparable orchestration systems, and CI/CD.

Ability to diagnose correctness, reliability, and performance issues across distributed components and deliver measurable improvements.

Strong communication and collaboration skills, including experience leading technical delivery for a small project and supporting other engineers through reviews or mentorship.

Ability to turn ambiguous requirements into maintainable software while balancing customer needs, delivery timelines, and operational quality.

Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related discipline, or equivalent practical experience.

Preferred Qualifications

Experience building or operating production ML or LLM inference APIs, including OpenAI-compatible interfaces.

Experience extending or contributing to vLLM, SGLang, PyTorch, Hugging Face Transformers, Triton, TensorRT-LLM, or another ML systems project.

Understanding of tokenization, chat templates, generation configuration, logits processing, stopping criteria, tool calling, structured generation, or constrained decoding.

Experience with disaggregated prefill/decode architectures, KV-cache transfer, prefix caching, chunked prefill, or inference request scheduling.

Experience building API conformance, model-quality, numerical-comparison, determinism, or performance-regression test systems.

Experience with multi-model or multi-tenant serving, including routing, admission control, quotas, rate limiting, or capacity-aware scheduling.

Experience developing performance-sensitive or highly concurrent services in Go, C++, Rust, or a similar language.

Familiarity with GPU inference, AMD Instinct accelerators, ROCm, CUDA, collective communication, or multi-node model serving.

Familiarity with reduced-precision inference and quantization formats such as BF16, FP8, FP4, INT8, or INT4.

Experience building SDKs, developer tools, configuration systems, or self-service ML workflows, or collaborating directly with customers and open-source communities.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Apply on jobs.ashbyhq.com About employer

More about this job

Responsibilities

The Senior Software Engineer at Cerebras Systems will design, build and operate inference API features, lead projects across several engineers, and improve speed and reliability of AI model serving.

Requirements

Candidates need 5+ years of software engineering experience, strong Python and a production language such as Go, C++ or Rust, and experience building production APIs and operating services on Linux with containers and Kubernetes.

Skills

Python
Go
C++
Rust
vLLM
PyTorch
Hugging Face Transformers
LLGuidance
Triton
TensorRT-LLM
SGLang
REST
gRPC
Streaming protocols
Kubernetes
Docker
Linux
CI/CD
GPU inference
CUDA
ROCm
Distributed systems
Tokenization
Chat templates
Constrained decoding

Keywords

Senior Software Engineer
ML API
AI inference
LLM inference
chat completions
streaming
tool calling
structured outputs
multimodal inputs
vLLM
PyTorch
Hugging Face
Python
Go
C++
Rust
Kubernetes
Docker
CI/CD
distributed systems

Seniority

Senior

Tools

Kubernetes
vLLM
PyTorch
Hugging Face Transformers
LLGuidance
CUDA

Languages

English

Fields of study

Computer Science
Computer Engineering
Electrical Engineering

Report this job

Work requirements

Jobs in Canada