Jobs in Canada

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added 1 month ago
DevOps Engineer - Halifax Canada
NTT DATA Canada, Inc.
Halifax, NS
Join a high-impact DevOps team within a global organization where you'll play a key role in modernizing cloud infrastructure, driving automation, and improving software delivery at scale.…
Added 1 month ago
Senior AI Engineer
Chubb Insurance Company of Canada
Toronto, ON
Cloud-native delivery: containers, Kubernetes (AKS preferred), CI/CD, and production observability.
Added 1 month ago
P
Senior Cloud DevOps Engineer
Procom
Ottawa, ON
- $96,000 to $120,000 CAD / year
Work Mode: Hybrid 3 days per week in the office (Ottawa)
Added 1 month ago
Data Engineering Leadership
Lutra
Montréal, QC · Kitchener, ON · Toronto, ON
Staff Engineer candidates may bring a stronger centre of gravity in backend and API systems or in data processing and platform engineering. For the Lead Engineer search, the client is…
Added 1 month ago
Staff Platform Site Reliability Engineer
Index Exchange
Toronto, ON
Cloud Platform Engineering builds the platform that makes all of this possible. We architect and deliver the foundational infrastructure - Kubernetes clusters, deployment pipelines,…
Added 1 month ago
BT
Azure cloud engineer – ai infrastructure
Blitz TI
Remote, Canada
- $120,000 to $140,000 CAD / year
Hybrid work arrangement with three days per week in the office in downtown Montréal
Added 1 month ago
Machine Learning Engineer (Canada)
Tiger Analytics Inc.
Toronto, ON
Knowledge on any of the cloud-native MLaaS offerings like AWS SageMaker, AzureML, or Google AI platform
Added 1 month ago
Senior DevOps Engineer
ResponsiveAds, Inc.
Vancouver, BC
Deploy and maintain cloud environments, including production and development environments on AWS and Google Cloud.
Added 1 month ago
AWS Devops Engineer
Newrich Network
Toronto, ON
Must have a hands-on experience on setting up Kubernetes platform, deploying microservices and other web applications, and managing secure secrets
Added 1 month ago
OSS Engineer (Canada - Remote)
AXON-Networks
Toronto, ON
The OSS Engineer will design, build and operate the Operations Support Systems (OSS), dashboards, data products and workflow automations that enable Network Operations to support cloud…
Added 1 month ago
Senior Software Developer
Elastic
Canada
…the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to…
Added 1 month ago
Senior Java Developer - Core/Infra - Elasticsearch
Elastic
Canada
…the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to…
Added 1 month ago
Camunda Platform Engineer
Astra North Infoteck Inc.
Toronto, ON
involving Kubernetes, Docker, and cloud platforms like OCP.
Added 1 month ago
Observability Engineer
Astra North Infoteck Inc.
Toronto, ON
Observability Engineer – Kubernetes, Prometheus, Grafana & Cloud Monitoring
Added 1 month ago
Software Engineer – Java, Spring Boot, DevSecOps, Cloud, Platform Modernization
Astra North Infoteck Inc.
Montréal, QC
Software Engineer – Java, Spring Boot, DevSecOps, Cloud, Platform Engineering
Added 1 month ago
Backend Developer – TypeScript/Node.js, NestJS & Kafka
Astra North Infoteck Inc.
Toronto, ON
We are hiring a senior engineer to help deliver the AVA Modernization program| moving a legacy platform to a cloud-native architecture using NX monorepo| NestJS services| event-driven…
Added 1 month ago
Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM
Astra North Infoteck Inc.
Toronto, ON
3–5+ years of hands-on CI/CD, cloud, and platform engineering experience in enterprise environments.
Added 1 month ago
DevOps Engineer – GitHub Enterprise, GitHub Actions & CI/CD
Astra North Infoteck Inc.
Toronto, ON
Set up and validate integrations between GitHub and Jenkins, Artifactory, SonarQube, CDD, Jira, Confluence, AWS, and Kubernetes.
Added 1 month ago
Cloud DevOps Engineer - Azure, Terraform, Kubernetes, CI/CD & Data Platforms
Astra North Infoteck Inc.
Toronto, ON
The successful candidate will demonstrate strong working experience with major cloud platforms such as Azure with the ability to design, deploy, and maintain scalable cloud infrastructure.
Added 1 month ago
Platform Engineer - Kubernetes, GitOps, Flux CD & AI/ML Infrastructure
Astra North Infoteck Inc.
Toronto, ON
We're seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure, e.g. LlamaIndex Cloud and KDB.AI applications on Kubernetes Platform.
Added 1 month ago
Java Backend developer - Java 17, DevSecOps, Kubernetes
Astra North Infoteck Inc.
Montréal, QC
We are seeking a Software Engineer to join a Global Enterprise Technology Team responsible for the development, modernization, security and operational reliability of mission critical…
Added 1 month ago
GCP Infrastructure & Cloud SRE Engineer.
Astra North Infoteck Inc.
Toronto, ON
Build and manage enterprise-scale cloud platforms on Google Cloud Platform (GCP).
Added 1 month ago
RC
Software Dev, Data - Remote
Randstad Canada
Toronto, ON
- $105,000 to $145,000 CAD / year
…move fast without accumulating operational debt. This role is platform-first: the output is a foundation that makes the rest of the Data team faster, more reliable, and better equipped to…
Added 1 month ago
RC
Senior Python Engineer
Randstad Canada
Toronto, ON
- $92.92 to $107.21 CAD / hour
Location & Work Arrangement: Toronto, ON (Hybrid: 4 days per week on-site at the corporate office, 1 day work from home)
Added 1 month ago
RC
Senior Software Engineer- 1745
Randstad Canada
ON
- $47.76 to $54.64 CAD / hour
As a senior software engineer, you will bridge the gap between software development, serverless automation, and cloud data governance. Operating within a flexible hybrid work model, you…

Cerebras Systems

Staff GPU Inference SDET

Toronto, ON, Canada

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Experience: 8+ years of software engineering experience as an SDET, Infrastructure Quality Lead, or Systems Test Engineer.
Posting language: English
Posted: Sep 9, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the Role
As a Staff GPU Inference SDET, you will be the founding quality, reliability, and validation lead for a new GPU Inference Development team. Working closely with engineering leads and cross-functional systems infrastructure teams, you will design, build, and scale the end-to-end release qualification and automated test ecosystem for our GPU inference stack and rack-scale accelerated compute fleets. In this high-impact role, you will be responsible for building automated test suites to validate multi-node GPU cluster bring-up, verifying prefill worker optimizations, testing open-source and custom serving engines, and ensuring numerical correctness and performance stability under real-world streaming workloads. You will be the primary technical anchor ensuring production-grade reliability, fault isolation, and peak inference performance across accelerated GPU infrastructure.

WHAT YOU’LL DO

Build GPU Release Qualification Systems:

Design and implement automated test automation frameworks, regression gates, and release qualification pipelines for the complete GPU inference stack - spanning custom API services, model-serving workers, container runtimes, serving engines, driver stacks, and firmware.

Inference Serving & Workload Validation:

Benchmark and stress-test distributed LLM serving frameworks, focusing on prefill vs. decode worker performance, continuous batching, prefix caching, KV-cache efficiency, and tensor/expert parallelism.

Performance & Performance Modeling Verification:

Build automated workload replay and benchmarking tools to validate GPU performance models. Track critical serving metrics including Time-to-First-Token (TTFT), Inter-Token Latency (ITL), request throughput, tail latency (P99), and capacity efficiency.

Numerical Correctness & Quality Gates:

Build validation infrastructure to ensure model accuracy, precision stability (FP16/FP8/quantization), determinism, and output correctness across software updates, kernel fusions, and hardware revisions.

Fault Injection & Fleet Resilience:

Engineer chaos engineering and fault-injection suites to simulate node failures, inter-node network degradation, GPU memory leaks, driver/firmware mismatches, and automated recovery paths for multi-node GPU clusters.

Observability & CI/CD Integration:

Integrate automated test pipelines with telemetry tools (e.g., Prometheus, Grafana) to turn one-off investigations into repeatable engineering gates and continuous performance monitoring.

REQUIREMENTS:

8+ years of software engineering experience as an SDET, Infrastructure Quality Lead, or Systems Test Engineer.

GPU & Cluster Infrastructure Expertise:

Hands-on experience bringing up, provisioning, and validating multi-node GPU clusters (NVIDIA or AMD ecosystem) across public cloud infrastructure or enterprise data center environments.

Inference Stack Knowledge:

Deep understanding of LLM serving engines and distributed runtimes, including prefill vs. decode disaggregation, KV-cache management, and dynamic batching.

Automation & Scripting:

Expert-level Python programming skills with extensive experience designing custom test automation frameworks, diagnostic tooling, and CI/CD integration.

Orchestration & Networking:

Strong proficiency with container orchestration tools (e.g., Kubernetes, Slurm, Ray) and high-performance cluster interconnects (e.g., InfiniBand, RoCE, NCCL).

Failure Analysis & Debugging:

Proven background in root-cause analysis across software/hardware boundaries, stress testing, and node failure simulation in distributed systems.

NICE TO HAVES:

Direct experience with either AMD (ROCm / HIP) or NVIDIA software stacks.
Experience building workload replay tools, ML evaluation pipelines, or MLPerf Inference benchmark suites.
Familiarity with low-level kernel profiling tools (PyTorch Profiler, NVTX, ROCm profilers) or C++

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Apply on jobs.ashbyhq.com About employer

More about this job

Responsibilities

The Staff GPU Inference SDET will build automated test suites and release gates that check GPU clusters, LLM serving engines and model accuracy. The role also designs fault-injection tests and connects performance monitoring to CI/CD pipelines.

Requirements

Cerebras Systems needs 8+ years of software test or infrastructure quality experience. Candidates must have hands-on GPU cluster bring-up experience, knowledge of LLM serving engines, expert Python and strong Kubernetes, Slurm or Ray skills.

Skills

Python
CI/CD integration
GPU cluster provisioning
NVIDIA GPU stack
AMD ROCm/HIP
Kubernetes
Slurm
Ray
InfiniBand
RoCE
NCCL
LLM serving engines
prefill and decode disaggregation
KV-cache management
dynamic batching
performance benchmarking
fault injection
chaos engineering
root-cause analysis
Prometheus
Grafana
PyTorch Profiler
NVTX
C++

Keywords

SDET
GPU inference
LLM inference
Python
test automation
release qualification
CI/CD
Kubernetes
Slurm
Ray
InfiniBand
RoCE
NCCL
NVIDIA
AMD ROCm
HIP
PyTorch Profiler
NVTX
Prometheus
Grafana

Seniority

senior

Department

software_development

Tools

Python
Kubernetes
Slurm
Ray
Prometheus
Grafana
PyTorch Profiler
NVTX
InfiniBand
NCCL

Languages

English

Report this job

Work requirements

Jobs in Canada