Find work in Canada.

485,444 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 1 month ago
C
Senior Software Engineer, GPU Infrastructure (HPC)
Cohere
Remote, Canada
- Full-time
- Remote
Strong programming skills: Proficiency in Python (for ML tooling) and Go (for systems engineering), with a preference for open-source contributions over reinventing solutions.
Added 1 month ago
Senior Software Engineer, Storage Infrastructure
Planet
Canada
We're looking for a Senior Software Engineer to help evolve this platform. You'll work across the stack - from object storage and metadata indexing to event notification and disaster…
Added 1 month ago
MS
R&D Biomedical Engineer (On-Site)
Myant Shared Service Corp.
Mississauga, ON
- Full-time
As an R&D Biomedical Engineer, you will work at the intersection of biomedical engineering, electromechanical design, sensing, and healthcare. You will contribute across the full product…
Added 1 month ago
A
Short Term 2027 Data Analyst Intern/Co-Op
AMD
Markham, ON
- $44,500 to $71,000 USD / year
- Full-time
…Analytics, Data Engineering, Computer Engineering, Electrical Engineer, Computer Science or a related…
Added 1 month ago
A
Short Term 2027 Graphics Software Engineering Intern/Co-Op
AMD
Markham, ON
- $44,500 to $71,000 USD / year
- Full-time
There are a wide variety of software engineering opportunities available such as application, kernel, graphics, AI development. As an AMD Software Engineer, you can expect to –
Added 1 month ago
A
Summer 2027 Long Term Graphics Software Engineering Intern/Co-Op
AMD
Markham, ON
- $67,000 USD / year
- Full-time
There are a wide variety of software engineering opportunities available such as application, kernel, graphics, AI development. As an AMD Software Engineer, you can expect to –
Added 1 month ago
AM
Principal Systems Validation Engineer – Data Center GPU System Stress
Advanced Micro Devices, Inc
Vancouver, BC
- Full-time
We are seeking a Principal System Validation Engineer to help drive product-level system and stress testing across AMD's next-generation platforms. In this role you will define and drive…
Added 1 month ago
V
Staff Software Engineer
Verily
Toronto, ON · Waterloo, ON
- Full-time
10+ years experience as a software developer in an industry setting.
Added 1 month ago
H(
Lead Agentic AI Engineer
HOOPP (Healthcare of Ontario Pension Plan)
Toronto, ON
- $86,000 to $131,000 CAD / year
- Full-time
…financial future for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers, architects, security, governance, and business partners to find…
Added 1 month ago
U
Platform Engineer
UST
Montreal, QC
- Full-time
UST is searching for a Platform Engineer to deploy and manage our AI/ML infrastructure, e.g LlamaIndex Cloud and KDB.AI applications on Kubernetes Platform. You'll be responsible for…
Added 2 months ago
TT
Building Automation Technician
Trane Technologies
Montreal, QC
- Full-time
…driving analytics for greater efficiency, your ideas will help engineer solutions for stronger communities and a sustainable…
Added 1 month ago
CF
Senior Observability Engineer
CI Financial
Toronto, ON
- Full-time
We are seeking a Mid-Level Observability Engineer to help build, maintain, and enhance our enterprise monitoring and observability capabilities across cloud and hybrid environments. This…
Added 1 month ago
Principal Engineer, Data Path / Metadata / Performance (StorageGRID)
NetApp, Inc.
Vancouver, BC
…analytics, and exabyte-scale enterprise data. As a Principal Engineer for Datapath / Performance, you will own the architecture and technical direction of the StorageGRID S3 data path and…
Added 2 months ago
Senior, AI & Data Science
Artefact
Montreal, QC
Proficiency in Python (scikit-learn, XGBoost; PyTorch a strong plus) and solid SQL.
Added 1 month ago
RA
Staff Embedded Software Engineer, Virtualization
Rivian and Volkswagen Group Technologies
Remote, Canada
- $137,300 to $181,890 USD / year
- Full-time
- Remote
As a Staff Embedded Software Engineer, you will transform real-world ECU firmware into high-performance virtual devices that run on everyday workstations and cloud servers. Your work closes…
Added 1 month ago
V
Sr Data Engineer, Specialist
Vanguard
Toronto, ON
- Full-time
We are looking for a Sr Data Engineer with in-depth expertise in AWS, Databricks, and modern data
Added 1 month ago
Production Support - SRE
Capgemini
Toronto, ON
Capgemini is looking for a Production support Engineer to work for the Commercial Line of Business. An ideal candidate should be the one that has experience as outlined below:-
Added 1 month ago
C
SVT/PV Engineer 1 - New Grad
Ciena
Ottawa, ON
- Full-time
Contribute to test automation initiatives using Python-based frameworks, Jupyter notebooks, and other software tools to improve test coverage and execution efficiency.
Added 1 month ago
IT Industrial CrossFunction - Full Stack & AI Integration
Amrize
Mississauga, ON · Laval, QC
The Industrial IT Full Stack / Back End & AI Integration Snr. Engineer role is to contribute her/his skills to the development of company Industrial Solutions including AI-powered features…
Added 1 month ago
Senior Software Engineer
Fleet Space Technologies
Toronto, ON
We are looking for a Senior Software Engineer to design and evolve the technical foundation underneath it. You will establish scalable, maintainable architecture across AWS infrastructure,…
Added 1 month ago
EC
Ingénieur(e) en réseaux de puissance / Power Systems Engineer
Eaton Corporation
Brossard, QC
- Full-time
Connaissance de Python, y compris une maîtrise de l'analyse et de la manipulation de données à l'aide de bibliothèques telles que Pandas, NumPy et Matplotlib.
Added 2 months ago
AI & Agentic Engineer, Senior
Artefact
Montreal, QC
Examples: Claude Certified Developer – Foundations (Anthropic), Google Cloud Professional Machine Learning Engineer, Google Cloud Generative AI Leader, Microsoft Azure AI Engineer…
Added 1 month ago
AM
Design Verification Engineer
Advanced Micro Devices, Inc
Vancouver, BC
- Full-time
AMD is seeking an experienced Design Verification Engineer to join our team developing next-generation high-performance computing and semiconductor products. In this role, you will be…
Added 1 month ago
SL
AI Engineer
Sun Life
Toronto, ON · Waterloo, ON · Sun Life Toronto One York
- Full-time
The Canada IT – Platforms and Engineering Domain is looking for an AI Engineer with 3+ years of development experience. You will drive GenAI innovation, implement cutting-edge cloud…
Added 1 month ago
A
Associate Software Engineer (Winter 2027)
AltaML
Calgary, AB · Edmonton, AB · Toronto, ON
- Internship
As an Associate Software Engineer you’ll play a hands-on role in building and scaling our agentic platform - an intelligent, adaptive system designed to automate workflows and power smarter…

Cohere

Senior Software Engineer, GPU Infrastructure (HPC)

Remote, Canada

Remote

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Workplace: Remote
Posting language: English
Posted: Sep 3, 2026

Original job description

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why this team?

The internal infrastructure team is responsible for building world-class infrastructure and tools used to train, evaluate and serve Cohere's foundational models. By joining our team, you will work in close collaboration with AI researchers to support their AI workload needs on the cutting edge, with a strong focus on stability, scalability, and observability. You will be responsible for building and operating superclusters across multiple clouds. Your work will directly accelerate the development of industry-leading AI models that power Cohere's platform North.

Please Note: All of our infrastructure roles require participating in a 24x7 on-call rotation, where you are compensated for your on-call schedule.

As a Staff Software Engineer, you will:

Build and scale ML-optimized HPC infrastructure: Deploy and manage Kubernetes-based GPU/TPU superclusters across multiple clouds, ensuring high throughput and low-latency performance for AI workloads.
Optimize for AI/ML training: Collaborate with cloud providers to fine-tune infrastructure for cost efficiency, reliability, and performance, leveraging technologies like RDMA, NCCL, and high-speed interconnects.
Troubleshoot and resolve complex issues: Proactively identify and resolve infrastructure bottlenecks, performance degradation, and system failures to ensure minimal disruption to AI/ML workflows.
Enable researchers with self-service tools: Design intuitive interfaces and workflows that allow researchers to monitor, debug, and optimize their training jobs independently.
Drive innovation in ML infrastructure: Work closely with AI researchers to understand emerging needs (e.g., JAX, PyTorch, distributed training) and translate them into robust, scalable infrastructure solutions.
Champion best practices: Advocate for observability, automation, and infrastructure-as-code (IaC) across the organization, ensuring systems are maintainable and resilient.
Mentorship and collaboration: Share expertise through code reviews, documentation, and cross-team collaboration, fostering a culture of knowledge transfer and engineering excellence.

You may be a good fit if you have:

Deep expertise in ML/HPC infrastructure: Experience with GPU/TPU clusters, distributed training frameworks (JAX, PyTorch, TensorFlow), and high-performance computing (HPC) environments.
Kubernetes at scale: Proven ability to deploy, manage, and troubleshoot cloud-native Kubernetes clusters for AI workloads.
Strong programming skills: Proficiency in Python (for ML tooling) and Go (for systems engineering), with a preference for open-source contributions over reinventing solutions.
Low-level systems knowledge: Familiarity with Linux internals, RDMA networking, and performance optimization for ML workloads.
Research collaboration experience: A track record of working closely with AI researchers or ML engineers to solve infrastructure challenges.
Self-directed problem-solving: The ability to identify bottlenecks, propose solutions, and drive impact in a fast-paced environment.

Full-Time Employees at Cohere enjoy these Perks:

A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.

6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:

Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.

We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Apply About employer

More about this job

Responsibilities

You will build and scale ML-optimized HPC infrastructure using Kubernetes to support AI model training across multiple clouds. Additionally, you will collaborate with researchers to optimize performance and provide self-service tools for debugging and monitoring training jobs.

Requirements

Candidates must have deep expertise in ML/HPC infrastructure, including experience with GPU/TPU clusters and distributed training frameworks. Proficiency in Python and Go, along with strong knowledge of Linux internals and Kubernetes at scale, is required.

Skills

Kubernetes
GPU infrastructure
HPC
Python
Go
Distributed training
JAX
PyTorch
TensorFlow
RDMA
NCCL
Linux internals
Infrastructure as code
Observability
Cloud computing
System troubleshooting

Benefits

Health insurance
Dental benefits
Mental health budget
RRSP matching
401k
Pension scheme
Parental leave
Arts and culture stipend
Fitness and wellness stipend
Education and learning stipend
Paid vacation
Home office stipend
Lunch stipend

Remote locations

Toronto, Canada
London, United Kingdom
New York City, United States
San Francisco, United States
Montreal, Canada
Paris, France
Berlin, Germany
Seoul, South Korea

Remote locations (standardized)

Berlin, Germany
London, England, United Kingdom
Montreal, Quebec, Canada
New York, New York, United States
Paris, Ile-de-France, France
San Francisco, California, United States
Seoul, South Korea
Toronto, Ontario, Canada

Visa sponsorship

Not detected in the job text

Keywords

Software Engineering
GPU Infrastructure
HPC
Kubernetes
Machine Learning
Artificial Intelligence
Python
Go
Distributed Training
JAX
PyTorch
TensorFlow
RDMA
NCCL
Linux
Infrastructure as Code
Observability
Cloud Computing
Superclusters
System Architecture
Performance Optimization
Automation
Enterprise AI
Foundation Models
Scalability
Reliability
Debugging
Networking
Tech Infrastructure
Engineering Excellence

Report this job