Jobs in Canada

Group jobs by employerEmail me new jobs Save this search

Added 12 days ago
B
Software Engineer - GPU Networking & Distributed Systems
Baseten
Toronto, ON
- $165,000 to $330,000 CAD / year
- Full-time
At Baseten, we are building the global operating system for distributed, heterogeneous AI hardware. We believe that as LLM and multi-modal workloads scale, the network is the computer. We…
Added 12 days ago
B
Software Engineer - Voice AI (Inference Runtime)
Baseten
Toronto, ON
- $165,000 to $330,000 CAD / year
- Full-time
Voice is becoming the internet’s next interface, but a production-grade Voice AI system is "hard to build". You’ll join a small founding team of Baseten Voice AI, focused on bringing…
Added 12 days ago
B
Software Engineer - Model Performance Systems
Baseten
Toronto, ON
- $165,000 to $330,000 CAD / year
- Full-time
System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
Added 12 days ago
A
Technical Documentation & BOM Specialist
Actalent
Ottawa, ON
- $30 to $50 CAD / hour
- Contract
…focused on next-generation high-speed networking technology. The engineer will be responsible for inspecting, documenting, and managing components in test stations, ensuring accurate bills…
Added 12 days ago
C
Transmission Lines Engineer-In-Training (Civil)
CIMA+
AB · Edmonton, AB
- $71,200 to $97,900 CAD / year
- Full-time
…what’s expected of us to meet the challenges of tomorrow and engineer a better…
Added 12 days ago
MS
Senior Engineer II, Proxy
Menlo Security Inc.
Canada
- Full-time
Agencies must have a valid services agreement executed and must have been assigned by the Talent team to a specific requisition
Added 12 days ago
T
Quality Assurance Engineer
Trulioo
Vancouver, BC
- Full-time
Our offices support a hybrid model and staff typically work three days per week at a hub location · This is a full-time, permanent position based out of our Vancouver office, working on a hybrid model (3 days per week in-office)
Added 12 days ago
Enterprise Account Executive - Toronto
Novisto
Toronto, ON
Prepare effective presentations with support from the Sales Engineer.
Added 12 days ago
IH
power engineer
Interior Health Authority
Williams Lake, BC
- Full-time
Assist in locating and isolating system problems
Added 12 days ago
PE
Senior Mechanical Engineer
Polar Engineering
Vancouver, BC
- Full-time
Senior Mechanical Engineer - Team Lead, Vancouver
Added 12 days ago
LH
Lead Electrical Engineer (P.Eng)– MV/HV
LeadingEdge HR Solutions
Halifax, NS
- Full-time
Our client is seeking an experienced and commercially minded Lead Electrical Engineer / Subject Matter Expert (SME) to lead the development, design, and execution of land-based power…
Added 12 days ago
A
Field Engineer
Airswift
Prince Rupert, BC
- Contract
Our client, a major Oil and Gas client, is looking for a Field Engineer to join their team in Prince Rupert, BC on a 1-year contract (fly in/fly out)
Added 12 days ago
ES
Opérateur(trice) - Centre d'opération à distance / Operator - Remote Operations Center
Equans Services Canada & US
Montreal, QC
- Full-time
The schedule follows a continental model (seven (7) 12-hour shifts over a two (2) week period), rotating between day and night shifts
Added 12 days ago
WI
Lead Mechanical Engineer, Resources
WSP in Canada
Winnipeg, MB
- Full-time
Shape the World Around You – As a Lead Mechanical Engineer, you will lead the delivery of complex mechanical and piping engineering for mining and industrial projects across Canada. From…
Added 12 days ago
AI
Intermediate Mechanical Design Engineer
Aversan Inc.
Cambridge, ON
- $76,000 to $105,000 CAD / year
- Full-time
Assist fabricators, machinists, toolmakers, and electricians in debugging, integration, and system completion
Added 12 days ago
I
AI Platform Engineer
Infoya
Toronto, ON
- Full-time
Work Arrangement: Hybrid (2 days in office)
Added 12 days ago
WN
Senior Mechanical Engineer
W3 North America
Toronto, ON · Greater Toronto and Hamilton Area, ON
- $140,000 to $160,000 CAD / year
- Full-time
…harvesting systems. They’re looking for a Senior Mechanical Engineer who wants to take the next step into leading a small engineering…
Added 12 days ago
SC
OCS Specialist/ Engineer (Overhead Catenary System)
SYSTRA Canada
Toronto, ON
- Full-time
This is an engineering role responsible for overhead contact system (OCS) design and delivery for rail and transit infrastructure projects. The position operates within multidisciplinary…
Added 12 days ago
NG
Process Engineer / Process Improver
NSG Group
Collingwood, ON
- Full-time
The Process Engineer is a key technical leader responsible for the optimization, standardization, and continuous improvement of manufacturing processes of a high-performance, 24/7…
Added 12 days ago
ST
Manufacturing Engineer
Sinclair Technologies
Aurora, ON
- $50,000 to $80,000 CAD / year
- Full-time
The Manufacturing Engineer is responsible for developing, implementing, supporting, and continuously improving manufacturing processes for RF antennas, filters, combiners, and related…
Added 12 days ago
HT
Product Development Engineer
Husky Technologies
Bolton, ON
- Full-time
Our Development Engineering team is looking to hire an experienced Product Development Engineer. The successful candidate will lead the technical development of packaging products working…
Added 12 days ago
S
Senior Opto-Mechanical Design Engineer
Sanmina
Ottawa, ON
- Full-time
The Senior Opto-Mechanical Design Engineer, as part of the larger product solutions development team, provides mechanical design support of product development, NPI, and manufacturing of a…
Added 12 days ago
IM
Audio Visual/Videoconferencing Installation Field Engineer
Integrated Media Technologies | IMT
Field, BC
- Full-time
Good computer skills; must have some experience with Visio, CAD, Word & Excel · Must possess a valid Driver’s License; have and continue to maintain a safe driving record
Added 12 days ago
C
Transmission Lines Engineer-In-Training (Civil)
CIMA+
Calgary, AB
- $71,200 to $97,900 CAD / year
- Full-time
…what’s expected of us to meet the challenges of tomorrow and engineer a better…
Added 12 days ago
E
AI DevOps Specialist (AI Enablement & Secure DevOps)
Experis
Canada
- Contract
● 4+ years of hands-on experience in DevOps, Cloud Engineering, or System Administration, with at least 2 years focused specifically on AI/MLOps platform delivery.

Baseten

Software Engineer - Model Performance Systems

Toronto, ON, Canada

$165,000 to $330,000 CAD / year · Full-time

Apply on LinkedIn About employer

Applications open in a new tab.

Job details

Pay: $165,000 to $330,000 CAD / year
Job type: Full-time
Apply by: Nov 28, 2026
Posting language: English
Posted: Oct 30, 2026

Original job description

About Baseten

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

We are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure; you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.

Responsibilities

Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse, disaggregated serving).
DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
Optimization Automation: Build tools to find the "Pareto frontier" - identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.

Requirements

This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:

A Love for Systems & Hardware: You aren’t just interested in the AI; you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.

WHY THIS ROLE

Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.

Benefits

Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $165K - $330K

Apply on LinkedIn About employer

More about this job

Responsibilities

Build and maintain benchmarking, profiling, monitoring, and automation tools to evaluate LLM quality and inference performance across models and workloads. Improve GPU-enabled development environments, automate performance testing and release workflows, and identify optimal configurations balancing latency, cost, and quality.

Requirements

This mid-to-senior role calls for strong systems and hardware knowledge, including GPU memory, cluster networking, and how Transformer computations translate into FLOPs and memory needs. Candidates should be familiar with Python, eager to learn the NVIDIA software stack, and able to lead cross-team work, navigate ambiguity, communicate effectively, and mentor engineers; C++ familiarity is beneficial.

Skills

Python
C++
High-Performance Computing
GPU Systems
LLM Inference
Benchmarking
Performance Profiling
System Optimization
Automation
CI/CD
Monitoring And Observability
Transformer Mathematics
Cross-Team Communication
Technical Leadership
Mentoring

Benefits

Competitive Compensation
Equity
Medical Insurance
Dental Insurance
Vision Insurance
Flexible Paid Time Off
Company-Wide Winter Break
Paid Parental Leave
Fertility And Family-Building Stipend
401(k)
Learning And Networking Opportunities

Visa sponsorship

Not detected in the job text

Keywords

Python
C++
High-Performance Computing
Large Language Models
LLM Inference
GPU
NVIDIA Software Stack
InfiniBand
GSM8K
MMLU
InferenceMAX
Genai-Bench
PyTorch Profiler
NVIDIA Nsight Systems
Py-Spy
Benchmarking
Model Evaluation
Performance Profiling
KV Cache Reuse
Disaggregated Serving
Long-Context Windows
GPU-Enabled Development Environments
GitHub Codespaces
Monitoring And Observability
CI/CD
Performance Regression Testing
Fuzzy Testing
Transformer Mathematics
Latency-Cost-Quality Optimization
Model Runtime

Report this job

Work requirements

Jobs in Canada