Find work in Canada.

545,929 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 17 hours ago
R|
Programmer
RI-MUHC | Research Institute of the MUHC | #rimuhc
Montreal, QC
- Full-time
…arm of the McGill University Health Centre (MUHC) affiliated with the Faculty of Medicine at McGill University. The RI-MUHC is supported in part by the Fonds de recherche du Québec - Santé…
Added 18 hours ago
B
Software Engineer - GPU Networking & Distributed Systems
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
You are fluent in C++ or Python, with the ability to bridge the gap between high-level logic and hardware. You have a deep understanding of the memory hierarchy in modern NVIDIA…
Added 18 hours ago
B
Software Engineer - Infrastructure
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Software Engineer - Voice AI (Inference Runtime)
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Software Engineer - Dedicated Inference
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Software Engineer - Model Performance Systems
Baseten
Montreal, QC
- $165,000 to $330,000 USD / year
- Full-time
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
Added 18 hours ago
B
Software Engineer - Infrastructure
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Software Engineer - Dedicated Inference
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Forward Deployed Engineer
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
…general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML…
Added 18 hours ago
B
Software Engineer - GPU Networking & Distributed Systems
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
You are fluent in C++ or Python, with the ability to bridge the gap between high-level logic and hardware. You have a deep understanding of the memory hierarchy in modern NVIDIA…
Added 18 hours ago
B
Software Engineer - Voice AI (Inference Runtime)
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
…applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing…
Added 18 hours ago
B
Software Engineer - Model Performance Systems
Baseten
Toronto, ON
- $165,000 to $330,000 USD / year
- Full-time
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
Added 18 hours ago
Sr. Network Designer
Rogers Communications
Brampton, ON · Toronto, ON
Our Technology team wakes up every day with one goal in mind - connecting Canadians to the people and things that matter most. Together, we are proud to support 30 million Canadians each…
Added 19 hours ago
JR
Applied Machine Learning Scientist
Jump! Recruiters
Toronto, ON · Greater Toronto Area, Canada
- Full-time
Strong programming proficiency in Python and R, with familiarity with additional languages such as Java or C++.
Added 20 hours ago
LI
Software Developer
Lotus IT Solutions
Toronto, ON
- Contract
…Delivery and Procurement) is seeking an Intermediate Software Developer with a data science focus to support platform initiatives and the execution of AI/ML use cases across government…
Added 20 hours ago
E
AI DevOps Specialist (AI Enablement & Secure DevOps)
Experis
Canada
- Contract
● Local Code Integration: Ensure developer command-line interfaces and local development terminals (such as Claude Code, VS Code, and GitKraken) seamlessly communicate with cloud model…
Added 21 hours ago
R
Network Operations Analyst
RBC
Toronto, ON
- Full-time
Scripting and automation experience, ideally with Python
Added 21 hours ago
UC
AI Developer
UniSysTech Consulting
Toronto, ON · Greater Toronto and Hamilton Area, ON
- Other
We are seeking an experienced AI Developer (Mid to Senior Level) to lead the design, development, and deployment of enterprise-grade Artificial Intelligence and Machine Learning solutions.…
Added 21 hours ago
H
Senior WMS Implementation Engineer
Hays
Canada
- $95 to $100 CAD / hour
- Contract
Duration: 12 Months contract with possibility of extension
Added 21 hours ago
W
Machine Learning Scientist III - Customer Service AI
Wayfair
Toronto, ON
- $211,914 to $225,158.5 CAD / year
- Full-time
Software Engineering & Infrastructure: Expert-level software development skills in Python, with clean production code standards, asynchronous programming, containerization (Docker,…
Added 22 hours ago
N
Software Engineer 2 - Kubernetes Backend and Platform Engineering
Nutanix
Vancouver, BC
- $103,000 to $155,000 CAD / year
- Full-time
…NKP delivers all the functionality necessary in production with a dramatically lowered TCO. NKP provides simplified Kubernetes operations, seamless application mobility, and integrated…
Added 1 day ago
A
Software Engineer - Factory Apps - Intern
Altera
Toronto, ON
- Full-time
Experience with Python or scripting for automation, testing, or data analysis.
Added 1 day ago
Senior Data Scientist
Helcim Inc
Calgary, AB
…from initial ideation and complex modeling to collaborating with our Data Platform team on deployment and…
Added 1 day ago
C
Customer Success Manager, Public Sector & Defence
Cohere
Ottawa, ON
- $150,000 to $215,000 USD / year
- Full-time
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Added 1 day ago
Senior Forward Deployed AI Engineer
Bell
Mississauga, ON
Strong software engineering foundation, including Python, APIs, and integration with production enterprise systems.

Baseten

Software Engineer - Model Performance Systems

Montreal, QC, Canada

$165,000 to $330,000 USD / year · Full-time

Apply About employer

Applications open in a new tab.

Job details

Pay: $165,000 to $330,000 USD / year
Job type: Full-time
Apply by: Nov 28, 2026
Posting language: English
Posted: Oct 30, 2026

Original job description

About Baseten

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

We are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure; you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.

Responsibilities

Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse, disaggregated serving).
DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
Optimization Automation: Build tools to find the "Pareto frontier" - identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.

Requirements

This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:

A Love for Systems & Hardware: You aren’t just interested in the AI; you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.

WHY THIS ROLE

Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.

Benefits

Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $165K - $330K

Apply About employer

More about this job

Responsibilities

Build and maintain benchmarking, profiling, monitoring, and automation tools to evaluate LLM quality and inference performance across models and workloads. Improve GPU-enabled development environments, automate performance testing and release workflows, and identify optimal configurations balancing latency, cost, and quality.

Requirements

This mid-to-senior role calls for strong systems and hardware knowledge, an automation mindset, mathematical curiosity about Transformers, and familiarity with Python; C++ experience is beneficial. Candidates should be able to lead cross-team technical efforts, navigate ambiguity, communicate effectively, and mentor engineers.

Skills

Python
C++
High-Performance Computing
Large Language Model Inference
GPU Systems
Benchmarking
Performance Profiling
System Optimization
Automation
Fuzzy Testing
CI/CD
Monitoring and Observability
Transformer Mathematics
InfiniBand
Cross-Team Communication
Technical Leadership

Benefits

Competitive Compensation
Equity
Medical Insurance
Dental Insurance
Vision Insurance
Flexible Paid Time Off
Company-Wide Winter Break
Paid Parental Leave
Fertility and Family-Building Stipend
401(k)

Visa sponsorship

Not detected in the job text

Keywords

High-Performance Computing
Large Language Models
LLM Inference
Python
C++
NVIDIA
GPU
GPU Memory
InfiniBand
GSM8K
MMLU
InferenceMAX
genai-bench
PyTorch Profiler
NVIDIA Nsight Systems
py-spy
Benchmarking
Model Evaluation
Performance Profiling
Disaggregated Serving
KV Cache Reuse
Long-Context Windows
CI/CD
Performance Regression Testing
Observability
Fuzzy Testing
Transformer Mathematics
FLOPs
Latency-Cost-Quality Optimization
GPU Orchestration

Report this job