Find work in Canada.

324,289 jobs across our Canadian network. How we count

Jobs in Canada

Email me new jobs Save this search

Added 6 days ago
Lead Data Engineer - AI & Machine Learning
RBC
Toronto, ON
Full-time
Support teams by applying and growing foundational knowledge in Generative AI and LLMs
Added 6 days ago
AI Engineer
GEI Consultants, Inc.
Kitchener, ON
Full-time
The AI Engineer is responsible for the development of AI solutions, typically leveraging pretrained models and copilots, to support GEI’s priority digital and AI initiatives. This role…
Added 6 days ago
Lab Technician
Ecolab Inc.
Calgary, AB
Full-time
Assemble prototypes using off the shelf, pre-designed and custom-made parts based on the engineer’s specifications. This can include sketch-level design, building or locally sourcing custom…
Added 6 days ago
Principal Software Development Engineer - AI Platform
Workday
Vancouver, BC · Canada, BC, Vancouver
Full-time
As a Principal Software Development Engineer for Machine Learning, you will be a team leader, working closely with other engineers and ML researchers to build and deploy robust, scalable AI…
Added 6 days ago
Senior Advanced Quality Engineer
Ecolab
Calgary, AB · CAN-Calgary Office Quarry Park
Full-time
We are seeking a talented Senior Advance Quality Engineer to join our Product Quality team, responsible for ensuring product quality during the development and launch phases. This role…
Added 6 days ago
Senior Data Engineer
Capgemini
Vancouver, BC
Added 6 days ago
Data Operations Engineer AI - Co-op Student (Winter 2027)
Rodan Energy Solutions Inc.
Mississauga, ON
Internship
Exposure to AI/ML concepts, generative AI tools, agentic AI, prompt engineering, RAG/knowledge-search patterns, or automation tooling.
Added 6 days ago
Staff Platform Engineer - Materia AI
Thomson Reuters
Toronto, ON
Full-time
As a Platform Engineer, you will contribute to leading the design, development, and evolution of our next-generation cloud-native platforms. You will contribute to technical strategy,…
Added 6 days ago
Data Operations Engineer AI - Co-op Student (Winter 2027)
Rodan Energy Solutions Inc.
Mississauga, ON
Internship
Exposure to AI/ML concepts, generative AI tools, agentic AI, prompt engineering, RAG/knowledge-search patterns, or automation tooling.
Added 7 days ago
Lab Technician
Ecolab
Calgary, AB · CAN-Calgary Office Liquid Lab
Full-time
Assemble prototypes using off the shelf, pre-designed and custom-made parts based on the engineer’s specifications. This can include sketch-level design, building or locally sourcing custom…
Added 7 days ago
Staff Software Engineer, Qualcomm AI Runtime
Qualcomm
Markham, ON
Full-time
Staff Software Engineer – Qualcomm AI Runtime
Added 7 days ago
Senior AI Engineer
CI Financial
Toronto, ON
Full-time
CI Financial is seeking an experienced and technically strong Senior AI Engineer to join our Data, AI & Analytics (DNA) team. This role focuses on the applied use of Generative AI and…
Added 7 days ago
Generative AI Cloud Operations Engineer - Evinova
Evinova
Mississauga, ON
Full-time
As a Generative AI Cloud Operations Engineer for clinical trial design, planning, and operational optimization on our team, you will lead the development and management of AI operations…
Added 7 days ago
Solutions Architect
Tundra Technical Solutions
Toronto, ON
$130,000 to $145,000 CAD / year
Full-time
…instrumental in driving secure, compliant, and high-impact enterprise generative AI adoption through…
Added 7 days ago
AI Architect, Manager
Avanade
Toronto, ON
Full-time
LLM solution architecture & solution development (Generative AI / Azure OpenAI)
Added 7 days ago
Generative AI Cloud Operations Engineer - Evinova
AstraZeneca
Mississauga, ON · Canada - Mississauga
Full-time
As a Generative AI Cloud Operations Engineer for clinical trial design, planning, and operational optimization on our team, you will lead the development and management of AI operations…
Added 8 days ago
Artificial Intelligence Engineer
Zown
Toronto, ON
Full-time
We are looking for an AI Software Engineer to design, build, and scale intelligent software systems that power our products. This role sits at the intersection of artificial intelligence…
Added 9 days ago
Senior L3 AI Engineer
Tata Consultancy Services
Montreal, QC
Full-time
We are seeking a Senior Level 3 AI Engineer to act as the first point of call for engineering issues across the firm’s end user AI products - Microsoft Copilot, OpenAI ChatGPT, Anthropic…
Added 9 days ago
Solution Architect, Google Workspace & Gemini AI
Tundra Technical Solutions
Toronto, ON
$130,000 to $145,000 CAD / year
Full-time
…instrumental in driving secure, compliant, and high-impact enterprise generative AI adoption through…
Added 12 days ago
Associate or Vice President Full Stack Engineer
BMO
Toronto, ON · FCP
We are seeking an exceptional Full Stack Engineer to join our Data Cognition Team at BMO Capital Markets. In this pivotal role, you will architect, develop, and implement innovative…
Added 2 months ago
Staff Developer, Intelligent Implementation Workspace
Dayforce
Canada
…hardest system-level problems, and raise the bar for every engineer around you. You will help define the engineering foundations of an AI-native product from the ground…
Added 9 days ago
Cloud, Automation & AI Engineer - Senior Consultant
Deloitte
Toronto, ON
Full-time
As a Cloud, Automation & AI Infrastructure Engineer, Senior Consultant, you will play a key role in designing, implementing, and modernizing cloud and AI-enabled technology platforms that…
Added 9 days ago
Engineering Manager, Forward Deployed Engineering (LLM)
Baseten
Toronto, ON
$260,000 to $380,000 USD / year
Full-time
…teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production…
Added 10 days ago
Sr. Software Dev Engineer, Amazon Customer Service
Amazon
Toronto, ON
The Contact Handling Experience team is seeking a innovative Sr. Software Development Engineer to lead technical strategy and support the team’s growth through mentorship.
Added 9 days ago
Applied AI Engineer
Hygiena
Mississauga, ON
Full-time
With rapid growth comes opportunity. We are looking for an Applied AI Engineer (LLM Applications Engineer) to join our team onsite in our Mississauga, Ontario Canada office! This is a…

Baseten

Engineering Manager, Forward Deployed Engineering (LLM)

Toronto, ON, Canada

Pay: $260,000 to $380,000 USD / year
Job type: Full-time
Apply by: Oct 18, 2026
Experience: 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
Posting language: English
Posted: Sep 18, 2026

Apply About employer

Applications open in a new tab.

Original job description

About Baseten

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As an Engineering Manager (Player & Coach), you will lead and mentor a team of Forward Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads for Baseten customers. Applying both hands-on technical ownership and managerial leadership, you will guide your team through the processes of designing, deploying, and managing high performance, low latency AI applications on Baseten’s platform. FDE at Baseten is not a sales function – we are a mix of engineering, product, and customer architects who contribute to the core Baseten codebase, drive large portions of our feature roadmap, and execute on complicated customer engagements.

You will also partner with product, infrastructure, and other customer engineering teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production environments.

EXAMPLE INITIATIVES

Take a look at these blog posts written by members of our Forward Deployed Engineering team:

Forward Deployed Engineering on the frontier of AI
The fastest, most accurate Whisper transcription
Deploy production-ready model servers from Docker images
Deploy custom ComfyUI workflows as APIs

Responsibilities

Leadership & Team Management

Lead, mentor, and grow a team of Forward Deployed Engineers, providing guidance on technical direction, project execution, and professional development.
Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
Player-coach – While much of this role will be leading the team, you will also be expected to be a key driver on strategic product initiatives and customer engagements. The best managers derive credibility from being able to be hands-on when needed.

Technical Ownership

Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.
Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.
Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.
Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution.

Requirements

Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, Hugging Face, Ray Serve).
Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
Excellent communication and collaboration skills - able to lead cross-functional efforts and drive outcomes in ambiguous, fast-paced environments.

NICE TO HAVE

Experience leading customer-facing engineering teams or working directly with enterprise partners.
Deep understanding of GPU infrastructure, distributed inference, or model compression techniques.

Benefits

Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $260K - $380K

Apply About employer

More about this job

Responsibilities

Lead and mentor a team of Forward Deployed Engineers to build and optimize LLM inference workloads for customers. Act as a player-coach by driving strategic product initiatives and designing end-to-end AI solutions on the Baseten platform.

Requirements

Requires a degree in Computer Science or Engineering with 4+ years of software engineering experience and at least 1 year in leadership. Must have strong Python skills and proven experience with LLM serving frameworks and production ML systems.

Skills

Engineering Management
Python
LLM Inference Optimization
MLOps
vLLM
TensorRT
Triton
Hugging Face
Ray Serve
GPU Infrastructure
Distributed Inference
Model Compression
Project Management
Product Management
Technical Leadership
Customer Architecture

Benefits

Competitive compensation
Equity
Medical insurance
Dental insurance
Vision insurance
Flexible PTO
Winter Break
Paid parental leave
Fertility and family-building stipend
401(k)

Visa sponsorship

Not detected in the job text

Keywords

LLM
Generative AI
Inference
Python
vLLM
TensorRT
Triton
Hugging Face
Ray Serve
GPU
Distributed Inference
Model Compression
MLOps
Docker
ComfyUI
Whisper
Observability
Profiling
Software Engineering
Forward Deployed Engineering
AI Infrastructure
Production ML
API
PRD
PoC

Report this job