Jobs in Canada

Save this search

Added 2 hours ago
AI Engineer, Entry Level (Canada)
Jobright.ai
Canada
Full-time
…the job search experience. They are seeking an entry-level AI Engineer to build and refine autonomous AI agents, develop sophisticated prompt engineering workflows, and integrate Large…
Added 3 hours ago
IT ENGINEER
Z-Tech Solution Co., Ltd
Engineer, BC
Full-time
Added 6 hours ago
Prompt Engineer - Early Career (Canada)
Jobright.ai
Canada
Full-time
Jobright is your personal AI job search agent transforming the job search process. They are seeking an early-career Prompt Engineer to craft and evaluate prompts that enhance the…
Added 9 hours ago
Founding DevOps/SRE Engineer
Requesty
London, ON
Full-time
…adding telemetry, analytics, load balancing, MCP integrations, prompt management, data loss protection and much more out of the…
Added 1 day ago
AI Engineer, Entry Level (Canada)
Jobright.ai
Canada
Full-time
…the job search experience. They are seeking an entry-level AI Engineer to build and refine autonomous AI agents, develop sophisticated prompt engineering workflows, and integrate Large…
Added 1 day ago
Prompt Engineer - Early Career (Canada)
Jobright.ai
Canada
Full-time
Jobright is your personal AI job search agent transforming the job search process. They are seeking an early-career Prompt Engineer to craft and evaluate prompts that enhance the…
Added 1 day ago
AI Engineer, Entry Level (Canada)
Jobright.ai
Canada
Full-time
…the job search experience. They are seeking an entry-level AI Engineer to build and refine autonomous AI agents, develop sophisticated prompt engineering workflows, and integrate Large…

Requesty

Founding DevOps/SRE Engineer

London, ON, Canada

Job type: Full-time
Apply by: Oct 14, 2026
Experience: You have 5+ years of experience deploying services using Kubernetes:
Posting language: English
Posted: Jul 10, 2026

Apply About employer

Applications open in a new tab.

Original job description

What we are building

We are building the LLM platform that will power tomorrow's AI-first companies.

A single platform that allows any LLM user to integrate, scale, secure and optimize their LLM inference across 200+ providers in a few clicks.

A highly scalable, reliable and secure infra that exposes simple, OpenAI-compatible APIs, that every product or tool can use. The API allows you to access any of the LLM providers, taking care of API compatibility while adding telemetry, analytics, load balancing, MCP integrations, prompt management, data loss protection and much more out of the box.

Why join us

You understand that the best development teams need the best tooling and processes.

You understand how hard it is to manage Kubernetes clusters and self-hosted deployments in different environments.

You understand that how to build security practices into systems in a way that protects the users but doesn't slow them down.

And you are excited to tackle these massive challenges and build an infra product that will be the backbone for the best AI products, and power the next AI coding assistants, agent orchestration systems or any other AI-based solution.

Work directly with the founders to influence the company's direction and make a tangible impact. If you're looking to build your own startup someday or want to thrive in the dynamic environment of a fast-growing company, this is the ideal place to accelerate your impact and growth.

A generous TC package with significant equity.

Our stack

We Running a Pragmatic Micro-service Architecture

Kubernetes
Core LLM gateway in Go
Auxiliary and ML/AI services in Python
Different SQL DBs + Distributed caches

You should expect this list to evolve. And most probably, you will be the one redefining and building it.

What we are looking for

You have 5+ years of experience deploying services using Kubernetes:
You can discuss Kubernetes best practices
You know how to build scalable, high-performing and reliable infra
You love integrating tools and setting up configurations for development, CI/CD, production and more
You know how to design technical processes that are easy to use (increase velocity) and hard to get wrong (secure) at the same time
You have a great attention to detail

Apply About employer

More about this job

Responsibilities

Build and scale a reliable infrastructure for an LLM platform that enables users to integrate and optimize inference across multiple providers. Collaborate with founders to define the technical direction and redefine the company's infrastructure stack.

Requirements

Requires over 5 years of experience with Kubernetes and a proven ability to build scalable, high-performing infrastructure. Candidates should be proficient in designing secure technical processes and integrating CI/CD tools.

Skills

Kubernetes
Go
Python
CI/CD
Infrastructure Design
Microservices Architecture
SQL
Distributed Caching
LLM Inference
Security Practices
Telemetry
Load Balancing

Benefits

Equity

Visa sponsorship

Not detected in the job text

Keywords

Kubernetes
Go
Python
LLM
AI
Microservices
SQL
Distributed Caches
CI/CD
SRE
DevOps
Infrastructure
API
Telemetry
Analytics
Load Balancing
MCP Integrations
Prompt Management
Data Loss Protection
Scalability

Report this job

Jobs in Canada

AI Engineer, Entry Level (Canada)

IT ENGINEER

Prompt Engineer - Early Career (Canada)