Founding Engineer
- London, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- You have 5+ years of experience building backend services using a compiled language (preferably Golang)
- Posting language
- English
- Posted
Original job description
What we are building
We are building the LLM platform that will power tomorrow's AI-first companies.
A single platform that allows any LLM user to integrate, scale, secure and optimize their LLM inference across 200+ providers in a few clicks.
A highly scalable, reliable and secure infra that exposes simple, OpenAI-compatible APIs, that every product or tool can use. The API allows you to access any of the LLM providers, taking care of API compatibility while adding telemetry, analytics, load balancing, MCP integrations, prompt management, data loss protection and much more out of the box.
Why join us
You want to build a novel infra product that will be the backbone for the best AI products, and power the next AI coding assistants, agent orchestration systems or any other AI-based solution.
Work directly with the founders to influence the company's direction and make a tangible impact. If you're looking to build your own startup someday or want to thrive in the dynamic environment of a fast-growing company, this is the ideal place to accelerate your impact and growth.
A generous TC package with significant equity.
Our stack
We Running a Pragmatic Micro-service Architecture
What we are looking for
We are building the LLM platform that will power tomorrow's AI-first companies.
A single platform that allows any LLM user to integrate, scale, secure and optimize their LLM inference across 200+ providers in a few clicks.
A highly scalable, reliable and secure infra that exposes simple, OpenAI-compatible APIs, that every product or tool can use. The API allows you to access any of the LLM providers, taking care of API compatibility while adding telemetry, analytics, load balancing, MCP integrations, prompt management, data loss protection and much more out of the box.
Why join us
You want to build a novel infra product that will be the backbone for the best AI products, and power the next AI coding assistants, agent orchestration systems or any other AI-based solution.
Work directly with the founders to influence the company's direction and make a tangible impact. If you're looking to build your own startup someday or want to thrive in the dynamic environment of a fast-growing company, this is the ideal place to accelerate your impact and growth.
A generous TC package with significant equity.
Our stack
We Running a Pragmatic Micro-service Architecture
- Kubernetes
- Core LLM gateway in Go
- Auxiliary and ML/AI services in Python
- Different SQL DBs + Distributed caches
What we are looking for
- You have 5+ years of experience building backend services using a compiled language (preferably Golang)
- You can discuss best practices in the language and frameworks you've used before
- You understand concurrency and you've used it before
- You've used different types of caches and databases and know how to choose and use them correctly
- You can design both scalable and pragmatic architectures, depending on the product's stage and actual needs
- You understand tradeoffs between quality, speed and completeness, and know that building a minimal product is not the same as building a broken one
- You've learnt new technologies by yourself in the past, and you are eager to do so again
More about this job
Responsibilities
Build and evolve a scalable, reliable, and secure LLM infrastructure platform that provides OpenAI-compatible APIs across more than 200 providers. Help shape the architecture and product direction, including integrations, telemetry, analytics, load balancing, and other platform capabilities.
Requirements
Candidates should have at least five years of backend service development experience in a compiled language, preferably Go, and be familiar with concurrency, databases, and caching. They should be able to design pragmatic, scalable architectures, make sound tradeoffs, and independently learn new technologies.
Skills
- Backend Service Development
- Go
- Python
- Concurrency
- Microservices
- Kubernetes
- LLM Infrastructure
- API Design
- Database Selection
- Caching
- Scalable Architecture
- System Design
- Load Balancing
- Telemetry
- Prompt Management
- Data Loss Protection
Benefits
- Equity
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
Keywords
- LLM Platform
- LLM Inference
- Go
- Golang
- Python
- Kubernetes
- Microservices
- OpenAI-Compatible APIs
- API Compatibility
- LLM Providers
- Telemetry
- Analytics
- Load Balancing
- MCP Integrations
- Prompt Management
- Data Loss Protection
- SQL Databases
- Distributed Caches
- Concurrency
- Backend Services
- Scalable Architecture
- Infrastructure
- AI
- Security
- Reliability