Software Engineer (Python, Go)

About The Company

Baseten is at the forefront of powering mission-critical inference for some of the world's most innovative AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By integrating applied AI research with flexible infrastructure and seamless developer tooling, Baseten enables organizations operating at the cutting edge of artificial intelligence to deploy and scale advanced models efficiently and reliably. The company’s recent successful funding round, a $1.5 billion Series F led by Altimeter Capital, Conviction Partners, and Spark Capital, underscores its rapid growth and industry confidence. As a rapidly expanding organization, Baseten is dedicated to building a platform that transforms how engineers and developers turn AI models into production-ready applications, fostering innovation and technological advancement in the AI space.

About The Role

As an Infrastructure Software Engineer at Baseten, you will play a critical role in developing and maintaining the core components of our machine learning inference platform. Your work will directly impact the efficiency, scalability, and reliability of AI applications used by top-tier clients. You will be responsible for designing and implementing infrastructure solutions that support high-performance deployment, monitoring, and management of machine learning models. This role offers an exciting opportunity to work on complex distributed systems, contribute to innovative initiatives such as multi-cloud capacity management and GPU optimization, and collaborate with a talented team dedicated to advancing AI infrastructure. Your contributions will help ensure that Baseten’s platform remains robust, scalable, and capable of supporting the most demanding AI workloads in production environments.

Qualifications

• Bachelor's degree or higher in Computer Science, Software Engineering, or a related field
• Proficiency in one or more programming or scripting languages such as Python, Go, or similar
• Working knowledge of Kubernetes and container orchestration technologies
• Basic understanding of machine learning concepts and model serving architectures
• Familiarity with distributed systems and scalable infrastructure design
• Experience with monitoring and logging tools for system performance and reliability
• Interest in AI/ML infrastructure and eagerness to learn emerging technologies
• Strong collaboration, communication, and problem-solving skills
  
  

Responsibilities

• Develop and maintain infrastructure components for the ML inference platform using Python, Go, and related technologies
• Implement and manage Kubernetes deployments to support scalable model serving
• Contribute to the development of inference orchestration layers for efficient model deployment workflows
• Build and improve monitoring systems to track model performance and system health
• Design and implement resource management solutions to optimize ML workloads across cloud and on-prem environments
• Automate infrastructure processes to streamline ML deployment pipelines and reduce manual interventions
• Collaborate with cross-functional teams to troubleshoot issues and implement technical solutions
• Balance system performance and reliability through continuous optimization and best practices
• Participate in technical discussions and contribute to infrastructure improvements and innovations
• Stay updated on industry trends and apply best practices in infrastructure engineering
  
  

Benefits

• Competitive salary with meaningful equity participation
• 100% coverage of medical, dental, and vision insurance for employees and dependents
• Flexible paid time off policy, including a company-wide Winter Break (closed from Christmas Eve to New Year’s Day)
• Paid parental leave to support work-life balance
• Fertility and family-building stipend through Carrot
• Company-sponsored 401(k) retirement plan
• Exposure to a diverse range of ML startups, providing valuable learning and networking opportunities
  
  

Equal Opportunity

Baseten is committed to fostering a diverse, inclusive, and equitable workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We consider qualified applicants with criminal histories in a manner consistent with applicable laws, including the San Francisco Fair Chance Ordinance where applicable.