Senior Software Engineer
- Toronto, ON, Canada
Hybrid
$160,000 to $250,000 USD / year · Full-time
Applications open in a new tab.
Job details
- Pay
- $160,000 to $250,000 USD / year
- Job type
- Full-time
- Workplace
- Hybrid
- Experience
- 3+ years of software engineering experience including internships with at least 1+ years of experience with LLMs.
- Posting language
- English
Original job description
HeyMilo is building the next-generation AI interviewing platform, enabling companies to conduct thousands of interviews in parallel while ensuring high-quality insights helping drive hiring decisions.
We're looking for a Senior Software Engineer (Core Platform & AI Insights) to optimize the quality of our insights and analysis, ensuring that our AI generates accurate, high-value hiring recommendations.
This role is not focused on UX or frontend, but rather on data quality, inference accuracy, and AI-driven insights at scale.
Who You Are
Hold a Computer Science/Engineering degree from a top university in the U.S. or Canada
3+ years of software engineering experience including internships with at least 1+ years of experience with LLMs.
AI & Data Expert – You understand how to extract meaningful insights from AI-generated data.
Scalability & Observability Focused – You design systems that scale, ensuring fast response times and deep observability.
API & Backend Architect – You know how to design and optimize APIs, ensuring clean handoffs to front-end teams.
Strategic & Hands-On – You can delegate frontend work while also having the ability to jump in and build when needed.
Eager and Hungry: You thrive in a fast-paced environment at a high-growth company that’s looking to lead in the conversational ai recruiting vertical.
What You’ll Do
Optimize AI-generated insights to ensure high accuracy and relevance for hiring decisions.
Build scalable AI pipelines that process thousands of interviews efficiently.
Implement robust observability to track the performance and reliability of AI-driven insights.
Architect high-performance APIs that integrate with AI workflows and hiring systems.
Ensure seamless handoff of features to front-end engineers while maintaining flexibility to build UI components when necessary.
Experiment with AI techniques, data embeddings, and ML-driven hiring models to improve platform intelligence.
Technical Expertise
Backend: Python, FastAPI, Redis, ClickHouse, Airflow
AI & ML: Prompt chaining, inference pipelines, vector databases (Pinecone)
Scalability & Observability: High-throughput ML inference, OpenTelemetry, InfluxDB, PostHog
Cloud & APIs: AWS, OpenAI, Gemini, Anthropic, ElevenLabs, Twilio
What’s In It for You
Work on cutting-edge AI inference and prompt engineering challenges.
Help shape how AI-powered hiring decisions are made at scale.
Competitive salary, equity, and opportunities for growth in an AI-first company.
More about this job
Responsibilities
The Senior Software Engineer at HeyMilo AI will improve the quality of AI-generated hiring recommendations, build pipelines that process thousands of interviews, and design the backend APIs that connect AI workflows to hiring systems.
Requirements
Candidates need a computer science or engineering degree from a top U.S. or Canadian university, 3+ years of software engineering experience including internships, and at least 1 year working with LLMs. Strong backend, API design, and scalability skills are expected.
Skills
- Python
- FastAPI
- Redis
- ClickHouse
- Apache Airflow
- Pinecone
- Prompt engineering
- Prompt chaining
- Inference pipelines
- Vector databases
- Embeddings
- High-throughput ML inference
- OpenTelemetry
- InfluxDB
- PostHog
- AWS
- OpenAI API
- Gemini API
- Anthropic API
- ElevenLabs API
- Twilio API
- REST API design
- Observability
- Backend architecture
- Large language models
Benefits
- Equity
- Growth opportunities
Categories
- Software
- Technology
- Human Resources
Keywords
- Python
- FastAPI
- Redis
- ClickHouse
- Airflow
- Pinecone
- vector databases
- LLM
- prompt chaining
- inference pipelines
- OpenTelemetry
- InfluxDB
- PostHog
- AWS
- OpenAI
- Gemini
- Anthropic
- ElevenLabs
- Twilio
- AI interviewing
Seniority
Senior
Perks
- Stock or equity
Tools
- Python
- FastAPI
- Redis
- ClickHouse
- Airflow
- Pinecone
- OpenTelemetry
- InfluxDB
- PostHog
- AWS
Languages
- English
Fields of study
- Computer Science
- Engineering