Staff Software Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Experience
- 8+ years of software engineering experience, including 4+ years in senior or lead AI/ML roles
- Posting language
- English
- Posted
Original job description
Staff Software Engineer, AI
Toronto, ON | Hybrid
We’re partnering with a global technology organization that is investing heavily in AI and building intelligent products used by professionals in complex, highly regulated industries.
They’re looking for a Staff Software Engineer, AI to provide hands-on technical leadership across the design, development, and scaling of enterprise-grade AI systems. This is a senior individual contributor opportunity with significant influence over architecture, engineering standards, and product direction.
What you’ll do
- Architect and build production-grade AI systems, including RAG pipelines and autonomous agents
- Integrate AI models into scalable applications through APIs, distributed data pipelines, and microservices
- Lead technical architecture decisions and define best practices for AI development
- Evaluate emerging AI technologies and turn promising ideas into production capabilities
- Champion MLOps and LLMOps practices across the development lifecycle
- Improve system performance across latency, reliability, cost, and user experience
- Mentor engineers and influence senior technical and product stakeholders
- Establish strong testing, monitoring, security, and AI governance practices
What we’re looking for
- 8+ years of software engineering experience, including 4+ years in senior or lead AI/ML roles
- Strong hands-on Python expertise
- Experience building and deploying Generative AI, LLM, RAG, or agentic systems
- Knowledge of AI/ML frameworks such as PyTorch, TensorFlow, or JAX
- Experience with vector databases, embeddings, semantic search, or information retrieval
- Strong understanding of distributed systems and cloud-native architecture
- Experience with AWS, Azure, or GCP
- Familiarity with Docker, Kubernetes, Terraform, and MLOps/LLMOps
- A track record of leading complex technical initiatives and mentoring engineers
- Strong communication skills with the ability to influence senior stakeholders
Experience building AI products for regulated or specialized industries would be an asset.
This is an opportunity to remain highly technical while helping shape the architecture and strategy behind enterprise AI products at scale.
More about this job
Responsibilities
Architect and build production-grade AI systems, including RAG pipelines and autonomous agents, while leading technical architecture decisions. The role involves championing MLOps/LLMOps practices and mentoring engineers to scale enterprise AI products.
Requirements
Requires 8+ years of software engineering experience with at least 4 years in senior AI/ML roles and strong Python expertise. Candidates must have a proven track record of deploying Generative AI systems and working with cloud-native architectures.
Skills
- Python
- Generative AI
- LLM
- RAG
- Agentic Systems
- PyTorch
- TensorFlow
- JAX
- Vector Databases
- Distributed Systems
- Cloud-native Architecture
- AWS
- Azure
- GCP
- Docker
- Kubernetes
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
- Data & Analytics
Keywords
- AI
- Machine Learning
- RAG
- LLMOps
- MLOps
- Python
- PyTorch
- TensorFlow
- JAX
- Vector Databases
- Semantic Search
- Information Retrieval
- Distributed Systems
- Cloud-native
- AWS
- Azure
- GCP
- Docker
- Kubernetes
- Terraform
- Microservices
- APIs
- Enterprise AI
- Autonomous Agents
- Software Engineering
- Technical Leadership