Senior System Software Engineer
- Toronto, ON, Canada
$250,000 to $450,000 CAD / year · Full-time
Applications open in a new tab.
Job details
- Pay
- $250,000 to $450,000 CAD / year
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Senior System Software Engineer (AI Runtime & Compute)
How much AI performance is lost between what the compiler produces and what the hardware actually executes?
I’m working with a venture-backed AI infrastructure startup tackling that problem through a new compiler and runtime platform. The aim is to help developers get more from different accelerators while reducing the engineering work involved in moving between hardware platforms.
The team brings together deep experience in compilers, runtimes and processor architecture. They’re hiring a Runtime Engineer to build a central part of the execution stack.
The opportunity
You’ll work where compiler output meets real hardware: deciding how work is scheduled, how parallelism is used and where execution loses performance.
Your work will include:
- Developing runtime components that support multiple hardware targets.
- Exploring scheduling and workload partitioning approaches.
- Building experiments that reveal where execution stalls and why.
- Measuring generated code on hardware and feeding findings into the compiler team.
- Turning promising ideas into reliable, maintainable systems software.
What would make you a strong fit
- Strong C++ experience and a background in runtime or compiler systems.
- A solid grasp of concurrency, asynchronous programming and memory hierarchies.
- Knowledge of operating-system kernel or hypervisor development.
- An interest in investigating performance through code, measurements and hardware behaviour.
GPU programming, CUDA/ROCm, HPC or experience with large compute systems would also be valuable.
This is an opportunity to influence core execution technology alongside experienced systems engineers, with equity participation and a direct connection between your engineering decisions and platform performance.
More about this job
Responsibilities
Develop runtime components for multiple hardware targets, investigate scheduling and workload partitioning, and run experiments to identify execution bottlenecks. Measure generated code on hardware, share findings with the compiler team, and turn performance improvements into reliable, maintainable systems software.
Requirements
Candidates should have strong C++ experience and a background in runtime or compiler systems, along with a solid understanding of concurrency, asynchronous programming, and memory hierarchies. Kernel or hypervisor development experience is relevant; GPU programming, CUDA or ROCm, high-performance computing, and large compute systems are valuable additional qualifications.
Skills
- C++
- Runtime Systems
- Compiler Systems
- Concurrency
- Asynchronous Programming
- Memory Hierarchies
- Operating-System Kernel Development
- Hypervisor Development
- Performance Analysis
- Scheduling
- Workload Partitioning
- GPU Programming
- CUDA
- ROCm
- High-Performance Computing
- Systems Software
Benefits
- Equity Participation
Visa sponsorship
Not detected in the job text
Categories
- Software
- Technology
- Engineering
Keywords
- C++
- AI Runtime
- Compute
- Compiler
- Runtime Platform
- Accelerators
- Hardware Targets
- Processor Architecture
- Scheduling
- Workload Partitioning
- Concurrency
- Asynchronous Programming
- Memory Hierarchies
- Operating-System Kernel
- Hypervisor
- Performance Analysis
- Generated Code
- Systems Software
- GPU Programming
- CUDA
- ROCm
- High-Performance Computing
- Large Compute Systems