Principal System Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
About the Role We are seeking a seasoned, hands-on Principal System Engineer to act as a technical vanguard and drive engineering excellence across our organization. Operating in a highly regulated banking environment, you will be the driving force behind our strategic technical direction, platform reliability, and system resilience. This is an influential role where you will balance the hands-on resolution of complex, cross-layer challenges with proactive architectural innovation. You will mentor engineering teams, foster cross-departmental collaboration, and ensure our distributed systems meet the absolute highest standards of compliance, security, and performance.
What You Will Do
What You Will Do
- Architect & Operate at Scale: Design, build, and maintain highly available infrastructure using self-managed Kubernetes on Azure. You will manage distributed architectures, stateful sets, database configurations, and advanced resilience patterns (circuit breakers, Istio traffic shifting).
- Drive Reliability & SRE Practices: Anticipate operational bottlenecks, define error budgets, conduct chaos engineering, and implement proactive scaling policies. You will own P0/P1 incident management from rapid cross-layer triage through to blameless Root Cause Analysis (RCA) and permanent mitigation.
- Champion DevSecOps & Automation: Build and manage automated, compliance-aligned CI/CD pipelines utilizing GitHub Actions, ArgoCD (GitOps), and Helm. You will enforce strict quality and security gates (SonarQube, Dependency-Track) and champion Infrastructure as Code (Terraform).
- Ensure Enterprise Security & Compliance: Navigate stringent financial regulations (PCI-DSS, GDPR, SOC 2, ISO 27001) by embedding secure SDLC processes. You will implement least privilege access (RBAC), mTLS, secret management (Azure Key Vault), network segmentation, and robust audit trails.
- Lead & Mentor: Advocate for technical standards, conduct architecture and secure code reviews, and actively mentor other system engineers. You will act as a calm, authoritative technical voice during outages and serve as a strategic consultant to both technical and business stakeholders.
- Cloud Native Mastery: Expert-level production experience with self-managed Kubernetes, Azure services, advanced Linux systems administration, and deep network routing/troubleshooting.
- Service Mesh & Networking: Expert configuration and operation of Istio Service Mesh (traffic management, mTLS, fault injection) and deep proficiency in DNS management (A, CNAME, SRV, SPF, DKIM).
- Java & Performance Tuning: Strong ability to read, modify, and optimize Java/Spring Boot microservices. You bring hands-on expertise in JVM memory tuning, heap sizing, and Garbage Collection (GC) analysis within containerized limits.
- PKI & Security: Deep practical knowledge of Public Key Infrastructure (PKI), certificate lifecycles, revocation, and security enforcement across distributed environments.
- Comprehensive Observability: Expertise utilizing Prometheus, Grafana, OpenTelemetry, and logging stacks (Loki/ELK) to drive data-informed platform stability.
- Systematic Debugging: Proven ability to dive deep into complex outages using distributed tracing, JVM debugging (heap/thread dumps), and infrastructure tools (kubectl, Envoy logs).
- Communication: Professional fluency in written and spoken English, with the presence and clarity to explain complex technical remediation to developers, security auditors, and executive management.
More about this job
Responsibilities
Design and operate highly available Azure Kubernetes infrastructure, improve reliability through SRE practices and incident management, and build secure, automated CI/CD and infrastructure-as-code processes. Set technical standards, guide architecture and security reviews, mentor engineers, and advise technical and business stakeholders.
Requirements
Requires expert production experience with self-managed Kubernetes, Azure, Linux, networking, Istio, DNS, and practical PKI and security controls. Candidates should also be able to optimize Java/Spring Boot services and JVM performance, use observability and debugging tools, and communicate complex technical issues clearly.
Skills
- Kubernetes
- Microsoft Azure
- Linux Systems Administration
- Istio Service Mesh
- Network Routing and Troubleshooting
- Java
- Spring Boot
- JVM Performance Tuning
- Public Key Infrastructure
- Prometheus
- Grafana
- OpenTelemetry
- Terraform
- GitHub Actions
- ArgoCD
- Helm
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
- Security & Safety
- Management & Leadership
Keywords
- Self-Managed Kubernetes
- Microsoft Azure
- Distributed Systems
- High Availability
- Site Reliability Engineering
- Error Budgets
- Chaos Engineering
- Incident Management
- Root Cause Analysis
- Istio
- Service Mesh
- mTLS
- Java
- Spring Boot
- JVM Tuning
- Public Key Infrastructure
- PKI
- Prometheus
- Grafana
- OpenTelemetry
- Loki
- ELK
- Terraform
- GitHub Actions
- ArgoCD
- Helm
- DevSecOps
- PCI-DSS
- GDPR
- SOC 2