Databricks DataOps / SRE Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Position Name – Databricks DataOps / SRE Engineer
Type of hiring – Fulltime/Subcon
Location – Downtown Toronto, ON
Work Model – Hybrid (3 days office, 2 days remote)
Job Description:
Exp – 5-8 Years
- Strong hands-on experience in Azure Databricks production support, pipeline troubleshooting, and monitoring.
- Expertise in Databricks Jobs, Workflows, Spark execution, Azure Data Factory, and SQL.
- Experience investigating pipeline failures, cluster issues, performance bottlenecks, and data processing errors.
- Develop Python and shell scripts for operational automation, pipeline recovery, and monitoring.
- Experience with Azure Monitor, Log Analytics, incident management, and root-cause analysis.
- Prepare technical runbooks, troubleshooting guides, and incident resolution documentation.
- Good to have: ServiceNow, SRE practices, SLI/SLO concepts, and Azure DevOps.
More about this job
Responsibilities
Support Azure Databricks production systems by monitoring and troubleshooting pipelines, jobs, workflows, clusters, and data processing issues. Automate operational tasks and pipeline recovery, investigate incidents and root causes, and maintain runbooks and troubleshooting documentation.
Requirements
Requires 5–8 years of experience and strong hands-on expertise supporting Azure Databricks in production, including Spark, Databricks Jobs and Workflows, Azure Data Factory, and SQL. Candidates should be able to develop Python and shell scripts and have experience with monitoring, incident management, and root-cause analysis; ServiceNow, SRE practices, SLI/SLO concepts, and Azure DevOps are desirable.
Skills
- Azure Databricks
- Production Support
- Pipeline Troubleshooting
- Monitoring
- Databricks Jobs
- Databricks Workflows
- Apache Spark
- Azure Data Factory
- SQL
- Python
- Shell Scripting
- Azure Monitor
- Log Analytics
- Incident Management
- Root-Cause Analysis
- Azure DevOps
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Engineering
Keywords
- Azure Databricks
- DataOps
- Site Reliability Engineering
- Production Support
- Pipeline Troubleshooting
- Databricks Jobs
- Databricks Workflows
- Apache Spark
- Azure Data Factory
- SQL
- Python
- Shell Scripting
- Operational Automation
- Pipeline Recovery
- Azure Monitor
- Log Analytics
- Incident Management
- Root-Cause Analysis
- Technical Runbooks
- Troubleshooting Guides
- ServiceNow
- SRE Practices
- SLI/SLO
- Azure DevOps
- Cluster Management
- Performance Optimization
- Data Processing