Senior Databricks Data Platform Engineer
- Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Original job description
We are looking for a Senior Databricks Data Platform Engineer with strong experience in Databricks platform administration, Unity Catalog, Terraform, and CI/CD automation. The candidate will be responsible for managing enterprise Databricks environments, platform security, governance, performance, and cost optimization.
Must-Have Skills:
- Strong Databricks Platform Administration – Workspaces, Unity Catalog, Cluster Policies, SQL Warehouses.
- Terraform and Databricks Asset Bundles (DABs).
- CI/CD – Azure DevOps or GitHub Actions.
- Python, SQL, PySpark, and Spark Performance Tuning.
- Delta Lake – OPTIMIZE, VACUUM, Z-Ordering, Liquid Clustering.
- Cloud – Azure (ADLS Gen2), AWS (S3), or GCP.
- Databricks FinOps – DBU Cost Optimization, Cluster Right-Sizing, Usage Monitoring.
More about this job
Responsibilities
Manage enterprise Databricks environments, including platform security, governance, and performance. Optimize platform costs through DBU monitoring, cluster right-sizing, and usage monitoring.
Requirements
Requires strong experience administering Databricks platforms, including workspaces, Unity Catalog, cluster policies, and SQL warehouses, along with Terraform, Databricks Asset Bundles, and CI/CD automation. Candidates should also have Python, SQL, PySpark, Spark performance tuning, Delta Lake optimization, cloud platform experience, and Databricks FinOps expertise.
Skills
- Unity Catalog
- Terraform
- Databricks Asset Bundles
- CI/CD Automation
- Azure DevOps
- GitHub Actions
- Python
- SQL
- PySpark
- Spark Performance Tuning
- Delta Lake
- Cloud Platforms
- Databricks FinOps
- Cost Optimization
- Platform Security and Governance
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Engineering
Keywords
- Databricks
- Workspaces
- Unity Catalog
- Cluster Policies
- SQL Warehouses
- Terraform
- Databricks Asset Bundles
- CI/CD
- Azure DevOps
- GitHub Actions
- Python
- SQL
- PySpark
- Spark Performance Tuning
- Delta Lake
- OPTIMIZE
- VACUUM
- Z-Ordering
- Liquid Clustering
- Azure
- ADLS Gen2
- AWS
- S3
- GCP
- Databricks FinOps
- DBU Cost Optimization
- Cluster Right-Sizing
- Usage Monitoring
- Platform Security and Governance