We are seeking a Databricks Architect to design, implement, and govern enterprise data platforms on Azure Databricks. The role focuses on platform architecture, workspace provisioning, data lake design, security, metadata management, and source system integration.
Key Responsibilities
- Design Databricks workspace, compute, networking, and private-access architecture.
- Define data lake architecture including Bronze, checkpoint, archive, and quarantine zones.
- Establish orchestration patterns, catalog structures, and platform standards.
- Develop HLD/LLD solution designs.
- Lead Databricks environment deployment using automation frameworks.
- Implement security and governance using Unity Catalog and Azure Key Vault.
- Configure ADLS Gen2, private endpoints, retention, and access controls.
- Design source connectivity, authentication, and data ingestion frameworks.
- Define cluster, runtime, operational, and security standards.
- Support testing, troubleshooting, validation, and production readiness.
Required Skills
- Strong experience with Azure Databricks architecture and administration.
- Expertise in ADLS Gen2, Unity Catalog, Azure Key Vault, Private Link, and networking.
- Enterprise-scale data lakehouse/data platform architecture experience.
- Strong knowledge of data governance, security, IAM, secrets management, and compliance.
- Experience with CI/CD and Infrastructure as Code, preferably Terraform.
- Strong understanding of data integration, ingestion patterns, and enterprise source connectivity.
