Data Architect (Google BigQuery/GCP to Azure Databricks)
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Position Name – Data Architect
Type of hiring – Fulltime/Subcon
Location – Downtown Toronto, ON
Work Model – Hybrid (3 days office, 2 days remote)
Job Description:
We are seeking an experienced Data Architect to lead the architecture and modernization of our enterprise data platforms. This role is critical as we undertake a large-scale migration from Google BigQuery/GCP to Azure Databricks. The Data Architect will be responsible for defining the target-state architecture, developing the migration strategy, implementing data governance, and executing the Lakehouse architecture for a strategic data transformation program.
Responsibilities
- Define the Azure Databricks Lakehouse architecture and create a comprehensive migration roadmap.
- Design and implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake solutions.
- Lead the architecture for the BigQuery-to-Databricks migration, including source-to-target mapping.
- Establish governance, security, and data management standards utilizing Unity Catalog.
- Architect scalable data models, ingestion frameworks, and analytics platforms to support business needs.
- Collaborate with business, engineering, and program teams to deliver cloud modernization initiatives effectively.
Mandatory Skills
- Expertise in Azure Databricks, including Delta Lake and Lakehouse Architecture.
- Proficient in PySpark and SQL.
- Strong background in Data Modeling (Dimensional/Data Vault), Data Migration, and Modernization.
- Experience with Azure Data Factory and ADLS Gen2.
- Familiarity with CI/CD processes and Azure DevOps.
- Proven experience in delivering large-scale cloud data migration programs.
Preferred Skills
- Experience with BigQuery migration.
- Financial Services industry experience is preferred.
Qualifications
- 15+ Years of experience in Data & Analytics.
- 5+ Years of experience in Data Architecture.
- Preferred certifications include:
- Microsoft Azure Solutions Architect Expert
- Databricks Certified Professional
- TOGAF
More about this job
Responsibilities
Define the target Azure Databricks Lakehouse architecture and migration roadmap for the enterprise transition from Google BigQuery/GCP. Lead the migration and implementation of Medallion Architecture and Delta Lake solutions, while establishing governance, security, data models, and ingestion frameworks in collaboration with business and technical teams.
Requirements
Requires 15+ years of experience in Data & Analytics and 5+ years in Data Architecture, with expertise in Azure Databricks, Delta Lake, Lakehouse Architecture, PySpark, SQL, data modeling, and cloud data migration. Experience with Azure Data Factory, ADLS Gen2, CI/CD, and Azure DevOps is required; BigQuery migration and Financial Services experience are preferred, as are the listed architecture and Databricks certifications.
Skills
- Azure Databricks
- Delta Lake
- Lakehouse Architecture
- PySpark
- SQL
- Data Modeling
- Data Migration
- Cloud Modernization
- Azure Data Factory
- ADLS Gen2
- CI/CD
- Azure DevOps
- Unity Catalog
- BigQuery
- Data Governance
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Management & Leadership
Keywords
- Azure Databricks
- Google BigQuery
- Google Cloud Platform
- Microsoft Azure
- Lakehouse Architecture
- Medallion Architecture
- Bronze-Silver-Gold
- Delta Lake
- PySpark
- SQL
- Data Modeling
- Dimensional Modeling
- Data Vault
- Data Migration
- Cloud Modernization
- Azure Data Factory
- ADLS Gen2
- Unity Catalog
- Data Governance
- Data Security
- Data Management
- CI/CD
- Azure DevOps
- Databricks Certified Professional
- TOGAF
- Financial Services
- Data Ingestion
- Analytics Platforms