Closed listing
Databricks Data Engineer
- Toronto, ON, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
- Proven experience with Azure Databricks, including Unity Catalog and Data Lakehouse Architecture.
- Strong proficiency in PySpark and Spark SQL.
- Expertise in ETL/ELT Development.
- Experience with Azure Data Lake Storage (ADLS).
- Familiarity with Git and CI/CD practices.
- SQL Optimization and Performance Tuning skills.
- Experience in Data Migration and Reconciliation Frameworks.
- GCP BigQuery Migration Experience is essential.
More about this job
Responsibilities
The role involves developing ETL/ELT pipelines and managing data migration projects using Azure Databricks. You will be responsible for optimizing SQL performance and ensuring data reconciliation across complex data environments.
Requirements
Candidates must have proven experience with Azure Databricks, Unity Catalog, and Data Lakehouse architecture. Proficiency in PySpark, Spark SQL, and experience with GCP BigQuery migration are essential requirements.
Skills
- Azure Databricks
- Unity Catalog
- Data Lakehouse Architecture
- PySpark
- Spark SQL
- ETL/ELT Development
- Azure Data Lake Storage
- Git
- CI/CD
- SQL Optimization
- Performance Tuning
- Data Migration
- Reconciliation Frameworks
- GCP BigQuery
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
- Consulting
Keywords
- Azure Databricks
- Unity Catalog
- Data Lakehouse
- PySpark
- Spark SQL
- ETL
- ELT
- ADLS
- Git
- CI/CD
- SQL Optimization
- Performance Tuning
- Data Migration
- Reconciliation Frameworks
- GCP BigQuery
- Data Engineering
- Cloud Computing
- IT Services