Senior Data Engineer
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
- Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
- Development of unified data platforms using Databricks and Unity catalog or its equivalent.
- Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
- Advanced SQL skills (PL/SQL, TSQL).
- Big Data processing Frameworks (PySpark).
- Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
- Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.
More about this job
Responsibilities
Design, build, automate, and optimize complex ETL/ELT processes and unified data platforms using Databricks, Delta Live Tables, Unity Catalog, or equivalent technologies. Develop data pipelines and support data migration and integration across Oracle, Azure Data Lake, Databricks, and Microsoft Fabric.
Requirements
Requires advanced SQL skills, including PL/SQL and T-SQL, and experience with relational databases, data modeling, query optimization, and data replication. The role also calls for PySpark, Azure Data Factory pipeline development, and CI/CD experience using Azure DevOps Git integration.
Skills
- Databricks
- Delta Live Tables
- ETL/ELT
- Data Platform Development
- Unity Catalog
- Relational Databases
- Data Modeling
- Advanced SQL
- Query Optimization
- Data Replication
- PySpark
- Azure Data Factory
- CI/CD
- Azure DevOps
- Data Migration
- Data Integration
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Databricks
- Delta Live Tables
- ETL/ELT
- Unified Data Platforms
- Unity Catalog
- Oracle
- MySQL
- SQL Server
- Relational Data Modeling
- Dimensional Data Modeling
- Advanced SQL
- PL/SQL
- T-SQL
- Query Optimization
- Data Replication
- PySpark
- Azure Data Factory
- Copy Activity
- Custom Data Pipelines
- CI/CD
- Azure DevOps
- Git Integration
- Data Migration
- Data Integration
- Azure Data Lake
- Microsoft Fabric