DataOps/Cloud Data Engineer - Senior
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
- Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
- Development of unified data platforms using Databricks and Unity catalog or its equivalent.
- Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
- Advanced SQL skills (PL/SQL, TSQL).
- Big Data processing Frameworks (PySpark).
- Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
- Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.
More about this job
Responsibilities
Design, build, automate, and optimize complex ETL/ELT processes and unified data platforms using Databricks, Delta Live Tables, Unity Catalog, and equivalent technologies. Develop data pipelines and integrations, and migrate data across Oracle, Azure Data Lake, Databricks, and Microsoft Fabric.
Requirements
Requires senior-level experience with Databricks-based data platforms, big data processing, and Azure Data Factory pipelines. Candidates should have advanced SQL skills, experience with relational databases and data modeling, and familiarity with CI/CD and cross-platform data migration.
Skills
- Databricks
- Delta Live Tables
- Unity Catalog
- ETL/ELT
- Relational Databases
- Data Modeling
- Advanced SQL
- PL/SQL
- T-SQL
- Query Optimization
- Data Replication
- PySpark
- Azure Data Factory
- Azure DevOps
- CI/CD
- Data Migration
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Engineering
Keywords
- Databricks
- Delta Live Tables
- Unity Catalog
- ETL/ELT
- Data Platforms
- Oracle
- MySQL
- SQL Server
- Relational Data Modeling
- Dimensional Data Modeling
- Advanced SQL
- PL/SQL
- T-SQL
- Query Optimization
- Data Replication
- Database Administration
- Big Data Processing
- PySpark
- Azure Data Factory
- Copy Activity
- Custom Data Pipelines
- CI/CD
- Azure DevOps
- Git Integration
- Data Migration
- Data Integration
- Azure Data Lake
- Microsoft Fabric