Movojobs
Back to results

Added

I8IS - Infiniti Software Solutions

DataOps/Cloud Data Engineer - Senior

  • Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type
Full-time
Apply by
Experience
Mandatory Skills and Experience (8+ years experience):
Posting language
English
Posted

Original job description

DataOps/Cloud Data Engineer - Senior
Onsite - Toronto ON

Mandatory Skills and Experience (8+ years experience):

  • Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
  • Development of unified data platforms using Databricks and Unity catalog or its equivalent.
  • Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
  • Advanced SQL skills (PL/SQL, TSQL).
  • Big Data processing Frameworks (PySpark).
  • Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
  • Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.

Desirable Skills and Experience:

  • Data lake design and development with focus on extracting, transforming data coming from various data sources and loading into Lakehouse in medallion architecture.
  • Advanced skills and hands-on experience with Oracle databases, Azure SQL Server and Azure Data Factory.
  • Cloud technologies (Azure, Google, AWS).
  • PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
  • Scripting languages (Python, Unix shell, Scala).
Apply About employer
More about this job

Responsibilities

Design, build, automate, and optimize complex ETL/ELT processes and unified data platforms using Databricks and related technologies. Develop data pipelines and support data migration and integration across Oracle, Azure Data Lake, Databricks, and Microsoft Fabric.

Requirements

Requires 8+ years of experience with Databricks, data engineering, relational databases, advanced SQL, and big data processing frameworks such as PySpark. Experience with Azure Data Factory, CI/CD using Azure DevOps, data modeling, database administration, and cross-platform data migration is required; cloud platforms and scripting languages are desirable.

Skills

  • Databricks
  • Delta Live Tables
  • Unity Catalog
  • ETL/ELT
  • SQL
  • PL/SQL
  • T-SQL
  • PySpark
  • Azure Data Factory
  • Azure DevOps
  • Data Modeling
  • Data Migration
  • Data Integration
  • Oracle
  • Python
  • Data Lakehouse

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Data & Analytics
  • Software
  • Engineering

Keywords

  • Databricks
  • Delta Live Tables
  • Unity Catalog
  • ETL/ELT
  • Data Platforms
  • Relational Databases
  • Oracle
  • MySQL
  • SQL Server
  • Azure SQL Server
  • Data Modeling
  • Dimensional Modeling
  • Advanced SQL
  • PL/SQL
  • T-SQL
  • Query Optimization
  • Data Replication
  • Database Administration
  • Big Data Processing
  • PySpark
  • Azure Data Factory
  • Azure DevOps
  • CI/CD
  • Data Migration
  • Data Integration
  • Azure Data Lake
  • Microsoft Fabric
  • Lakehouse
  • Medallion Architecture
  • Python

Report this job