Senior Cloud Data Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines and cloud data platforms.
- Build and manage enterprise data lakes, lakehouses, and data warehouses.
- Implement DataOps practices, CI/CD automation, and data pipeline orchestration.
- Develop automated metadata collection, data quality, and lineage solutions.
- Support cloud data migration, modernization, and enterprise integration initiatives.
- Collaborate with data architects and governance teams to implement data standards and common data models.
- Support cloud-native data architectures and Data as a Service (DaaS), Database as a Service (DBaaS), and Data Warehouse as a Service (DWaaS) solutions.
- Optimize cloud data services for performance, scalability, and reliability.
- Design and execute large-scale data migration and modernization initiatives.
- Migrate very large datasets from OLTP and OLAP environments to cloud platforms.
- Support transitions to SaaS, PaaS, and IaaS environments.
- Strong hands-on experience with Azure Databricks, Delta Lake, and Databricks SQL.
- Solid understanding of Medallion Architecture (Bronze, Silver, Gold).
- Experience with Azure Data Services and Azure Data Factory (ADF).
- Experience with Informatica or equivalent data integration tools.
- Experience operationalizing common data models and metadata repositories.
- Proven experience with ETL/ELT pipelines, DataOps, and CI/CD automation.
- Experience with Microsoft Purview and Microsoft Fabric.
- Previous Ontario Public Service (OPS) or public-sector experience.
- Knowledge of graph technologies and semantic repositories.
- Familiarity with AODA standards and enterprise data governance.
More about this job
Responsibilities
Design, build, and optimize scalable cloud data platforms, lakes, lakehouses, warehouses, and ETL/ELT pipelines, including large-scale migration and modernization of data environments. Implement DataOps automation, metadata, data quality, lineage, and governance solutions while collaborating with architecture and governance teams to deliver secure, reliable, high-performance services.
Requirements
Requires hands-on experience with Azure Databricks, Delta Lake, Databricks SQL, Azure Data Services, Azure Data Factory, and Informatica or equivalent tools, along with knowledge of Medallion Architecture. Candidates should have proven experience in ETL/ELT, DataOps, CI/CD, metadata repositories, and common data models; public-sector experience, Microsoft Purview, Microsoft Fabric, graph technologies, and AODA familiarity are advantageous.
Skills
- Azure Databricks
- Delta Lake
- Databricks SQL
- Medallion Architecture
- Azure Data Services
- Azure Data Factory
- Informatica
- ETL/ELT Pipelines
- DataOps
- CI/CD Automation
- Metadata Management
- Data Governance
- Cloud Data Migration
- Data Integration
- Microsoft Purview
- Microsoft Fabric
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
Keywords
- Azure Data Services
- Azure Data Factory
- Azure Databricks
- Delta Lake
- Databricks SQL
- Medallion Architecture
- Bronze-Silver-Gold
- ETL/ELT
- DataOps
- CI/CD
- Data Pipeline Orchestration
- Data Lakes
- Lakehouses
- Data Warehouses
- Informatica
- Metadata Management
- Metadata Repositories
- Data Quality
- Data Lineage
- Data Governance
- Common Data Models
- Cloud Data Migration
- Enterprise Data Integration
- Data as a Service
- Database as a Service
- Data Warehouse as a Service
- Microsoft Purview
- Microsoft Fabric
- Graph Technologies
- Semantic Repositories