Data Engineer – Azure Databricks / Data Modeling / Data Lineage
Location: Toronto Canada
Contract: Long-Term Contract
Job Summary
We are looking for a Data Engineer with strong hands-on experience in Azure Databricks, Data Modeling, Data Lineage, Metadata Management, and Data Engineering. The ideal candidate will help build scalable and standardized enterprise data lineage solutions by consolidating existing proof-of-concepts into production-ready platforms.
Key Responsibilities
- Develop and enhance scalable data engineering solutions using Azure Databricks.
- Design and implement conceptual, logical, and physical data models.
- Develop and maintain data lineage models and lineage metamodels.
- Transform existing data lineage POCs into standardized, enterprise-grade solutions.
- Work closely with Data Architects, Data Engineers, Data Governance, and Data Management teams.
- Define and implement enterprise data lineage standards, frameworks, and technical solutions.
- Support metadata management, data integration, lineage, and data governance initiatives.
- Analyze data flows across multiple platforms and document end-to-end lineage.
- Build scalable solutions for capturing, managing, and consuming technical and business metadata.
- Ensure data solutions follow enterprise architecture, governance, security, and quality standards.
- Troubleshoot data pipeline and lineage-related issues and improve solution performance.
- Contribute to modernization and standardization of enterprise data platforms.
Required Skills
- Strong hands-on experience with Azure Databricks and modern data engineering.
- Strong knowledge of Data Modeling and enterprise data architecture concepts.
- Strong understanding of Data Lineage and Lineage Metamodels.
- Experience designing metadata and lineage solutions.
- Experience converting POCs/prototypes into scalable production solutions.
- Strong understanding of data platforms, metadata management, data integration, and data governance.
- Strong SQL and data transformation skills.
- Experience working with large-scale enterprise data environments.
- Strong communication and collaboration skills.