Azure Data Engineer
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
- Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services.
- Expertise in developing scalable data ingestion, transformation, and orchestration pipelines using Databricks and Apache Airflow.
- Experience implementing Medallion Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks.
- Develop reusable Databricks notebooks, data transformation components, orchestration workflows, and automated data quality checks.
- Strong experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes.
- Experience with Spark performance tuning, pipeline troubleshooting, data reconciliation, and workload optimization.
- Knowledge of data governance, metadata management, Unity Catalog, and enterprise data engineering best practices.
- For Lead Engineers: Experience in solution design, technical architecture, code reviews, mentoring, and collaboration with client architects.
- Good to have: Databricks Asset Bundles, REST APIs, and integration with enterprise data platforms.
More about this job
Responsibilities
Develop scalable data ingestion, transformation, and orchestration pipelines, reusable Databricks components, and automated data quality checks. Optimize and troubleshoot data workloads, support governance and metadata management, and, for lead-level work, contribute to architecture, code reviews, mentoring, and client collaboration.
Requirements
Requires strong hands-on experience with Azure Data Factory, Databricks, Python, PySpark, SQL, Azure services, and data pipeline development. Candidates should also have experience with orchestration, Delta Lake and Medallion Architecture, CI/CD, performance tuning, data governance, and enterprise data engineering practices.
Skills
- Azure Data Factory
- Azure Databricks
- Python
- PySpark
- SQL
- Azure Cloud Services
- Apache Airflow
- Medallion Architecture
- Delta Lake
- Data Engineering
- Azure DevOps
- Git
- CI/CD
- Spark Performance Tuning
- Unity Catalog
- Data Governance
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
Keywords
- Azure Data Factory
- Azure Databricks
- Python
- PySpark
- SQL
- Azure Cloud Services
- Apache Airflow
- Data Ingestion
- Data Transformation
- Pipeline Orchestration
- Medallion Architecture
- Delta Lake
- Reusable Data Engineering Frameworks
- Databricks Notebooks
- Data Quality Checks
- Azure DevOps
- Git
- CI/CD Pipelines
- Automated Deployment
- Spark Performance Tuning
- Pipeline Troubleshooting
- Data Reconciliation
- Workload Optimization
- Data Governance
- Metadata Management
- Unity Catalog
- Solution Design
- Technical Architecture
- Code Reviews
- Databricks Asset Bundles