Position: Databricks Engineer
Location: Mississauga, ON
Work Type: Onsite
Salary: CAD $110k- $115k/Annually
Mandatory Skills:
- Azure Databricks
- PySpark Apache Spark
- Python
- SQL
- Azure Data Factory ADF
- Delta Lake Delta Live Tables DLT
- Unity Catalog
- Azure Data Lake Storage ADLS Gen2
- Databricks Workflows
- CICD using Azure DevOps Git
- Data Engineering ETLELT Data Warehousing
Good to Have Skills:
- Scala
- Azure Synapse Analytics
- Snowflake
- Airflow
- Databricks Asset Bundles
- Auto Loader
- Terraform
- Lakehouse Medallion Architecture
- Data Governance Security
- Gen AI RAG Vector Search LLM Integrations
Role Summary
- Lead the design development and optimization of enterprise scale data platforms using Azure Databricks Drive architecture mentor teams implement scalable data pipelines and ensure performance governance and operational excellence across Azure based data solutions
- Explain how you have implemented Delta Lake Delta Live Tables DLT and Unity Catalog in a production Azure Databricks environment What business challenges were addressed
- Describe an enterprise scale PySpark based ETLELT solution you designed How did you optimize performance scalability and cost
- How have you implemented CICD pipelines for Databricks deployments using Azure DevOps and Git Describe the deployment strategy branching model and release process used.
“We are an equal opportunity employer. It is our policy to provide employment, compensation, and other benefits related to employment without regard to race, color, religion, sex, gender, national or ethnic origin, disability, veteran status, age, genetic information, citizenship, or any other basis prohibited by applicable federal, state, or local law.”