Databricks Engineer

Position: Databricks Engineer

Location: Mississauga, ON

Work Type: Onsite

Salary: CAD $110k- $115k/Annually

Mandatory Skills:

• Azure Databricks
• PySpark Apache Spark
• Python
• SQL
• Azure Data Factory ADF
• Delta Lake Delta Live Tables DLT
• Unity Catalog
• Azure Data Lake Storage ADLS Gen2
• Databricks Workflows
• CICD using Azure DevOps Git
• Data Engineering ETLELT Data Warehousing

Good to Have Skills:

• Scala
• Azure Synapse Analytics
• Snowflake
• Airflow
• Databricks Asset Bundles
• Auto Loader
• Terraform
• Lakehouse Medallion Architecture
• Data Governance Security
• Gen AI RAG Vector Search LLM Integrations

Role Summary

• Lead the design development and optimization of enterprise scale data platforms using Azure Databricks Drive architecture mentor teams implement scalable data pipelines and ensure performance governance and operational excellence across Azure based data solutions
• Explain how you have implemented Delta Lake Delta Live Tables DLT and Unity Catalog in a production Azure Databricks environment What business challenges were addressed
• Describe an enterprise scale PySpark based ETLELT solution you designed How did you optimize performance scalability and cost
• How have you implemented CICD pipelines for Databricks deployments using Azure DevOps and Git Describe the deployment strategy branching model and release process used.

“We are an equal opportunity employer. It is our policy to provide employment, compensation, and other benefits related to employment without regard to race, color, religion, sex, gender, national or ethnic origin, disability, veteran status, age, genetic information, citizenship, or any other basis prohibited by applicable federal, state, or local law.”