Movojobs
Back to results

Added

BeachHead

Sr. Azure Data Engineer-DataBricks

  • Toronto, ON, Canada

Contract

Apply About employer

Applications open in a new tab.

Job details

Job type
Contract
Apply by
Experience
7+ years' experience with Azure Data Factory, Databricks, and Azure Functions (C#)
Posting language
English
Posted

Original job description

Are you an experienced Data Analyst ready to lead transformative data projects? Apply Now!

Working with one of our top financial clients, this role calls for a Sr. Azure Data Engineer-DataBricks. This position involves working within a dynamic team to support large-scale data solutions in the asset management sector, focusing on advanced Databricks implementations, data governance, and cloud-based data platforms to enable strategic decision-making.

Responsibilities

  • Develop and maintain Azure Data Factory orchestrations with Databricks integrations
  • Configure and manage Unity Catalog for data governance and access control
  • Design and implement Delta Lake schemas and tables with appropriate security permissions
  • Load datasets from diverse sources into Databricks using ADF with Medallion architecture
  • Convert Databricks workspace from hive metastore to Unity Catalog and set up associated permissions
  • Build and optimize Delta Live Tables, ensuring performance and cost-efficiency
  • Develop deployment pipelines using Azure DevOps and GitHub Enterprise for CI/CD processes
  • Deploy and manage Azure PaaS resources such as Azure SQL, Azure Data Lake, and Synapse
  • Collaborate with team members independently and provide technical leadership
  • Support a highly regulated environment with a focus on data security, governance, and compliance
  • Troubleshoot and resolve complex data platform issues efficiently

Desired Skill-Set

  • 7+ years' experience with Azure Data Factory, Databricks, and Azure Functions (C#)
  • Deep knowledge of Python, notebooks, Spark, and pandas within Databricks
  • Expertise in Unity Catalog and data governance setup in a cloud environment
  • Experience loading datasets from various sources using ADF in a Medallion architecture
  • Proficiency in converting and managing Databricks workspace permissions and security
  • Familiarity with Delta Live Tables, cost, and performance optimization
  • Experience with Azure DevOps or GitHub for DevOps pipelines and CI/CD
  • Working knowledge of Azure Entra ID for SSO and RBAC configuration
  • Ability to work in a highly regulated industry environment with limited access
  • Strong communication skills and ability to lead small teams independently
  • Financial services industry experience is an asset

Nice to Have

  • Previous experience working with financial institutions

BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.

Privacy Policy
Apply About employer
More about this job

Responsibilities

Develop and optimize Azure-based data solutions using Data Factory, Databricks, Delta Lake, and Delta Live Tables, including data ingestion, governance, security, and workspace migration to Unity Catalog. Build CI/CD deployment pipelines, manage Azure PaaS resources, troubleshoot platform issues, and provide technical leadership in a regulated financial-services environment.

Requirements

Requires 7+ years of experience with Azure Data Factory, Databricks, and Azure Functions, along with strong Python, Spark, pandas, Unity Catalog, and data governance expertise. Candidates should also have experience with Medallion architecture, Databricks security and permissions, CI/CD, Azure Entra ID, and working independently in regulated environments; financial-services experience is an asset.

Skills

  • Azure Data Factory
  • Databricks
  • Azure Functions
  • Python
  • Apache Spark
  • Pandas
  • Unity Catalog
  • Delta Lake
  • Delta Live Tables
  • Medallion Architecture
  • Azure DevOps
  • GitHub Enterprise
  • Azure Entra ID
  • Data Governance
  • CI/CD
  • Data Security

Visa sponsorship

Not detected in the job text

Categories

  • Data & Analytics
  • Technology
  • Software
  • Finance & Accounting
  • Management & Leadership

Keywords

  • Azure Data Factory
  • Databricks
  • Azure Functions
  • C#
  • Python
  • Notebooks
  • Apache Spark
  • Pandas
  • Unity Catalog
  • Data Governance
  • Delta Lake
  • Delta Live Tables
  • Medallion Architecture
  • Azure DevOps
  • GitHub Enterprise
  • CI/CD
  • Azure SQL
  • Azure Data Lake
  • Azure Synapse
  • Azure Entra ID
  • Single Sign-On
  • Role-Based Access Control
  • Cloud Data Platforms
  • Data Security
  • Regulatory Compliance
  • Asset Management
  • Financial Services

Explore similar work

Report this job