Data Engineer
- Toronto, ON, Canada
$65 to $80 CAD / hour · Contract
Applications open in a new tab.
Job details
- Pay
- $65 to $80 CAD / hour
- Job type
- Contract
- Apply by
- Experience
- Core Technical Stack: 7+ years of hands-on development experience with Azure Data Factory (ADF), Databricks, and Azure Functions (C#).
- Posting language
- English
- Posted
Original job description
Job Title: Data Analyst - Expert (Senior Data Engineer)
Location: Once every Thursday, and 2nd Friday in Downtown, Toronto
Line of Business: Global Asset Management Technology
Duration: 6-Month Contract (Potential for extension)
Compensation: T4: $65-$70/HR | IC: $75-$80/HR
About the Role
We are looking for an Expert Data Analyst / Senior Data Engineer to join our Global Asset Management Technology team. Our business is currently undergoing a major data transformation journey, actively exploring and expanding advanced functionalities within Databricks and modern cloud ecosystems. You will work closely with a Data Engineer Lead, Senior Data Engineers, and Business Analysts to build, secure, and optimize enterprise-scale data pipelines supporting institutional execution and quantitative analysis groups.
Key Responsibilities
- Design, build, and optimize end-to-end data pipelines loading large-scale datasets from various sources into Azure Databricks using Azure Data Factory (ADF) and Medallion architecture.
- Engineered silver-layer Delta tables and views, establishing proper table design, properties, schema, and security permissions.
- Migrate Databricks workspaces from Hive Metastore to Unity Catalog, setting up associated permissions and governance configurations.
- Ensure smooth deployment and DevOps pipelines using Azure DevOps or GitHub Enterprise for both ADF and Databricks artifacts.
- Implement Azure Entra ID for Single Sign-On (SSO) and Role-Based Access Control (RBAC).
- Deploy to and manage Azure PaaS resources (such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, and Synapse dedicated SQL databases) in a locked-down, highly regulated windows environment.
- Lead technical problem-solving sessions and guide a small team independently with minimal supervision.
Key Requirements & Qualifications
- Core Technical Stack: 7+ years of hands-on development experience with Azure Data Factory (ADF), Databricks, and Azure Functions (C#).
- Development & Coding: In-depth development experience using Python, notebooks, PySpark, and Pandas on Databricks.
- Governance & Architecture: Expert working knowledge of Unity Catalog and data governance setup, alongside Medallion architecture.
- Cloud & DevOps: In-depth experience with Azure Entra ID (SSO/RBAC), Azure PaaS resources, and CI/CD deployment pipelines (Azure DevOps/GitHub Enterprise).
- Environment: Proven ability to work independently in a locked-down, highly regulated financial services or enterprise environment.
- Nice-to-Haves: Experience with Delta Live Tables, previous Tier-1 financial institution/CIBC background, and strong communication skills.
More about this job
Responsibilities
Design, build, and optimize enterprise data pipelines using Azure Data Factory and Databricks, including Delta tables, governance, security, and migration to Unity Catalog. Manage Azure resources and CI/CD deployments, and lead technical problem-solving while guiding a small team.
Requirements
Requires 7+ years of hands-on experience with Azure Data Factory, Databricks, and Azure Functions, plus strong development skills in Python, PySpark, and Pandas. Candidates should have expertise in Unity Catalog, Medallion architecture, Azure identity and access controls, Azure PaaS, and CI/CD, with the ability to work independently in a regulated enterprise environment.
Skills
- Azure Data Factory
- Databricks
- Azure Functions
- Python
- PySpark
- Pandas
- Unity Catalog
- Medallion Architecture
- Azure Entra ID
- Single Sign-On
- Role-Based Access Control
- Azure DevOps
- GitHub Enterprise
- Delta Live Tables
- Data Governance
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Finance & Accounting
- Management & Leadership
Keywords
- Azure Data Factory
- Databricks
- Azure Functions
- Python
- PySpark
- Pandas
- Delta Tables
- Unity Catalog
- Hive Metastore
- Medallion Architecture
- Azure Entra ID
- Single Sign-On
- Role-Based Access Control
- Azure DevOps
- GitHub Enterprise
- CI/CD
- Azure SQL
- Azure Data Lake Storage
- Azure Synapse Analytics
- Delta Live Tables
- Data Pipelines
- Data Governance
- Cloud Computing
- Financial Services
- Quantitative Analysis
- Institutional Execution
- Data Transformation