Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 24 mins ago
BT
SharePoint .NET Developer
BULL TECHNICAL SERVICES LIMITED
Montreal, QC
- Full-time
Integrate SharePoint Online, Microsoft 365, and Microsoft Graph APIs using secure Azure AD authentication.
Added 54 mins ago
LI
Systems Testing/QA Specialist
Lotus IT Solutions
Enterprise, ON
- Contract
Identify, document, and track software defects using tools such as ALM, JIRA, Bugzilla, and Azure DevOps; work closely with developers to reproduce and resolve issues
Added 1 hour ago
M
Software Engineer
Microsoft
Vancouver, BC
- Full-time
Microsoft’s Azure Data engineering team is leading the transformation of analytics and data with products including Microsoft Fabric, Azure SQL Database, Azure Cosmos DB, Azure Database for…
Added 1 hour ago
M
Cloud Solution Architect / Cloud + AI Platform Full-time LOA backfill
Microsoft
Toronto, ON
- Full-time
Maintain technical intensity through continuous skilling and certifications in priority workloads such as Azure SQL, PostgreSQL, AKS, App Service, AVS, SAP (Native + RISE), Windows, Linux…
Added 1 hour ago
M
Azure Digital Solution Area Specialist- Oil & Gas
Microsoft
Calgary, AB · Vancouver, BC · Goodwood, ON
- Full-time
…career. Together, we are shaping the future of business. As a Azure Digital Solution Area Specialist you will be a solution sales leader within our mid-market sales organization working…
Added 1 hour ago
E
Junior AI Developer
Ericsson
Ottawa, ON
- Full-time
…verification efficiency. We are looking for a passionate Junior AI Developer who wants to apply AI and software development skills to real-world engineering challenges while learning from…
Added 1 hour ago
TD
Service Delivery Manager
Terra Dygital
Toronto, ON
- $115,000 to $130,000 CAD / year
- Full-time
As a Service Delivery Manager, you are a hands-on technical leader who earned credibility as a Senior System Administrator before moving into people management. You own the quality of…
Added 1 hour ago
M
Data Valuation Analyst
Maarut
Montréal-Est, QC · Montreal, Quebec
- Contract
supports the developer in configuring the data mart, without owning core
Added 2 hours ago
HG
Software Architect– Azure & Application Modernization
Hanalytica GmbH
Canada
- Contract
Software Architect – Azure & Application Modernization
Added 2 hours ago
KA
Senior Databricks Engineer
KData AI
Toronto, ON
- Full-time
…enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines, implement robust governance and security controls via…
Added 2 hours ago
PC
Azure Data Consultant, Senior Associate
PwC Canada
Toronto, ON
- Full-time
As a Senior Associate, Azure Data Engineer, you will play a key role in designing and building data solutions on Azure. You will work closely with project teams to deliver high-quality data…
Added 2 hours ago
OA
Product Software Developer
OpenRoad Auto
Richmond, BC
- Full-time
Build applications and integrations within Microsoft/Azure tenant environments.
Added 2 hours ago
A
Quality Assurance (QA) Analyst
Affinity
Burnaby, BC
- Contract
…reliability, reduce rework, and support efficient use of business and technical…
Added 2 hours ago
M
Lead Full Stack Engineer
Manulife
Toronto, ON · Waterloo, ON
- Full-time
As a Lead Full Stack Engineer, you will shape the technical direction for your area, lead complex engineering programs across multiple teams, and establish standards for how solutions are…
Added 3 hours ago
PE
Software Developer
PRI Engineering
Mississauga, ON
- Full-time
…internal applications: business systems that run the firm, and technical tools that support our engineering and environmental practices. They run on our own Azure platform and integrate…
Added 3 hours ago
I
Cyber Security Consultant
Infosys
Ottawa, ON
- Full-time
…This position will interface with key stakeholders and apply technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation,…
Added 3 hours ago
R
IT Systems Administrator
Remarcable
Vancouver, BC
- $91,000 to $119,000 CAD / year
- Full-time
The ideal candidate is a proven problem solver who is proactive, responsive, and familiar with Mac and Windows environments, Google Workspace, Microsoft Azure, and cybersecurity standards.
Added 3 hours ago
E
Junior AI Developer
Ericsson
Ottawa, ON
- Full-time
…verification efficiency. We are looking for a passionate Junior AI Developer who wants to apply AI and software development skills to real-world engineering challenges while learning from…
Added 3 hours ago
M
Lead Full Stack Engineer
Manulife
Waterloo, ON
- Full-time
As a Lead Full Stack Engineer, you will shape the technical direction for your area, lead complex engineering programs across multiple teams, and establish standards for how solutions are…
Added 3 hours ago
I
Technology Analyst - GenAI
Infosys
Mississauga, ON
- Full-time
…frameworks. This role is ideal for an engineer with strong technical depth, a passion for building AI-powered applications, and experience delivering production-grade GenAI solutions in a…
Added 3 hours ago
D
Software Developer
dormakaba
Montreal, QC
- Full-time
dormakaba is seeking an experienced Software Developer based in Montreal, specializing in backend development with deep expertise in Node.js and TypeScript. The Software developer will be…
Added 3 hours ago
I
Technology Lead - GenAI Lead
Infosys
Mississauga, ON
- Full-time
…frameworks. This role is ideal for a mid-level engineer with strong technical depth, a passion for building, and the ability to lead small teams or workstreams in a fast-paced,…
Added 3 hours ago
PE
Software Developer
PRI Engineering
Calgary, AB
- Full-time
…internal applications: business systems that run the firm, and technical tools that support our engineering and environmental practices. They run on our own Azure platform and integrate…
Added 3 hours ago
PE
Junior Software Developer
PRI Engineering
Mississauga, ON
- Full-time
…internal applications: business systems that run the firm, and technical tools that support our engineering and environmental practices. They run on our own Azure platform and integrate…
Added 3 hours ago
PE
Junior Software Developer
PRI Engineering
Calgary, AB
- Full-time
…internal applications: business systems that run the firm, and technical tools that support our engineering and environmental practices. They run on our own Azure platform and integrate…

KData AI

Senior Databricks Engineer

Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Dec 2, 2026
Posting language: English
Posted: Nov 2, 2026

Original job description

Role Overview

We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines, implement robust governance and security controls via Unity Catalog, drive platform-wide performance tuning and FinOps initiatives, and mentor engineering talent across the data organization.

Key Responsibilities

Lakehouse Architecture & Modeling: Spearhead the end-to-end technical design and implementation of highly scalable lakehouse pipelines adhering to the Medallion Architecture (Bronze, Silver, Gold), dimensional modeling principles, and robust Change Data Capture (CDC) patterns.
Pipeline Development & Orchestration: Build high-throughput, fault-tolerant batch and real-time streaming ingestion pipelines using PySpark, Spark SQL, Delta Lake, Auto Loader, and Databricks Workflows / Lakeflow Jobs.
Performance Tuning & FinOps Leadership: Profile workloads, analyze execution plans, and optimize compute configurations to drive down runtimes and minimize Databricks Unit (DBU) consumption using liquid clustering, Photon, serverless compute, and automated table maintenance (OPTIMIZE, VACUUM).
Enterprise Governance & Security: Architect and enforce fine-grained access control policies (row/column-level security, data masking), data lineage tracking, and auditing using Databricks Unity Catalog across multi-workspace and multi-region environments.
DevOps, IaC & CI/CD: Establish automated deployment pipelines, testing frameworks, and code promotion standards using Databricks Asset Bundles (DABs), Terraform, and CI/CD tools (GitHub Actions, Azure DevOps, or GitLab CI).
Technical Mentorship & Cross-Functional Alignment: Serve as the subject matter expert on the Databricks ecosystem, establishing code quality benchmarks, leading architecture reviews, and mentoring mid-to-senior engineers while partnering closely with Analytics and Machine Learning teams.

Requirements

Required Qualifications

Experience: 8+ years of hands-on software and data engineering experience, with at least 5+ years of dedicated, deep technical experience architecting and building production-grade solutions on the Databricks platform.
Core Languages: Advanced, expert-level proficiency in Python (PySpark, Spark Core) and Advanced SQL (complex analytical queries, window functions, and physical query execution plan tuning).
Lakehouse Internals: Deep operational mastery of Delta Lake internals (ACID guarantees, transaction logs, data skipping, Z-ordering/liquid clustering, compaction, and schema evolution) along with Structured Streaming.
Cloud Architecture & Networking: Substantial production experience across cloud storage and networking architectures (AWS, Azure, or GCP), including private link, VPC peering/vNet injection, IAM roles, and secure storage access patterns (e.g., ADLS Gen2, AWS S3).
Governance & Access Management: Proven track record designing and managing Databricks Unity Catalog at scale (catalogs, schemas, volumes, external locations, privilege inheritance, and metastore integrations).
Software Engineering Rigor: Strong background in enterprise-level version control workflows (Git), automated unit/integration testing (TDD), modular software design, and automated CI/CD practices.

Preferred Qualifications

Certifications: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.
Infrastructure as Code (IaC): Production experience provisioning workspaces, clusters, and access permissions using Terraform.
Modern Data Stack: Practical experience with dbt (dbt-databricks), Apache Kafka, Azure Event Hubs, Delta Live Tables (DLT), or MLflow integration.
BI & Consumption Layer: Hands-on experience optimizing Databricks Serverless SQL Warehouses for downstream consumption tools such as Power BI, Tableau, or Looker.

Apply About employer

More about this job

Responsibilities

Architect and build scalable lakehouse solutions and reliable batch and streaming pipelines, while implementing governance, security, and performance and cost optimizations. Establish deployment and testing practices, lead technical reviews, and mentor engineers while collaborating with analytics and machine learning teams.

Requirements

Requires 8+ years of software and data engineering experience, including at least 5+ years building production Databricks solutions, with expert Python/PySpark and advanced SQL skills. Candidates should have deep Delta Lake and Structured Streaming expertise, cloud networking and storage experience, Unity Catalog governance knowledge, and strong software engineering, testing, Git, and CI/CD practices.

Skills

Databricks
PySpark
Python
Spark SQL
Advanced SQL
Delta Lake
Structured Streaming
Unity Catalog
Lakehouse Architecture
Data Modeling
Change Data Capture
Terraform
CI/CD
Cloud Architecture
Performance Tuning
Technical Mentorship

Visa sponsorship

Not detected in the job text

Keywords

Databricks
PySpark
Python
Spark Core
Spark SQL
Delta Lake
Structured Streaming
Unity Catalog
Medallion Architecture
Change Data Capture
Auto Loader
Databricks Workflows
Lakeflow Jobs
Photon
Liquid Clustering
Databricks Asset Bundles
Terraform
GitHub Actions
Azure DevOps
GitLab CI
AWS
Azure
Google Cloud Platform
ADLS Gen2
Amazon S3
dbt
Apache Kafka
Azure Event Hubs
Delta Live Tables
MLflow

Report this job