Databricks Lead
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
SCM Data & Innovation Analytics is seeking a Databricks Lead with strong expertise in Databricks to design, build, and operationalize scalable Supply Chain data products that deliver measurable business value. This role combines advanced analytics, data pipeline development, and product delivery to transform complex Supply Chain Management (SCM) data into trusted, governed, and actionable insights.
Key Responsibilities
Develop analytics solutions that address Supply Chain business challenges, leveraging knowledge of oil & gas operations, procurement, supplier performance, spend analytics, and enterprise value drivers.
Design, build, test, and optimize scalable ETL/ELT pipelines in Databricks using Python, PySpark, SQL, notebooks, jobs, and orchestration patterns to support reliable Silver and Gold data products.
Transform and model data from ERP and enterprise platforms, including Oracle Cloud, SAP, ADW, Microsoft Dataflow, Dataverse, and other approved data sources.
Build and evaluate machine learning, statistical, and AI-assisted solutions, including:
Communicate technical concepts, requirements, solution designs, and product details effectively to business stakeholders in clear, non-technical language.
Required Skills
Databricks
Python
PySpark
SQL / Oracle SQL
Data Architecture & Data Modeling
ETL / ELT Pipeline Development
Machine Learning
Supply Chain Analytics
Data Integration and Data Transformation
Key Responsibilities
Develop analytics solutions that address Supply Chain business challenges, leveraging knowledge of oil & gas operations, procurement, supplier performance, spend analytics, and enterprise value drivers.
Design, build, test, and optimize scalable ETL/ELT pipelines in Databricks using Python, PySpark, SQL, notebooks, jobs, and orchestration patterns to support reliable Silver and Gold data products.
Transform and model data from ERP and enterprise platforms, including Oracle Cloud, SAP, ADW, Microsoft Dataflow, Dataverse, and other approved data sources.
Build and evaluate machine learning, statistical, and AI-assisted solutions, including:
- Classification
- Forecasting
- Anomaly Detection
- Text Analytics
- Natural Language Processing (NLP)
- Notebooks
- Jobs
- Workflows
- Unity Catalog
- SQL Warehouses
- Genie Code
- Lakeflow / Lakeflow Designer
Communicate technical concepts, requirements, solution designs, and product details effectively to business stakeholders in clear, non-technical language.
Required Skills
Databricks
Python
PySpark
SQL / Oracle SQL
Data Architecture & Data Modeling
ETL / ELT Pipeline Development
Machine Learning
Supply Chain Analytics
Data Integration and Data Transformation
More about this job
Responsibilities
Design, build, test, and optimize scalable Databricks data pipelines and governed Silver and Gold data products using supply chain and enterprise data. Develop analytics and machine learning solutions, operationalize data products, document project work, and communicate designs and requirements to business stakeholders.
Requirements
The role requires strong Databricks expertise, including Python, PySpark, SQL, data architecture and modeling, and ETL/ELT pipeline development. It also calls for machine learning, data integration and transformation, and supply chain analytics knowledge.
Skills
- Databricks
- Python
- PySpark
- SQL
- Oracle SQL
- Data Architecture
- Data Modeling
- ETL/ELT Pipeline Development
- Machine Learning
- Supply Chain Analytics
- Data Integration
- Data Transformation
- Statistical Analysis
- Natural Language Processing
- Forecasting
- Anomaly Detection
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Logistics
- Energy
Keywords
- Databricks
- Python
- PySpark
- SQL
- Oracle SQL
- Data Architecture
- Data Modeling
- ETL
- ELT
- Supply Chain Management
- Supply Chain Analytics
- Oil and Gas Operations
- Procurement
- Supplier Performance
- Spend Analytics
- Machine Learning
- Classification
- Forecasting
- Anomaly Detection
- Text Analytics
- Natural Language Processing
- Oracle Cloud
- SAP
- ADW
- Microsoft Dataflow
- Dataverse
- Unity Catalog
- Databricks Workflows
- SQL Warehouses
- Lakeflow