Databricks Lead – Python, PySpark, SQL & Supply Chain Analytics
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Work location
- Work Model: Hybrid (3 days per week in office)
- Experience
- Experience Required: 6-8 Years
- Posting language
- English
- Posted
Original job description
Databricks Lead – Python, PySpark, SQL & Supply Chain Analytics
Experience Required: 6-8 Years
Location: Toronto / Edmonton / Calgary
Work Model: Hybrid (3 days per week in office)
Role Summary
Seeking a Databricks Lead with strong expertise in Databricks to design, build, and operationalize scalable Supply Chain data products that deliver measurable business value. This role combines advanced analytics, data pipeline development, and product delivery to transform complex Supply Chain Management (SCM) data into trusted, governed, and actionable insights.
Key Responsibilities
Develop analytics solutions that address Supply Chain business challenges, leveraging knowledge of oil & gas operations, procurement, supplier performance, spend analytics, and enterprise value drivers.
Design, build, test, and optimize scalable ETL/ELT pipelines in Databricks using Python, PySpark, SQL, notebooks, jobs, and orchestration patterns to support reliable Silver and Gold data products.
Transform and model data from ERP and enterprise platforms, including Oracle Cloud, SAP, ADW, Microsoft Dataflow, Dataverse, and other approved data sources.
Build and evaluate machine learning, statistical, and AI-assisted solutions, including:
Classification
Forecasting
Anomaly Detection
Text Analytics
Natural Language Processing (NLP)
Utilize Databricks platform capabilities such as:
Notebooks
Jobs
Workflows
Unity Catalog
SQL Warehouses
Genie Code
Lakeflow / Lakeflow Designer
Maintain project documentation, including idea assessments, requirements, design documents, and weekly status reports.
Communicate technical concepts, requirements, solution designs, and product details effectively to business stakeholders in clear, non-technical language.
Required Skills
Databricks
Python
PySpark
SQL / Oracle SQL
Data Architecture & Data Modeling
ETL / ELT Pipeline Development
Machine Learning
Supply Chain Analytics
Data Integration and Data Transformation
Preferred Domain Experience
Supply Chain Management (SCM)
Oil & Gas Industry
Procurement Analytics
Supplier Performance Analytics
Spend Analytics
More about this job
Responsibilities
The Databricks Lead at Astra North Infoteck Inc. will build and operate data pipelines and analytics products for supply chain data. They will also model data from enterprise systems, develop machine learning solutions, and explain technical work to business stakeholders.
Requirements
Candidates need 6 to 8 years of experience, strong Databricks, Python, PySpark and SQL skills, and knowledge of data modeling and supply chain analytics. Experience in oil and gas, procurement or spend analytics is preferred.
Skills
- Databricks
- Python
- PySpark
- SQL
- Oracle SQL
- Databricks Notebooks
- Databricks Jobs
- Databricks Workflows
- Unity Catalog
- Databricks SQL Warehouses
- Genie Code
- Lakeflow Designer
- ETL/ELT Pipeline Development
- Data Architecture
- Data Modeling
- Data Integration
- Data Transformation
- Machine Learning
- Classification
- Forecasting
- Anomaly Detection
- Natural Language Processing
- Text Analytics
- Supply Chain Analytics
- Procurement Analytics
Categories
- Technology
- Data & Analytics
- Software
- Energy
- Consulting
Keywords
- Databricks
- Python
- PySpark
- SQL
- Oracle SQL
- Databricks Lakeflow
- Unity Catalog
- Databricks Workflows
- ETL
- ELT
- Data Pipeline
- Data Modeling
- Data Architecture
- Machine Learning
- Forecasting
- Anomaly Detection
- NLP
- Supply Chain Analytics
- Procurement Analytics
- Spend Analytics
Seniority
Senior
Tools
- Databricks
- Python
- PySpark
- SQL
- Oracle SQL
- Unity Catalog
- Lakeflow Designer
- Oracle Cloud
- SAP
- Dataverse
Languages
- English