Data Engineer
- Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Experience
- Minimum of 2 years’ experience building and supporting production data pipelines in cloud-based environments.
- Posting language
- English
- Posted
Original job description
Pattison Food Group Ltd., a Jim Pattison business, is Canada’s largest Western-based provider of food and health products. Headquartered in British Columbia, the company has been serving communities since 1915. Pattison Food Group Ltd. comprises well-known grocery banners including Save-On-Foods, which operates nearly 300 retail locations across Western Canada and the Yukon Territory. Employing over 30,000 team members, the organization is committed to long-term growth, community engagement, and operational excellence. The group also includes four wholesale businesses, several food and pharmacy production facilities, a leading loyalty program, proprietary consumer brands, and an award-winning restaurant. Pattison Food Group is widely recognized for its leadership in customer service and innovation within the retail sector.
About The Role
We are seeking a full-time Data Engineer to join our IT team in Langley, BC. Reporting to the Team Lead, Data & Analytics, this role offers the opportunity to work with one of the largest and most comprehensive datasets in Canada. The Data Engineer will be responsible for designing, building, and maintaining scalable data solutions on modern delta lake/lakehouse platforms using Medallion Architecture. The successful candidate will develop high-performance data pipelines leveraging technologies such as Databricks, Spark, Python/PySpark, and SQL, and contribute to the delivery of innovative solutions that drive disruption in the retail industry.
Key responsibilities include developing dimensional and analytical data models, writing production scripts to support machine learning pipelines, orchestrating data ingestion and transformation processes using tools like Azure Data Factory, and applying rigorous data quality, security, and governance standards. The role requires collaboration with both technical and business partners to translate requirements into practical solutions, while optimizing pipeline performance, scalability, and cost efficiency. Troubleshooting and continuous improvement of platform and processes are also essential components of the position.
Qualifications
- Bachelor’s degree in a STEM discipline is required; a Master’s degree is preferred.
- Minimum of 2 years’ experience building and supporting production data pipelines in cloud-based environments.
- Strong proficiency in SQL and Python/PySpark with experience handling large datasets.
- Experience with Databricks, Spark, Delta Lake, or comparable modern data platforms.
- Familiarity with data pipeline orchestration tools such as Azure Data Factory or Databricks Jobs.
- Solid understanding of modern data architecture, ETL/ELT processes, data modelling, incremental processing, data quality, and production support.
- Experience with Git-based version control, automated testing, and CI/CD methodologies.
- Excellent communication skills with the ability to document solutions and collaborate effectively with technical and non-technical stakeholders.
- Build and maintain scalable, well-structured data solutions using Medallion Architecture on delta lake/lakehouse platforms.
- Design and develop high-performance, scalable data pipelines utilizing Databricks, Spark, Python/PySpark, and SQL.
- Develop dimensional and analytical data models including fact and dimension tables, slowly changing dimensions, incremental processing, and change data capture.
- Write production-level Python/Scala scripts within Spark/Databricks environments to support machine learning data pipelines.
- Orchestrate data ingestion, transformation, scheduling, monitoring, and recovery processes using Azure Data Factory or Databricks Automation Bundles.
- Implement and enforce data quality, testing, documentation, security, and governance standards throughout the development lifecycle.
- Optimize data pipelines and models for improved performance, scalability, reliability, and cost efficiency.
- Identify opportunities to simplify processing and enhance overall solution design.
- Employ version control, conduct code reviews, and follow CI/CD and release management best practices.
- Collaborate with business and technical partners to understand requirements and translate them into practical data solutions.
- Troubleshoot production issues and contribute to ongoing platform and process improvements.
- Highly competitive salary package.
- Comprehensive company pension plan.
- Free parking facilities.
- Exclusive team member offers.
- Opportunities for professional development and career progression.
- Supportive work environment that values people first.
Pattison Food Group Ltd. is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and welcome applications from individuals of all backgrounds, identities, and experiences. We do not discriminate based on race, colour, religion, gender, sexual orientation, age, disability, or any other legally protected status. Our commitment to diversity and inclusion is fundamental to our culture and business success.
More about this job
Responsibilities
Build, maintain, and optimize scalable data pipelines and analytical models using Databricks, Spark, Python/PySpark, SQL, and Medallion Architecture. Orchestrate data workflows, uphold data quality and governance standards, support machine learning pipelines, and collaborate with stakeholders to troubleshoot and improve production data solutions.
Requirements
A bachelor's degree in a STEM discipline is required, and a master's degree is preferred. Candidates need at least two years of experience supporting production data pipelines in cloud environments, proficiency in SQL and Python/PySpark, familiarity with modern data platforms and orchestration, and knowledge of data modeling, testing, version control, and CI/CD.
Skills
- SQL
- Python
- PySpark
- Scala
- Databricks
- Apache Spark
- Delta Lake
- Lakehouse Platforms
- Medallion Architecture
- Azure Data Factory
- Data Pipeline Orchestration
- Data Modeling
- ETL/ELT
- Data Quality
- Git
- CI/CD
Benefits
- Company Pension Plan
- Free Parking
- Team Member Offers
- Professional Development Opportunities
- Career Progression Opportunities
- Supportive Work Environment
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Retail
Keywords
- Databricks
- Apache Spark
- Python
- PySpark
- Scala
- SQL
- Delta Lake
- Lakehouse
- Medallion Architecture
- Azure Data Factory
- Databricks Jobs
- Automation Bundles
- Data Engineering
- Data Pipelines
- Data Ingestion
- Data Transformation
- Dimensional Modeling
- Fact Tables
- Dimension Tables
- Slowly Changing Dimensions
- Incremental Processing
- Change Data Capture
- Machine Learning Pipelines
- ETL/ELT
- Data Quality
- Data Governance
- Data Security
- Git
- Automated Testing
- CI/CD