Data Engineer 1
- Langley (District), BC, Canada
- Langley Office - Langley BC, Canada
$85,062.00 - $106,328.00 · Full-time
Applications open in a new tab.
Job details
- Pay
- $85,062.00 - $106,328.00
- Job type
- Full-time
- Apply by
- Experience
- A minimum 2 years of experience in creating and managing large-scale, distributed data
- Posting language
- English
- Posted
Original job description
Come join Pattison Food Group Ltd., a Jim Pattison business, and Canada’s largest Western-based provider of food and health products.
Pattison Food Group Ltd. consists of Save-On-Foods and other well-known grocery banners. With nearly 300 retail locations, we proudly employ more than 30,000 team members.
We have an exciting opportunity for a full-time Data Engineer to join our IT team in Langley, BC.
Reporting to the Manager, Data & Analytics, you will be responsible for working with one of the largest, most comprehensive datasets in Canada while delivering and pioneering solutions that will disrupt the retail industry using the latest tools and technologies.
You will be responsible for:
Designing and constructing high-performance, scalable data pipelines to operationalize our state-of-the-art solutions ranging from quantum computing pipelines to deep learning based recommender systems
Creating innovative solutions to tackle computationally intensive challenges and business issues
Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models
Leveraging cloud environments and following best practices while building solutions in the data lake as it evolves to meet the needs of the business
Performing data wrangling, feature engineering, and dimension reduction with data of all shapes and sizes, from parquet files to images
Partnering with Machine Learning Engineers, Data Scientists, and Cloud Architects to deliver models into production
Coaching, mentoring, and providing feedback to team members and junior data engineers
Discovering novel datasets and data sources and making them available for modeling and reporting
Using your expertise in big data technologies to champion innovation, design, and implement data-stores and analytic models, oversee large-scale data lake platforms, and design and implement efficient data pipelines from source systems to data-stores
Defining and implementing Quality Assurance best practices that support the implementation of data transformations and the availability of high-quality data.
You have:
A Bachelor’s degree in a STEM discipline at minimum, a Master’s is preferred.
A minimum 2 years of experience in creating and managing large-scale, distributed data
Expertise in Python and Spark. Experience in other programming languages such as Java, Scala, or C++ is a plus
Expertise in SQL
Experience designing and deploying high-performance data processing systems with reliable data validation, monitoring, and logging practices
Rigor in high code quality, automated testing, and other engineering best practices
Experience with big data technologies such as Hadoop, Spark and Databricks
Familiarity with software development best practices, including version control, CI/CD and CAB processes
Expert knowledge of databases and modern data workloads
You are:
A strong communicator
Detail-oriented and organized
A leader with an ownership mindset
Passionate about machine learning
Able to work independently and as part of a team
What we offer
In addition to a highly competitive salary, we offer a great range of benefits, a company pension plan, free parking, exclusive team member offers, and opportunities for development and career progression.
If you’re looking to join a team that puts people first, you’re in the right place. Apply online today!
Compensation Details:
$85,062.00 - $106,328.00The compensation offered for this position will take into consideration location, education, skills, experience and other factors.
More about this job
Responsibilities
You will design and construct high-performance, scalable data pipelines to support machine learning models and business analytics. Additionally, you will collaborate with cross-functional teams to deliver innovative data solutions and mentor junior team members.
Requirements
Candidates must have a Bachelor's degree in a STEM discipline and at least 2 years of experience in managing large-scale, distributed data. Proficiency in Python, Spark, and SQL is required, along with experience in cloud environments and software development best practices.
Skills
- Python
- Spark
- SQL
- Databricks
- Data engineering
- Data pipelines
- Machine learning
- Cloud environments
- Data lake
- Big data
- Hadoop
- Scala
- Java
- C++
- CI/CD
- Quality assurance
Benefits
- Competitive salary
- Company pension plan
- Free parking
- Exclusive team member offers
- Development and career progression opportunities
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
- Retail
Keywords
- Data Engineer
- Python
- Spark
- Databricks
- SQL
- Data Pipelines
- Machine Learning
- Cloud
- Data Lake
- Hadoop
- Scala
- Java
- C++
- CI/CD
- Quality Assurance
- Data Wrangling
- Feature Engineering
- Dimension Reduction
- Big Data
- STEM
- Retail
- Analytics
- Version Control
- Data Modeling
- Distributed Systems