Sr. Data Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- 6 years of related experience.
- Posting language
- English
- Posted
Original job description
Livingston moves goods across a complex, high-velocity supply chain, and data is at the heart of how we plan, route, and optimize that movement. We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure that powers logistics operations, and executive decision-making. The ideal candidate must have experience in building end-to-end data pipelines in GCP.
Reporting to the Director, IT, this role is a technical anchor within the Data & Analytics function. You'll partner closely with Operations, Supply Chain Planning, Finance, internal IT and Business Intelligence teams to turn high-volume, time-sensitive logistics data into reliable, well-governed and intelligent data products. This is an opportunity to shape data architecture and engineering for a growing organization where data quality and speed directly affect the movement of freight and the customer experience.
Job Duties:
- Design, build, and maintain scalable ETL/ELT pipelines that ingest data from transportation management (TMS), ERP, EDI, and telematics/IoT sources.
- Architect and optimize data models and data warehouse/lakehouse structures to support reporting, forecasting, advanced analytics and AI.
- Build and maintain the infrastructure required to support near-real-time visibility into shipments, inventory, and performance.
- Establish and enforce metadata, data quality, validation, and reconciliation processes across high-volume logistics data feeds.
- Partner with data analysts, data scientists, and BI developers to ensure data is modeled and delivered in a way that supports self-serve reporting and predictive modeling.
- Implement and maintain data governance, lineage, security, and access control practices in line with company policy and regulatory requirements.
- Optimize pipeline performance and cost across cloud data platforms, monitoring for reliability, latency, and scalability as data volumes grow.
- Collaborate with the Director, IT and cross-functional stakeholders to translate business requirements (e.g., optimization, performance, demand forecasting, Portal integrations, etc.) into technical data solutions.
- Provide technical mentorship to junior and intermediate data engineers, and contribute to engineering standards, documentation, and code review practices.
- Support the evaluation and integration of new data tools, platforms, and vendor systems.
- Participate in on-call rotation and incident response for critical data pipeline issues affecting operational reporting.
- Be hands-on with data architecture and engineering functions
Knowledge and skills:
- 6 years of related experience. Strong proficiency in SQL and other programming languages commonly used in data engineering (e.g., Python, Apache).
- Hands-on experience with modern cloud data platforms (e.g., GCP and / or AWS) and associated data services (e.g., Redshift, BigQuery, Composer, Airflow, Knowledge Catalog, BQ Products, BQ Conversational AI).
- Experience building and orchestrating pipelines in GCP.
- Experience in multiple industries, methodologies and architectures
- Strong experience in organizations that have gone / going through technology transformation
- Hands-on experience with EDI, APIs, or data integration tools is a strong asset.
- Working knowledge of streaming/real-time data technologies (e.g., Kafka, Pub/Sub) is required.
- Strong grasp of data governance, security, and privacy best practices.
- Excellent communication skills, with the ability to translate technical concepts for non-technical, senior stakeholders.
More about this job
Responsibilities
Design, build, and maintain scalable data pipelines and cloud data infrastructure for logistics operations, reporting, forecasting, and analytics. Establish data quality, governance, security, and performance practices while collaborating with business and technical teams, mentoring engineers, and supporting critical pipeline incidents.
Requirements
Requires six years of related experience, strong SQL and programming skills, and hands-on experience building and orchestrating data pipelines in GCP or other modern cloud platforms. Candidates should also have experience with real-time data technologies, data governance and security, and the ability to communicate technical concepts to senior non-technical stakeholders.
Skills
- SQL
- Python
- GCP
- AWS
- BigQuery
- Redshift
- Composer
- Airflow
- ETL/ELT Pipelines
- Data Modeling
- Data Warehousing
- Data Governance
- Data Quality
- EDI
- APIs
- Kafka
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Logistics
- Transportation
Keywords
- GCP
- AWS
- SQL
- Python
- Apache
- BigQuery
- Redshift
- Composer
- Airflow
- Knowledge Catalog
- BigQuery Conversational AI
- ETL/ELT
- Data Pipelines
- Data Warehousing
- Lakehouse
- Data Modeling
- ERP
- EDI
- Telematics
- IoT
- APIs
- Kafka
- Pub/Sub
- Data Governance
- Data Lineage
- Data Security
- Data Quality
- Real-Time Data
- Demand Forecasting