Senior Data Engineer
- Ottawa, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
- Posting language
- English
- Posted
Original job description
Location: Ottawa/Toronto (Hybrid)
Duration: 12+ Months
Job Description:
This position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems
Skills:
- 5+ years - SQL Server based development of large datasets
- 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
- Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
- Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
- Minimally a BA degree within an engineering and/or computer science discipline
- Master’s degree strongly preferred
More about this job
Responsibilities
Develop and deploy enterprise-scale ETL pipelines using Databricks and PySpark, working with large datasets and SQL Server. Contribute architectural and design expertise to enterprise cloud data platform migration and data warehousing initiatives.
Requirements
Requires at least five years of SQL Server development with large datasets and experience developing and deploying Databricks PySpark ETL pipelines. Candidates should have cloud data warehouse and data modeling experience, strong architecture and design skills, and at least a bachelor's degree in engineering or computer science; a master's degree is strongly preferred.
Skills
- Python
- PySpark
- SQL
- SQL Server
- Databricks
- ETL Pipelines
- Cloud Data Warehousing
- Synapse
- BigQuery
- Redshift
- Snowflake
- Data Warehousing
- OLTP
- OLAP
- Data Modeling
- Cloud Data Platform Migration
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
Keywords
- Python
- PySpark
- SQL
- SQL Server
- Databricks
- ETL Pipelines
- Cloud Data Warehouse
- Synapse
- BigQuery
- Redshift
- Snowflake
- Data Warehousing
- OLTP
- OLAP
- Dimensions
- Facts
- Data Modeling
- Cloud Data Platform Migration
- Enterprise Systems
- Architecture
- Design
- Large Datasets
- Engineering
- Computer Science