Data Engineer (Databricks / Apache Spark)
Contract Term: 7 months, renewal
Work Location: Toronto, ON. hybrid
Service Description: Provide data engineering services to design, develop, and optimize data processing solutions using Databricks and Apache Spark. Support the development of scalable data transformation and processing capabilities to meet project requirements.
Role Description
- Design, develop, and maintain data processing solutions using Databricks.
- Develop and optimize Apache Spark jobs for data transformation and processing.
- Collaborate with project team members to support data engineering requirements and delivery activities.
- Troubleshoot and resolve issues related to Databricks and Spark workloads.
- Support the implementation and enhancement of data pipelines and data processing frameworks.
Deliverables
- Databricks notebooks and data processing solutions.
- Apache Spark data transformation jobs.
- Data ingestion and transformation workflows.
- Optimized and reusable data engineering code.
- Unit-tested data processing components.
- Technical documentation of implemented data engineering solutions.
- Support for deployment and issue resolution activities.
Required Qualifications / Experience
- Strong experience with Databricks
- Strong experience with Apache Spark
