Closed listing
Senior Data Engineer Azure Data Factory Developer (35968)
- Toronto, ON, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Role 1: Senior Data Engineer, Databricks / Apache Spark
Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore.
Responsibilities
- Design, develop and maintain data processing solutions using Databricks
- Develop and optimize Apache Spark jobs for data transformation and processing
- Build data ingestion and transformation workflows
- Develop scalable, reusable and unit-tested data engineering components
- Troubleshoot Databricks and Spark workloads
- Support deployment, issue resolution and enhancement activities
- Produce technical documentation and support knowledge transfer
- Strong Databricks experience
- Strong Apache Spark experience
- Data transformation and processing
- Data ingestion and pipeline development
Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore.
Responsibilities
- Design, build and maintain Azure Data Factory pipelines and workflows
- Develop ETL and data integration solutions across source and target systems
- Support integrated processing and orchestration using Databricks where required
- Configure pipeline monitoring and error handling
- Troubleshoot and optimize data movement and pipeline execution
- Support testing, deployment and operational stabilization
- Produce technical documentation and support knowledge transfer
- Strong Azure Data Factory experience
- Working knowledge of Databricks
- Data integration experience
- ETL pipeline development and support
More about this job
Responsibilities
Design, develop, maintain, and optimize Databricks and Apache Spark data processing solutions, including ingestion and transformation workflows. Build and support Azure Data Factory pipelines and ETL integrations, troubleshoot and optimize execution, and assist with testing, deployment, documentation, and knowledge transfer.
Requirements
The Databricks-focused role requires strong Databricks and Apache Spark experience, along with data transformation, processing, ingestion, and pipeline development experience. The Azure Data Factory role requires strong Azure Data Factory experience, working knowledge of Databricks, and experience developing and supporting ETL pipelines and data integrations.
Skills
- Databricks
- Apache Spark
- Azure Data Factory
- Data Transformation
- Data Processing
- Data Ingestion
- Data Pipeline Development
- ETL
- Data Integration
- Pipeline Monitoring
- Error Handling
- Troubleshooting
- Unit Testing
- Technical Documentation
- Knowledge Transfer
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Manufacturing
Keywords
- Databricks
- Apache Spark
- Azure Data Factory
- Data Engineering
- Data Integration
- ETL
- Data Transformation
- Data Processing
- Data Ingestion
- Data Pipelines
- Workflow Orchestration
- Pipeline Monitoring
- Error Handling
- Unit Testing
- Testing
- Deployment
- Operational Stabilization
- Troubleshooting
- Technical Documentation
- Knowledge Transfer
- Manufacturing