Closed listing
Senior Data Engineer Azure Data Factory Developer (35968)
- Toronto, ON, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Role 1: Senior Data Engineer, Databricks / Apache Spark
Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore.
Responsibilities
- Design, develop and maintain data processing solutions using Databricks
- Develop and optimize Apache Spark jobs for data transformation and processing
- Build data ingestion and transformation workflows
- Develop scalable, reusable and unit-tested data engineering components
- Troubleshoot Databricks and Spark workloads
- Support deployment, issue resolution and enhancement activities
- Produce technical documentation and support knowledge transfer
- Strong Databricks experience
- Strong Apache Spark experience
- Data transformation and processing
- Data ingestion and pipeline development
Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore.
Responsibilities
- Design, build and maintain Azure Data Factory pipelines and workflows
- Develop ETL and data integration solutions across source and target systems
- Support integrated processing and orchestration using Databricks where required
- Configure pipeline monitoring and error handling
- Troubleshoot and optimize data movement and pipeline execution
- Support testing, deployment and operational stabilization
- Produce technical documentation and support knowledge transfer
- Strong Azure Data Factory experience
- Working knowledge of Databricks
- Data integration experience
- ETL pipeline development and support
More about this job
Responsibilities
Design, develop, and maintain scalable data processing, ingestion, transformation, and ETL solutions using Databricks, Apache Spark, and Azure Data Factory. Troubleshoot and optimize workloads and pipelines, support testing, deployment, and operational stabilization, and provide technical documentation and knowledge transfer.
Requirements
The roles require strong experience with Databricks and Apache Spark for the data engineering position, or strong Azure Data Factory experience for the ETL and integration position. Relevant capabilities include data ingestion, transformation, pipeline development, data integration, and, for the Azure Data Factory role, working knowledge of Databricks.
Skills
- Databricks
- Apache Spark
- Azure Data Factory
- Data Transformation
- Data Processing
- Data Ingestion
- Data Pipeline Development
- ETL
- Data Integration
- Pipeline Orchestration
- Pipeline Monitoring
- Error Handling
- Unit Testing
- Troubleshooting
- Technical Documentation
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Manufacturing
Keywords
- Databricks
- Apache Spark
- Azure Data Factory
- Data Engineering
- ETL
- Data Integration
- Data Ingestion
- Data Transformation
- Data Processing
- Data Pipelines
- Workflow Orchestration
- Pipeline Monitoring
- Error Handling
- Unit Testing
- Troubleshooting
- Deployment
- Operational Stabilization
- Technical Documentation
- Knowledge Transfer
- Manufacturing