Data Engineer (Azure)
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- Experience Required: 6-8 Years
- Posting language
- English
- Posted
Original job description
Role: Data Engineer
Contract
Work Arrangement: Hybrid (4 days/week onsite): Work Hours: 9:00 AM - 5:00 PM
Experience Required: 6-8 Years
Role Description
Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks.
Essential Skills
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Architecting ETL Frameworks
Required Skills
Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners
Strong ability to break down technical requirements into actionable tasks
Proficient with relational databases such as MS SQL and SQL scripting
Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration
Good OOP understanding with experience in Python or Java
Proficiency with Git (Bitbucket or GitHub)
Good understanding of CI/CD concepts for building and deploying artifacts
Understanding of synchronous and asynchronous data encryption/decryption
Nice To Have Skills
Azure Databricks Notebooks or Apache Spark for data transformations
Datadog dashboard and monitoring experience
Azure Data Lake Gen2
Understanding of Parquet and Delta Lake concepts
Experience with XLR for CI/CD
Experience with Flyway for data migrations
Contract
Work Arrangement: Hybrid (4 days/week onsite): Work Hours: 9:00 AM - 5:00 PM
Experience Required: 6-8 Years
Role Description
Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks.
Essential Skills
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Architecting ETL Frameworks
Required Skills
Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners
Strong ability to break down technical requirements into actionable tasks
Proficient with relational databases such as MS SQL and SQL scripting
Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration
Good OOP understanding with experience in Python or Java
Proficiency with Git (Bitbucket or GitHub)
Good understanding of CI/CD concepts for building and deploying artifacts
Understanding of synchronous and asynchronous data encryption/decryption
Nice To Have Skills
Azure Databricks Notebooks or Apache Spark for data transformations
Datadog dashboard and monitoring experience
Azure Data Lake Gen2
Understanding of Parquet and Delta Lake concepts
Experience with XLR for CI/CD
Experience with Flyway for data migrations
More about this job
Responsibilities
The role involves architecting ETL frameworks and building Azure Data Factory pipelines for data ingestion orchestration. The engineer will also coordinate with SMEs and technical partners to translate technical requirements into actionable tasks.
Requirements
Candidates need 6-8 years of experience with strong proficiency in ADF, ADB, PySpark, and SQL. Proficiency in Git, CI/CD concepts, and OOP principles in Python or Java is also required.
Skills
- Azure Data Factory
- Azure Databricks
- PySpark
- SQL
- ETL Frameworks
- Python
- Java
- Git
- CI/CD
- MS SQL
- Data Encryption
- Azure Data Lake Gen2
- Parquet
- Delta Lake
- Flyway
- Datadog
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
- Consulting
Keywords
- Azure Data Factory
- Azure Databricks
- PySpark
- SQL
- ETL
- Python
- Java
- Git
- Bitbucket
- GitHub
- CI/CD
- MS SQL
- Data Encryption
- Azure Data Lake Gen2
- Parquet
- Delta Lake
- XLR
- Flyway
- Datadog
- Apache Spark
- Data Ingestion
- Data Migration
- Information Technology
- IT Consulting