Responsibilities
Design, develop, and maintain scalable data pipelines and workflows using Databricks, Python, and SQL, integrating data from Azure and Oracle databases. Ensure data quality and pipeline performance, troubleshoot processing issues, and collaborate with stakeholders while following security, governance, and documentation practices.
Requirements
Requires 5–7 years of data engineering or data development experience, strong hands-on Databricks experience, and proficiency in Python, SQL, Azure database technologies, and Oracle Database. Experience with ETL/ELT, data integration and transformation is required; exposure to AI or machine learning, Spark, PySpark, Delta Lake, and Azure data services is preferred.
