Responsibilities
Develop and validate data pipelines and ETL/ELT processes using Databricks and PySpark. Implement data quality and validation practices, automate REST API testing, and perform end-to-end and asynchronous backend testing.
Requirements
Requires 8+ years of experience in ETL, data engineering, SDET, or quality engineering, with strong hands-on Databricks and PySpark experience. Candidates should also have experience with Microsoft Azure, REST API test automation using Karate or similar tools, Kafka, end-to-end testing, and Databricks data validation frameworks.
