We are looking for a GCP Senior Data Engineer – Lead with strong hands-on data engineering expertise and proven experience leading onshore/offshore data engineering teams.
⚠️ This is a Lead position, not a Senior Data Engineer individual contributor role. Candidates without team leadership experience will not be considered.
🔹 Required Skills
- Experience leading data engineering teams, including onshore/offshore teams
- Strong hands-on experience with GCP
- BigQuery, Dataflow, Dataproc, Pub/Sub, Composer/Airflow
- Strong SQL and Python
- Experience with Java/Scala
- Distributed processing with Apache Spark and Apache Beam
- Strong Terraform / Infrastructure-as-Code experience
- CI/CD and Git
🔹 Key Responsibilities
- Build and optimize ETL/ELT pipelines using Dataflow, Apache Beam, Dataproc, Spark and Pub/Sub
- Architect and manage BigQuery, Cloud Storage and Data Fusion
- Lead a team of approximately 10 data engineers
- Conduct code reviews and establish engineering standards
- Implement CI/CD, monitoring and logging
- Optimize pipeline performance, BigQuery queries and GCP costs
- Work with data architects, data scientists and analysts
- Implement data quality, lineage and metadata management
- Support advanced analytics and ML use cases
🔹 Nice to Have
- GCP Professional Data Engineer certification
- Real-time/streaming data processing
- Vertex AI experience
- Multi-cloud experience
- dbt experience
