Closed listing
GCP Senior Data Engineer
- Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
About the Role
We are looking for a hands-on Data Engineering Lead to run a team of 10 engineers, both onshore and offshore, building cloud data platforms on Google Cloud. This is a leadership role, not a senior individual contributor position. You will set technical direction, review code, and make sure the team delivers reliable, cost-efficient data pipelines.
What You'll Do
- Build pipelines: Design and improve ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub and Cloud Functions
- Own the data platform: Architect and manage BigQuery, Cloud Storage and Data Fusion for ingesting, transforming and storing data
- Lead the team: Guide a team of 10 engineers, review code, and set standards for data engineering, CI/CD and monitoring (Cloud Monitoring, Logging)
- Tune performance and cost: Improve pipeline speed and query efficiency, and control GCP spend through practices like slot reservations and partitioning
- Partner across teams: Work with data architects, data scientists and analysts to deliver self-service data platforms and support advanced analytics and ML use cases
- Protect data quality: Put data validation, lineage and metadata management in place using tools such as Data Catalog and dbt
Required Skills
- Leadership: Proven experience leading data engineering teams across onshore and offshore locations. Candidates without team leadership experience will not be considered.
- Core technical skills: SQL, Python, Java or Scala, and distributed systems such as Spark and Beam
- GCP expertise: Hands-on work with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow) and Terraform
- DevOps: Familiarity with CI/CD, Git and infrastructure as code
Nice to Have
- GCP certification, such as Professional Data Engineer
- Experience with real-time processing, Vertex AI or multi-cloud environments
More about this job
Responsibilities
Lead a team of 10 onshore and offshore engineers building and operating reliable, cost-efficient data platforms and ETL/ELT pipelines on Google Cloud. Set technical standards, review code, optimize performance and cloud costs, and partner with analytics and data teams to support self-service, data quality, and advanced analytics use cases.
Requirements
Requires proven experience leading data engineering teams across onshore and offshore locations, along with hands-on GCP expertise in BigQuery, Dataflow, Dataproc, Pub/Sub, Composer, and Terraform. Candidates should also have experience with SQL, Python, Java or Scala, distributed systems, CI/CD, Git, and infrastructure as code.
Skills
- Team Leadership
- SQL
- Python
- Java
- Scala
- Distributed Systems
- Apache Spark
- Apache Beam
- Google Cloud Platform
- BigQuery
- Dataflow
- Dataproc
- Pub/Sub
- Cloud Composer
- Terraform
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Management & Leadership
Keywords
- Google Cloud Platform
- Data Engineering
- Team Leadership
- Onshore And Offshore Teams
- ETL/ELT
- Dataflow
- Apache Beam
- Dataproc
- Apache Spark
- Pub/Sub
- Cloud Functions
- BigQuery
- Cloud Storage
- Data Fusion
- Cloud Composer
- Apache Airflow
- Terraform
- SQL
- Python
- Java
- Scala
- Distributed Systems
- CI/CD
- Git
- Infrastructure As Code
- Cloud Monitoring
- Cloud Logging
- Data Catalog
- dbt
- Vertex AI