Closed listing
GCP Senior Data Engineer
- Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
We are looking for a GCP Senior Data Engineer – Lead with strong hands-on data engineering expertise and proven experience leading onshore/offshore data engineering teams.
⚠️ This is a Lead position, not a Senior Data Engineer individual contributor role. Candidates without team leadership experience will not be considered.
🔹 Required Skills
- Experience leading data engineering teams, including onshore/offshore teams
- Strong hands-on experience with GCP
- BigQuery, Dataflow, Dataproc, Pub/Sub, Composer/Airflow
- Strong SQL and Python
- Experience with Java/Scala
- Distributed processing with Apache Spark and Apache Beam
- Strong Terraform / Infrastructure-as-Code experience
- CI/CD and Git
🔹 Key Responsibilities
- Build and optimize ETL/ELT pipelines using Dataflow, Apache Beam, Dataproc, Spark and Pub/Sub
- Architect and manage BigQuery, Cloud Storage and Data Fusion
- Lead a team of approximately 10 data engineers
- Conduct code reviews and establish engineering standards
- Implement CI/CD, monitoring and logging
- Optimize pipeline performance, BigQuery queries and GCP costs
- Work with data architects, data scientists and analysts
- Implement data quality, lineage and metadata management
- Support advanced analytics and ML use cases
🔹 Nice to Have
- GCP Professional Data Engineer certification
- Real-time/streaming data processing
- Vertex AI experience
- Multi-cloud experience
- dbt experience
More about this job
Responsibilities
Lead a team of approximately 10 data engineers while building and optimizing ETL/ELT pipelines and managing BigQuery, Cloud Storage, and Data Fusion. Establish engineering standards through code reviews, implement CI/CD and monitoring, optimize performance and costs, and support data quality, metadata, analytics, and machine learning use cases.
Requirements
Requires proven experience leading data engineering teams, including onshore/offshore teams, alongside strong hands-on GCP data engineering expertise. Required technical skills include BigQuery, Dataflow, Dataproc, Pub/Sub, Composer/Airflow, SQL, Python, Java or Scala, Spark, Beam, Terraform, CI/CD, and Git.
Skills
- Data Engineering Team Leadership
- Google Cloud Platform
- BigQuery
- Dataflow
- Dataproc
- Pub/Sub
- Cloud Composer
- Apache Airflow
- SQL
- Python
- Java
- Scala
- Apache Spark
- Apache Beam
- Terraform
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Management & Leadership
- Finance & Accounting
Keywords
- Google Cloud Platform
- BigQuery
- Dataflow
- Dataproc
- Pub/Sub
- Cloud Composer
- Apache Airflow
- Cloud Storage
- Data Fusion
- SQL
- Python
- Java
- Scala
- Apache Spark
- Apache Beam
- Terraform
- Infrastructure As Code
- CI/CD
- Git
- ETL
- ELT
- Distributed Processing
- Data Engineering
- Team Leadership
- Onshore/Offshore Teams
- Data Quality
- Data Lineage
- Metadata Management
- Real-Time Data Processing
- Vertex AI