Closed listing
Cloud Data Engineer (AWS and GCP)
- Montreal, QC, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Experience
- · 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Cloud Data Engineer (GCP and AWS)
Our Challenge
We are seeking a Cloud Data Engineer to design, develop, and maintain scalable data solutions on AWS and Google Cloud Platform. The successful candidate will build reliable data ingestion and processing pipelines, automate workflows, and support efficient deployment through modern DevOps practices.
Responsibilities:
· Develop cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
· Design and implement API-based data ingestion and integration processes.
· Consume REST APIs, extract data, and transform it for analytical use.
· Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
· Build and maintain ETL/ELT data pipelines.
· Use Apache Airflow for workflow scheduling and pipeline orchestration.
· Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
· Use GitHub for source control and collaborative development.
· Develop and maintain CI/CD pipelines and release automation.
· Support deployment processes and promote consistent DevOps practices across data engineering initiatives.
Skills:
· 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
· Design and implement API-based data ingestion and integration processes.
· Consume REST APIs, extract data, and transform it for analytical use.
· Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
· Build and maintain ETL/ELT data pipelines.
· Use Apache Airflow for workflow scheduling and pipeline orchestration.
· Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
· Use GitHub for source control and collaborative development.
· Develop and maintain CI/CD pipelines and release automation.
· Support deployment processes and promote consistent DevOps practices across data engineering initiatives.
More about this job
Responsibilities
Design, develop, and maintain scalable cloud data solutions and ingestion pipelines across AWS and Google Cloud Platform, including batch, near-real-time, and change data capture workflows. Orchestrate and monitor pipelines with Apache Airflow, and support source control, CI/CD, release automation, and consistent DevOps practices.
Requirements
Requires 6+ years of experience developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery. Candidates should have experience with API and REST data integration, ETL/ELT pipelines, Apache Airflow, pipeline monitoring and recovery, GitHub, and CI/CD practices.
Skills
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Batch Ingestion
- Near-Real-Time Ingestion
- Change Data Capture
- ETL/ELT Pipelines
- Apache Airflow
- Pipeline Monitoring
- GitHub
- CI/CD
- DevOps
- Cloud Data Engineering
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
Keywords
- Cloud Data Engineering
- AWS
- Google Cloud Platform
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Data Extraction
- Data Transformation
- Batch Processing
- Near-Real-Time Processing
- Change Data Capture
- ETL
- ELT
- Apache Airflow
- Workflow Scheduling
- Pipeline Orchestration
- Pipeline Monitoring
- Error Handling
- GitHub
- CI/CD
- Release Automation
- DevOps