Cloud Data Engineer
- Montreal, QC, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Posting language
- English
- Posted
Original job description
Our Challenge
We are seeking a Cloud Data Engineer to design, develop, and maintain scalable data solutions on AWS and Google Cloud Platform. The successful candidate will build reliable data ingestion and processing pipelines, automate workflows, and support efficient deployment through modern DevOps practices.
Responsibilities:
- Develop cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Design and implement API-based data ingestion and integration processes.
- Consume REST APIs, extract data, and transform it for analytical use.
- Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
- Build and maintain ETL/ELT data pipelines.
- Use Apache Airflow for workflow scheduling and pipeline orchestration.
- Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
- Use GitHub for source control and collaborative development.
- Develop and maintain CI/CD pipelines and release automation.
- Support deployment processes and promote consistent DevOps practices across data engineering initiatives.
Skills:
- 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Design and implement API-based data ingestion and integration processes.
- Consume REST APIs, extract data, and transform it for analytical use.
- Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
- Build and maintain ETL/ELT data pipelines.
- Use Apache Airflow for workflow scheduling and pipeline orchestration.
- Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
- Use GitHub for source control and collaborative development.
- Develop and maintain CI/CD pipelines and release automation.
- Support deployment processes and promote consistent DevOps practices across data engineering initiatives.
More about this job
Responsibilities
Design, build, and maintain scalable cloud data solutions and ETL/ELT pipelines across AWS and Google Cloud Platform, including API-based ingestion and batch, near-real-time, and CDC patterns. Orchestrate and monitor workflows with Apache Airflow, and support source control, CI/CD, release automation, and consistent DevOps practices.
Requirements
The role requires 6+ years of experience developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery. Candidates should have experience with API and REST data integration, ingestion patterns, ETL/ELT pipelines, Apache Airflow, GitHub, CI/CD, and pipeline monitoring and recovery.
Skills
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Data Transformation
- Batch Ingestion
- Near-Real-Time Ingestion
- Change Data Capture
- ETL/ELT Pipelines
- Apache Airflow
- Pipeline Monitoring
- GitHub
- CI/CD
- DevOps
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Cloud Data Engineering
- AWS
- Google Cloud Platform
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Data Integration
- Data Extraction
- Data Transformation
- Batch Processing
- Near-Real-Time Processing
- Change Data Capture
- ETL
- ELT
- Apache Airflow
- Workflow Orchestration
- Pipeline Monitoring
- Error Handling
- GitHub
- CI/CD
- Release Automation
- DevOps