Cloud data Engineer
- Montreal, QC, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Experience
- 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Posting language
- English
- Posted
Original job description
Role :- Cloud Data Engineer
Location :- - Montreal, QC
Job Type :- Contract
Role Summary
We are seeking a Cloud Data Engineer to design, develop, and maintain scalable data solutions on AWS and Google Cloud Platform. The successful candidate will build reliable data ingestion and processing pipelines, automate workflows, and support efficient deployment through modern DevOps practices.
Responsibilities:
- Develop cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Design and implement API-based data ingestion and integration processes.
- Consume REST APIs, extract data, and transform it for analytical use.
- Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
- Build and maintain ETL/ELT data pipelines.
- Use Apache Airflow for workflow scheduling and pipeline orchestration.
- Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
- Use GitHub for source control and collaborative development.
- Develop and maintain CI/CD pipelines and release automation.
- Support deployment processes and promote consistent DevOps practices across data engineering initiatives.
Skills:
- 6+ years experience Developing cloud data solutions using AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery.
- Design and implement API-based data ingestion and integration processes.
- Consume REST APIs, extract data, and transform it for analytical use.
- Develop batch, near-real-time, and change data capture (CDC) ingestion patterns.
- Build and maintain ETL/ELT data pipelines.
- Use Apache Airflow for workflow scheduling and pipeline orchestration.
- Manage pipeline dependencies, monitoring, alerts, error handling, and recovery.
- Use GitHub for source control and collaborative development.
- Develop and maintain CI/CD pipelines and release automation.
Support deployment processes and promote consistent DevOps practices across data engineering initiatives
More about this job
Responsibilities
Design, develop, and maintain scalable cloud data solutions and ingestion pipelines across AWS and Google Cloud Platform. Orchestrate and monitor workflows, manage pipeline reliability, and support deployments through GitHub, CI/CD automation, and DevOps practices.
Requirements
Requires 6+ years of experience developing cloud data solutions with AWS Athena, Amazon S3, AWS Glue Data Catalog, and Google BigQuery. Candidates should have experience with API and REST data integration, batch and near-real-time ingestion, CDC, ETL/ELT pipelines, Apache Airflow, GitHub, CI/CD, and DevOps.
Skills
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Data Transformation
- Batch Ingestion
- Near-Real-Time Ingestion
- Change Data Capture
- ETL/ELT Pipelines
- Apache Airflow
- GitHub
- CI/CD
- DevOps
- Pipeline Monitoring
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Cloud Data Engineering
- AWS
- Google Cloud Platform
- AWS Athena
- Amazon S3
- AWS Glue Data Catalog
- Google BigQuery
- API-Based Data Ingestion
- REST APIs
- Data Integration
- Data Transformation
- Batch Processing
- Near-Real-Time Processing
- Change Data Capture
- ETL
- ELT
- Apache Airflow
- Workflow Scheduling
- Pipeline Orchestration
- Pipeline Monitoring
- Error Handling
- GitHub
- CI/CD
- Release Automation
- DevOps