Closed listing
Data Engineer
- Halifax, NS, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Posting language
- English · French
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
English section of this bilingual listing.
Role: Data Engineer
Location: Halifax, Canada (ONSITE)
Duration: Long Term
Key Responsibilities:
- Design and implement complex ETL/ELT workflows for diverse data sources both on-prem and Cloud platform (AWS)
- Build and optimize data lake architectures on Cloudera Data Platform (CDP)
- Develop data models in Snowflake cloud warehouse and CDP environments
- Implement CI/CD pipelines using Helios for data infrastructure automation
- Collaborate with analysts to enable advanced analytics on data lake assets
- Ensure security/governance compliance for sensitive data at scale
- Technical Expertise Required:
- Python: Advanced scripting for data processing, API integration, and automation
- AWS : Amazon S3,AWS Glue
- Cloud Services: AWS/Azure storage integration with CDP/Snowflake
Soft Skills:
- Problem-solving for hybrid cloud data challenges
- Cross-functional collaboration with data scientists and analysts
- Clear communication of complex technical solutions
- Nice-to-Have Qualifications:
- Certifications: Cloudera CCP, SnowPro, Red Hat OpenShift
- Experience with streaming platforms (Flink, Kafka Streams)
- MLOps patterns for model deployment
Read the full bilingual original
Role: Data Engineer
Location: Halifax, Canada (ONSITE)
Duration: Long Term
Key Responsibilities:
- Design and implement complex ETL/ELT workflows for diverse data sources both on-prem and Cloud platform (AWS)
- Build and optimize data lake architectures on Cloudera Data Platform (CDP)
- Develop data models in Snowflake cloud warehouse and CDP environments
- Implement CI/CD pipelines using Helios for data infrastructure automation
- Collaborate with analysts to enable advanced analytics on data lake assets
- Ensure security/governance compliance for sensitive data at scale
- Technical Expertise Required:
- Python: Advanced scripting for data processing, API integration, and automation
- AWS : Amazon S3,AWS Glue
- Containerization: Docker image management; orchestration via Kubernetes/OCP4
- Data Platforms:
- Cloudera Data Platform (CDP) for Hadoop/Spark ecosystems
- Snowflake cloud data warehouse architecture
- Storage Solutions: Data lake design (S3/ADLS), structured/unstructured data optimization
- Pipeline Tools: Airflow, Kafka, Helios CI/CD
- Version Control: GitHub collaboration
- Cloud Services: AWS/Azure storage integration with CDP/Snowflake
Soft Skills:
- Problem-solving for hybrid cloud data challenges
- Cross-functional collaboration with data scientists and analysts
- Clear communication of complex technical solutions
- Nice-to-Have Qualifications:
- Certifications: Cloudera CCP, SnowPro, Red Hat OpenShift
- Experience with streaming platforms (Flink, Kafka Streams)
- MLOps patterns for model deployment
More about this job
Responsibilities
Design and optimize ETL/ELT workflows, data lake architectures, and data models across on-premises and cloud environments, including AWS, Cloudera Data Platform, and Snowflake. Automate data infrastructure with CI/CD pipelines, support analytics collaboration, and ensure security and governance for sensitive data.
Requirements
Requires advanced Python skills and experience with AWS, Cloudera Data Platform, Snowflake, data lake design, and ETL/ELT workflows. Also calls for containerization and orchestration experience, pipeline tools such as Airflow and Kafka, GitHub collaboration, and the ability to solve hybrid-cloud challenges and communicate across teams.
Skills
- Python
- AWS
- Amazon S3
- AWS Glue
- Cloudera Data Platform
- Snowflake
- Docker
- Kubernetes
- OpenShift
- Airflow
- Kafka
- Helios
- GitHub
- ETL/ELT
- Data Lake Architecture
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Python
- AWS
- Amazon S3
- AWS Glue
- Cloudera Data Platform
- Hadoop
- Spark
- Snowflake
- Docker
- Kubernetes
- OpenShift
- Airflow
- Kafka
- Helios
- GitHub
- ETL/ELT
- Data Engineering
- Data Lake
- Data Modeling
- CI/CD
- Cloud Data Warehouse
- Data Governance
- Data Security
- Azure
- ADLS
- Flink
- Kafka Streams
- MLOps
- Cloudera CCP
- SnowPro