Role Summary
- Seeking an experienced Data Platform Engineer with strong Netezza expertise.
- Design, develop, and support scalable data pipelines and distributed data platforms.
- Work with AWS Cloud, Big Data, Data Warehousing, ETL, and real-time data processing.
- Support data platform modernization and on-premises to AWS cloud migration initiatives.
Required Technical Skills
AWS Cloud
- AWS EMR
- EC2
- S3
- VPC
- RDS
- Redshift
- AWS Glue
- IAM
- CloudWatch
- CloudFormation
- Airflow / AWS Managed Workflows
Databases & Data Warehousing
- Netezza Mandatory
- SQL Server
- PostgreSQL
- Teradata
- Amazon Redshift
ETL / Data Integration
- SSIS
- Pentaho or similar ETL tools
- ETL/ELT processes
Programming & Scripting
- Strong SQL
- Shell scripting
- Python Good to have
Operating Systems
- Strong Unix/Linux experience
Key Responsibilities
- Design, develop, maintain, and support scalable data pipelines.
- Lead and support on-premises to AWS cloud migration initiatives.
- Leverage Netezza expertise for data migration and platform modernization.
- Develop and manage ETL/ELT processes using SSIS, Pentaho, or similar tools.
- Implement and manage AWS services including EMR, S3, EC2, Redshift, Glue, and Airflow.
- Build and optimize data workflows and orchestration pipelines.
- Work with real-time streaming technologies such as Kafka and Spark Streaming.
- Perform data ingestion, transformation, and validation across multiple data sources.
- Optimize SQL queries for performance and scalability.
- Monitor platform performance and troubleshoot technical issues.
- Ensure data platform reliability, scalability, and performance.
- Collaborate with developers, architects, infrastructure teams, and business stakeholders.
Must-Have Skills
- 10+ years of Data Engineering / Big Data / Platform Engineering experience
- Hands-on Netezza experience Mandatory
- Strong AWS Cloud experience
- Strong SQL and Shell scripting
- Experience with ETL/ELT
- Strong Unix/Linux experience
- Data Warehousing experience
- Data migration and modernization experience
- Experience building scalable data pipelines
- Experience with distributed data systems
Nice-to-Have Skills
- Python
- Kafka
- Spark Streaming
- Airflow
- Pentaho
- AWS data migration experience
