Movojobs
Back to results

Added

J&M Group

Data Platform Engineer

  • Toronto, ON, Canada

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type
Full-time
Apply by
Experience
10+ years of Data Engineering / Big Data / Platform Engineering experience
Posting language
English
Posted

Original job description

Role Summary

  • Seeking an experienced Data Platform Engineer with strong Netezza expertise.
  • Design, develop, and support scalable data pipelines and distributed data platforms.
  • Work with AWS Cloud, Big Data, Data Warehousing, ETL, and real-time data processing.
  • Support data platform modernization and on-premises to AWS cloud migration initiatives.

Required Technical Skills

AWS Cloud

  • AWS EMR
  • EC2
  • S3
  • VPC
  • RDS
  • Redshift
  • AWS Glue
  • IAM
  • CloudWatch
  • CloudFormation
  • Airflow / AWS Managed Workflows

Databases & Data Warehousing

  • Netezza Mandatory
  • SQL Server
  • PostgreSQL
  • Teradata
  • Amazon Redshift

ETL / Data Integration

  • SSIS
  • Pentaho or similar ETL tools
  • ETL/ELT processes

Programming & Scripting

  • Strong SQL
  • Shell scripting
  • Python Good to have

Operating Systems

  • Strong Unix/Linux experience

Key Responsibilities

  • Design, develop, maintain, and support scalable data pipelines.
  • Lead and support on-premises to AWS cloud migration initiatives.
  • Leverage Netezza expertise for data migration and platform modernization.
  • Develop and manage ETL/ELT processes using SSIS, Pentaho, or similar tools.
  • Implement and manage AWS services including EMR, S3, EC2, Redshift, Glue, and Airflow.
  • Build and optimize data workflows and orchestration pipelines.
  • Work with real-time streaming technologies such as Kafka and Spark Streaming.
  • Perform data ingestion, transformation, and validation across multiple data sources.
  • Optimize SQL queries for performance and scalability.
  • Monitor platform performance and troubleshoot technical issues.
  • Ensure data platform reliability, scalability, and performance.
  • Collaborate with developers, architects, infrastructure teams, and business stakeholders.

Must-Have Skills

  • 10+ years of Data Engineering / Big Data / Platform Engineering experience
  • Hands-on Netezza experience Mandatory
  • Strong AWS Cloud experience
  • Strong SQL and Shell scripting
  • Experience with ETL/ELT
  • Strong Unix/Linux experience
  • Data Warehousing experience
  • Data migration and modernization experience
  • Experience building scalable data pipelines
  • Experience with distributed data systems

Nice-to-Have Skills

  • Python
  • Kafka
  • Spark Streaming
  • Airflow
  • Pentaho
  • AWS data migration experience
Apply About employer
More about this job

Responsibilities

Design, develop, and support scalable data pipelines and distributed data platforms. Lead the migration of on-premises data systems to AWS cloud and optimize data workflows.

Requirements

Requires over 10 years of experience in data engineering with mandatory expertise in Netezza and AWS Cloud. Proficiency in SQL, shell scripting, and ETL processes is essential.

Skills

  • Netezza
  • AWS Cloud
  • SQL
  • Shell Scripting
  • ETL/ELT
  • Unix/Linux
  • Data Warehousing
  • Python
  • Amazon Redshift
  • AWS Glue
  • Airflow
  • Kafka
  • Spark Streaming
  • Data Migration
  • AWS EMR
  • S3

Visa sponsorship

Not detected in the job text

Categories

  • Data & Analytics
  • Technology
  • Engineering
  • Software
  • Consulting

Keywords

  • Netezza
  • AWS Cloud
  • AWS EMR
  • EC2
  • S3
  • VPC
  • RDS
  • Redshift
  • AWS Glue
  • IAM
  • CloudWatch
  • CloudFormation
  • Airflow
  • SQL Server
  • PostgreSQL
  • Teradata
  • SSIS
  • Pentaho
  • ETL
  • ELT
  • Python
  • Unix
  • Linux
  • Kafka
  • Spark Streaming
  • Data Migration
  • Data Warehousing
  • Big Data
  • Distributed Systems
  • Data Pipelines

Report this job