Cloud Data Engineer
Full Time
Toronto, ON
Required Skills:
Extensive experience in Data Warehousing, Data Engineering, and AWS Cloud technologies.
Strong domain knowledge in Banking and Financial Services.
Experience designing and implementing large-scale data platforms and migration initiatives.
Technical Skills (Must Have)
Amazon S3 (Data Lake)
AWS Glue (ETL)
AWS Lambda
Amazon Redshift
AWS Step Functions
AWS IAM
AWS CloudWatch
IBM Netezza
ETL/ELT Design and Development
Data Warehouse Architecture
Data Migration and Modernization
CI/CD Pipeline Implementation
Key Responsibilities:
Data Engineering & Development
Design, develop, and maintain scalable data pipelines and workflows on AWS.
Build and manage enterprise data lakes and data warehouses using AWS services such as Amazon S3 and Amazon Redshift.
Develop and maintain ETL/ELT processes using AWS Glue, AWS Lambda, Apache Spark, and related technologies.
Implement robust data ingestion frameworks including batch processing and streaming solutions.
Optimize data ingestion, transformation, and data loading processes for performance and scalability.
Monitor, troubleshoot, and support data pipelines and workflows.
Cloud & Architecture:
Design cloud-native data solutions leveraging AWS services and best practices.
Ensure data quality, governance, security, and compliance standards are met.
Implement and manage monitoring solutions using AWS CloudWatch.
Manage access controls and security configurations using AWS IAM.
Improve platform performance, scalability, reliability, and cost optimization.
Migration & Modernization:
Analyze and understand existing IBM Netezza implementations.
Design and implement migration strategies from Netezza to AWS Data Lake architecture.
Ensure feature parity and optimal performance in the target AWS environment.
Support deployment and migration activities through to production.
Testing & Deployment:
Perform unit testing and support QA, SIT, performance, and user acceptance testing activities.
Automate deployment processes using CI/CD pipelines.
Support production releases and post-deployment validation activities.
*Disclaimer: This E-Mail may contain Confidential and/or legally privileged Information and is meant for the intended recipient(s) only. If you have received this e-mail in error and are not the intended recipient/s, kindly notify us at [email protected] and then delete this e-mail immediately from your system. You are also hereby notified that any use, any form of reproduction, dissemination, copying, disclosure, modification, distribution, and/or publication of this e-mail, its contents, or its attachment/s other than by its intended recipient/s is strictly prohibited and may be unlawful.
Internet communication cannot be guaranteed to be secured or error-free as information could be delayed, intercepted, corrupted, lost, or contain viruses. Tekshapers. does not accept any liability for any errors, omissions, viruses or computer problems experienced by any recipient as a result of this e-mail.