ETL Developer with Snowflake

PURPOSE OF THE POSITION:

We are looking for a Senior ETL developer with Snowflake experience to serve as a technical leader and trusted advisor for business/stakeholders. This role is not just about building data pipelines. But also architecting the future of our CPKC data ecosystems. Profile must possess expertise on best practices in data governance, data quality, CORTEX Analyst/Search, SNOWFLAKE Intelligence and modern data architecture, specifically the Medallion framework.

Job necessitates direct exposure to stakeholders focused at understanding their business challenges and design performance-oriented solutions on Snowflake Data Cloud that are secure, reliable and cost efficient.

POSITION ACCOUNTABILITIES:

• Design and implement scalable, end-to-end data platform solutions on Snowflake.
• Architect data solutions using Medallion (Bronze, Silver, Gold) architecture.
• Facilitate befitting Data Modelling Methodologies for Data Warehousing enabling a sound realization of Business Intelligence and Analytics needs.
• Design and implement CDC (Change Data capture) and data ingestion using tools like Snowpipe, Python and IDMC.
• Recommend and help enforcing Snowflake best practices and governance for data warehousing, data lakes, data engineering, and cost optimization.
• Work on realizing robust Role-Based Access Control(RBAC) models to ensure optimal privileges.
• Implement asset and user tagging for tracking credits/over-usage with resulting notifications/alerting
• Implement concepts like Dynamic Data Masking, Row-Access Policies and Column-Level Security for protecting sensitive data.
• Design and implement data validation, profiling, transformation and cleansing processes directly within data pipelines or layer of Medallion architecture.
• Mentor junior consultants, fostering a culture of technical excellence and continuous learning.
• Leverage Snowflake-Marketplace as an app store for readily exposure and use of data.
• Design and develop AI agents on structured or non-structured data.

POSITION REQUIREMENTS:

• 8+ years of experience in data engineering, data warehousing, and data architecture.
• 4+ years of hands-on, in-depth experience with Snowflake Data Cloud.
• Proven, demonstrable experience designing and implementing Medallion architecture in a production environment.
• Proficient in use of Python, SQL, Stored-proc for transformation.
• Excellent communication and client-facing skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Experience with CI/CD practices for data pipelines using Git, Azure DevOps.
• Expertise in using and building IDMC pipelines.
• Familiarity with reporting tools such as POWER BI and QLIK.
• Working knowledge of integration with Control-M to enable process orchestration.
• Familiarity with the railway industry and an understanding of operation data will be preferred.