At a glance
Automatically prepared from the listing. Check the original description for the full requirements.
Jump to the original descriptionResponsibilities
The role involves architecting and building efficient Python-based ETL pipelines to transform raw data into business insights. Responsibilities include implementing complex data transformation logic using pandas and collaborating with stakeholders to define data requirements.
Requirements
Candidates need over 3 years of Python experience with advanced proficiency in pandas and a solid understanding of data modeling and SQL. Familiarity with orchestration tools and high-performance processing libraries like Polars is preferred.
Working hours
40 hours per week
Skills
- Python
- Pandas
- ETL Pipeline Design
- Data Modeling
- SQL
- Git
- Polars
- DuckDB
- Cloud Data Platforms
- Airflow
- Luigi
- Dagster
- Data Governance
- Data Quality Monitoring
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Software
- Technology
- Engineering
- Consulting
Keywords
- Python
- ETL
- Pandas
- Data Pipelines
- Data Modeling
- SQL
- Git
- Polars
- DuckDB
- AWS
- GCP
- Azure
- Airflow
- Luigi
- Dagster
- Data Governance
- Data Quality
- IT Services
- IT Consulting
- Engineering
Original job description
Job Overview
We're seeking an experienced ETL Pipeline Developer proficient in Python to design, implement, and maintain robust data pipelines. This role is critical for transforming raw data into valuable business insights across our organization.
Key Responsibilities
Architect and build efficient ETL pipelines in Python to process diverse data sources
Implement data transformation logic using pandas for complex manipulations and aggregations
Document pipeline architecture, data flows, and transformation processes
Collaborate with data scientists and business stakeholders to understand data requirements
Optimize existing pipelines for performance and maintainability
Implement data quality checks and monitoring solutions
Required Skills
Strong Python programming experience (3+ years)
Advanced proficiency with pandas for data manipulation and analysis
Experience designing and maintaining production ETL workflows
Solid understanding of data modeling concepts and techniques
Familiarity with SQL and relational database concepts
Version control systems (Git) and collaborative development practices
Preferred Qualifications
Experience with Polars for high-performance data processing
Familiarity with DuckDB for analytical query processing
Knowledge of cloud-based data platforms (AWS, GCP, or Azure)
Experience with orchestration tools like Airflow, Luigi, or Dagster
Understanding of data governance and compliance requirements
Contributions to open-source data projects
What Makes You Successful
Problem-solving mindset with attention to detail
Strong communication skills to explain technical concepts clearly
Commitment to code quality and testing practices
Ability to balance competing priorities in a fast-paced environment, Project Code :
Apply by
Report this job
