Data Engineer
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Description
- We are looking for an experienced Data Engineer nwith strong expertise in Python, PySpark, SQL, and AWS cloud services. The ideal candidate will have experience designing and developing large-scale data pipelines, optimizing data workflows, and managing complex data engineering projects. Healthcare insurance domain experience and technical leadership skills are highly preferred.
- ### Key Responsibilities
- - Lead the development and implementation of data pipelines and architectures to handle large-scale datasets.
- - Design, build, and test data architectures aligned with business requirements.
- - Provide technical leadership on data engineering projects, ensuring best practices and high-quality solutions.
- - Collaborate with Product, Finance, and other business teams to understand data requirements.
- - Develop data solutions that support predictive and prescriptive analytics.
- - Ensure data quality, consistency, and smooth data movement across different environments.
- - Optimize data workflows and improve overall data processing performance.
- - Align data architecture with Healthfirst solution architecture.
- Required Technical Skills
- - Strong experience in Python Scripting and PySpark for data processing.
- - Proficiency in *SQL* and large-scale data processing.
- - Hands-on experience with **AWS Cloud Services**, including:
- - Amazon S3
- - AWS Redshift
- - AWS Lambda
- - Amazon EMR
- - AWS Glue
- - Apache Airflow
- - Expertise in BASH/Shell Scripting.
- - Strong understanding of data engineering concepts, data pipelines, and data architecture.
- Domain & Other Requirements
- - Strong understanding and experience in the **Healthcare Insurance domain**.
- - Experience leading data engineering teams.
- - Experience working in Agile environments.
- - Excellent problem-solving, analytical, and communication skills.
- - Ability to collaborate effectively with technical and business stakeholders.
More about this job
Responsibilities
Lead the design, development, testing, and optimization of large-scale data pipelines and architectures, ensuring data quality and reliable movement across environments. Provide technical leadership and collaborate with business and technical teams to deliver data solutions for predictive and prescriptive analytics aligned with business requirements and Healthfirst architecture.
Requirements
The role requires strong experience with Python, PySpark, SQL, AWS data services, shell scripting, and data engineering architecture and pipelines. Healthcare insurance experience, technical leadership, Agile experience, and strong analytical, problem-solving, and communication skills are preferred or required.
Skills
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- AWS Redshift
- AWS Lambda
- Amazon EMR
- AWS Glue
- Apache Airflow
- BASH/Shell Scripting
- Data Pipelines
- Data Architecture
- Healthcare Insurance
- Agile
- Technical Leadership
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Healthcare
- Management & Leadership
Keywords
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- AWS Redshift
- AWS Lambda
- Amazon EMR
- AWS Glue
- Apache Airflow
- BASH
- Shell Scripting
- Data Engineering
- Data Pipelines
- Data Architecture
- Large-Scale Data Processing
- Data Quality
- Predictive Analytics
- Prescriptive Analytics
- Healthcare Insurance
- Technical Leadership
- Agile
- Workflow Optimization
- Healthfirst
- Business Requirements