Senior Data Engineer
- Halifax, NS, Canada
$55 to $60 CAD / hour · Contract
Applications open in a new tab.
Job details
- Pay
- $55 to $60 CAD / hour
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Position: Senior Data Engineer
Location: Halifax, Canada (Hybrid)
Duration: Contract
Tech Skills:
- Strong experience in Python Scripting and PySpark for data processing
- Proficiency in SQL, dealing with big data processing
- Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Glue)
- Expertise in BASH/Shell scripting
- Strong understanding of healthcare insurance domain and experience leading data engineering teams
- Experience in Agile environments.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills.
Responsibilities:
- Leads development of data pipelines and architectures that handle large-scale data sets.
- Designs, constructs, and tests data architecture aligned with business requirements.
- Provides technical leadership for data projects, ensuring best practices and high-qualitydata solutions.
- Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
- Oversees development of data solutions that enable predictive and prescriptive analytics.
- Ensures the technical quality of solutions, managing data as it moves across environments.
- Aligns data architecture to Healthfirst solution architecture.
More about this job
Responsibilities
Lead the development, design, construction, and testing of scalable data pipelines and architectures that meet business requirements and support predictive and prescriptive analytics. Provide technical leadership, ensure high-quality solutions and data management across environments, and collaborate with business units to align data architecture with Healthfirst’s solution architecture.
Requirements
Requires strong experience with Python, PySpark, SQL, AWS data services, and BASH or shell scripting, along with a strong understanding of the healthcare insurance domain. The role also calls for experience leading data engineering teams in Agile environments, as well as problem-solving, attention to detail, communication, and collaboration skills.
Skills
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- BASH
- Shell Scripting
- Data Pipeline Development
- Data Architecture
- Healthcare Insurance
- Agile
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Healthcare
- Management & Leadership
Keywords
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- BASH
- Shell Scripting
- Big Data Processing
- Data Engineering
- Data Pipelines
- Data Architecture
- Healthcare Insurance
- Technical Leadership
- Agile
- Predictive Analytics
- Prescriptive Analytics
- Data Quality
- Business Requirements
- Healthfirst