Lead Software Engineer
- Halifax, NS, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- 8+ Years overall IT experience with minimum 5 years of work experience in below tech
- Posting language
- English
- Posted
Original job description
Position Summary
The Senior Data Engineer leads complex data engineering projects, working on designing data
architectures that align with business requirements. This role focuses on optimizing data
workflows, managing data pipelines, and ensuring the smooth operation of data systems.
Minimum Qualifications
- 8+ Years overall IT experience with minimum 5 years of work experience in below tech
- Tech Skills:
▪ Proficiency in SQL, dealing with big data processing
▪ Experience in AWS cloud platform and its data services (S3, Redshift, Lambda,
EMR, Airflow, Glue)
▪ Expertise in BASH/Shell scripting
- Strong understanding of healthcare insurance domain and experience leading data
- Experience in Agile environments.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills.
- Leads development of data pipelines and architectures that handle large-scale data sets.
- Designs, constructs, and tests data architecture aligned with business requirements.
- Provides technical leadership for data projects, ensuring best practices and high-quality
- Collaborates with product, finance, and other business units to ensure data pipelines
- Oversees development of data solutions that enable predictive and prescriptive
- Ensures the technical quality of solutions, managing data as it moves across
- Aligns data architecture to Healthfirst solution architecture.
More about this job
Responsibilities
Leads the design, development, and testing of large-scale data pipelines and architectures aligned with business and solution architecture requirements. Provides technical leadership, ensures data quality across environments, and collaborates with business teams to deliver data solutions for predictive and prescriptive analytics.
Requirements
Requires at least eight years of overall IT experience, including at least five years of experience with relevant technologies such as Python, PySpark, SQL, AWS data services, and Bash or shell scripting. Candidates should also have healthcare insurance domain knowledge, experience leading data engineering teams, Agile experience, and strong problem-solving, communication, and collaboration skills.
Skills
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- Bash
- Shell Scripting
- Data Pipeline Development
- Data Architecture
- Healthcare Insurance
- Agile
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Management & Leadership
- Healthcare
Keywords
- Data Engineering
- Python
- PySpark
- SQL
- Big Data
- AWS
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- Bash
- Shell Scripting
- Data Pipelines
- Data Architecture
- Data Processing
- Healthcare Insurance
- Predictive Analytics
- Prescriptive Analytics
- Agile
- Technical Leadership
- Data Quality
- Solution Architecture
- Data Systems