Back to results

Lead Software Engineer

  • Halifax, NS, Canada

Full-time

Applications open in a new tab.

Job details

Job type
Full-time
Apply by
Experience
 8+ Years overall IT experience with minimum 5 years of work experience in below tech
Posting language
English
Posted

Original job description

Job Requirements

Senior Data Engineer

Position Summary

The Senior Data Engineer leads complex data engineering projects, working on designing data

architectures that align with business requirements. This role focuses on optimizing data

workflows, managing data pipelines, and ensuring the smooth operation of data systems.

Minimum Qualifications

 8+ Years overall IT experience with minimum 5 years of work experience in below tech

Skills

 Tech Skills:

 Strong experience in Python Scripting and PySpark for data processing

 Proficiency in SQL, dealing with big data processing

 Proven experience in data processing for data lake in Iceberg format, with

strong understanding of architecture

 Experience in AWS Glue jobs

 Experience in AWS cloud platform and its data services (S3, Redshift, Lambda,

EMR, Airflow, Postgres, SNS, Event bridge)

 Expertise in BASH/Shell scripting

 Strong understanding of healthcare Finance systems and experience leading data

engineering teams

 Experience in Agile environments.

 Excellent problem-solving skills and attention to detail.

 Effective communication and collaboration skills.

Responsibilities

 Leads development of data pipelines and architectures that handle large-scale data sets.

 Designs, constructs, and tests data architecture aligned with business requirements.

 Provides technical leadership for data projects, ensuring best practices and high-quality

data solutions.

 Collaborates with product, finance, and other business units to ensure data pipelines

meet business requirements.

 Oversees development of data solutions that enable predictive and prescriptive

analytics.

 Ensures the technical quality of solutions, managing data as it moves across

environments.

  • Aligns data architecture to Healthfirst solution architecture.

Work Experience

7-10Years
More about this job

Responsibilities

Lead the design, development, and testing of scalable data pipelines and architectures aligned with business and solution architecture requirements. Provide technical leadership, collaborate with business teams, and oversee data solutions that support predictive and prescriptive analytics while maintaining data quality across environments.

Requirements

Requires 8+ years of overall IT experience, including at least 5 years with relevant data engineering technologies and experience leading data engineering teams. Candidates should have strong Python, PySpark, SQL, Iceberg, AWS data services, and shell scripting skills, along with healthcare finance systems knowledge, Agile experience, and strong communication and problem-solving abilities.

Skills

  • Python
  • PySpark
  • SQL
  • Iceberg
  • AWS Glue
  • AWS
  • Amazon S3
  • Amazon Redshift
  • AWS Lambda
  • Amazon EMR
  • Airflow
  • PostgreSQL
  • Amazon SNS
  • Amazon EventBridge
  • Bash/Shell Scripting
  • Agile

Visa sponsorship

Not detected in the job text

Categories

  • Data & Analytics
  • Technology
  • Software
  • Management & Leadership
  • Healthcare

Keywords

  • Data Engineering
  • Data Architecture
  • Data Pipelines
  • Python
  • PySpark
  • SQL
  • Big Data
  • Data Lakes
  • Apache Iceberg
  • AWS Glue
  • Amazon Web Services
  • Amazon S3
  • Amazon Redshift
  • AWS Lambda
  • Amazon EMR
  • Airflow
  • PostgreSQL
  • Amazon SNS
  • Amazon EventBridge
  • Bash
  • Shell Scripting
  • Healthcare Finance Systems
  • Predictive Analytics
  • Prescriptive Analytics
  • Agile
  • Technical Leadership
  • Data Quality

Report this job