Senior Data Engineer
- Toronto, ON, Canada
$63 to $65 CAD / hour · Contract
Applications open in a new tab.
Job details
- Pay
- $63 to $65 CAD / hour
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Requirements
Title: Senior AWS Data Engineer
Looking for 10+ years of exp consultants
Position Summary: The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.
Minimum Qualifications:
? 8+ Years overall IT experience with minimum 5 years of work experience in below tech skills
? Tech Skills:
? Strong experience in Python Scripting and PySpark for data processing
? Proficiency in SQL, dealing with big data processing
? Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Glue)
? Expertise in BASH/Shell scripting
? Strong understanding of healthcare insurance domain and experience leading data engineering teams
? Experience in Agile environments.
? Excellent problem-solving skills and attention to detail.
? Effective communication and collaboration skills.
Responsibilities:
? Leads development of data pipelines and architectures that handle large-scale data sets.
? Designs, constructs, and tests data architecture aligned with business requirements.
? Provides technical leadership for data projects, ensuring best practices and high-qualitydata solutions.
? Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
? Oversees development of data solutions that enable predictive and prescriptive analytics.
? Ensures the technical quality of solutions, managing data as it moves across environments.
- Aligns data architecture to Healthfirst solution architecture.
Work Experience :10Years
More about this job
Responsibilities
Lead the design, development, and testing of scalable data architectures and pipelines that meet business requirements, and provide technical leadership to ensure high-quality solutions. Collaborate with business teams to support predictive and prescriptive analytics, align architecture with Healthfirst solutions, and manage data quality as it moves across environments.
Requirements
Requires 8 or more years of overall IT experience, including at least 5 years with relevant technologies; the posting also seeks consultants with 10 or more years of experience. Candidates should have strong Python, PySpark, SQL, AWS data services, and shell scripting skills, along with healthcare insurance domain knowledge, data engineering leadership experience, Agile experience, and strong communication and problem-solving abilities.
Skills
- Python
- PySpark
- SQL
- AWS
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- Bash/Shell Scripting
- Data Pipeline Development
- Data Architecture
- Healthcare Insurance
- Agile
- Team Leadership
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Engineering
- Healthcare
- Management & Leadership
Keywords
- Senior Data Engineer
- AWS
- Python
- PySpark
- SQL
- Big Data
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon EMR
- Apache Airflow
- AWS Glue
- Bash
- Shell Scripting
- Data Processing
- Data Pipelines
- Data Architecture
- Predictive Analytics
- Prescriptive Analytics
- Healthcare Insurance
- Agile
- Technical Leadership
- Data Quality
- Healthfirst
- Cloud Computing