Closed listing
Technology Lead - AWS Data Engineer
- Burnaby, BC, Canada
Full-time
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Full-time
- Closing date
- Education
- Bachelor’s degree
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Infosys is seeking an experienced Data Engineer with 6+ years of experience in building scalable data platforms and ETL pipelines. The ideal candidate should have strong hands-on expertise in AWS Athena, Scala, and Apache Spark, with experience designing and optimizing large-scale data processing solutions in AWS environments. Experience with AWS data lake architectures, performance tuning, and distributed data processing is essential. The requirements align with enterprise data engineering practices found in internal data engineering profiles and job descriptions.
Required Qualifications
Estimated annual compensation range for the candidate based in the below location will be:
British Columbia - $ 90450 to $ 136500
Additional Required Qualifications
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
- At least 4 years of Information Technology experience
- Candidate must be located within commuting distance of Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.
- Design, develop, and maintain scalable ETL/ELT pipelines using Scala and Apache Spark.
- Build and optimize data processing workflows for large-scale structured and semi-structured datasets.
- Develop and manage data lake solutions using AWS S3, Athena, Glue, and EMR.
- Optimize Athena queries, partitions, and data storage formats to improve performance and reduce costs.
- Implement data quality checks, validation frameworks, and monitoring solutions.
- Integrate data from multiple sources including databases, APIs, streaming platforms, and flat files.
- Collaborate with Data Architects, Analysts, and Business Stakeholders to deliver data solutions.
- Tune Spark jobs by optimizing joins, partitioning, caching, and shuffle operations.
- Support CI/CD deployments, release management, and production issue resolution.
- Participate in Agile ceremonies, code reviews, and technical design discussions.
- At least 6 years of experience in Data Engineering.
- Strong hands-on experience with AWS Athena.
- Strong development experience in Scala.
- Expertise in Apache Spark (Spark Core, Spark SQL).
- Experience with AWS services such as S3, Glue, EMR, IAM, CloudWatch.
- Strong SQL and data modeling skills.
- Experience building and maintaining ETL/ELT pipelines.
- Good understanding of distributed data processing and performance tuning.
- Experience with Git and CI/CD practices.
Estimated annual compensation range for the candidate based in the below location will be:
British Columbia - $ 90450 to $ 136500
Additional Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
More about this job
Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines while optimizing data processing workflows for large-scale datasets. Collaborate with architects and stakeholders to deliver robust data solutions using AWS services and perform production issue resolution.
Requirements
Requires at least 6 years of experience in data engineering with strong hands-on expertise in Scala, Apache Spark, and AWS Athena. Candidates must possess a bachelor's degree or equivalent and be authorized to work in Canada without sponsorship.
Skills
- AWS Athena
- Scala
- Apache Spark
- Data Engineering
- ETL/ELT Pipelines
- AWS S3
- AWS Glue
- AWS EMR
- SQL
- Data Modeling
- Distributed Data Processing
- Performance Tuning
- Git
- CI/CD
- Data Lake Architectures
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Engineering
- Consulting
Keywords
- AWS Athena
- Scala
- Apache Spark
- Data Engineering
- ETL
- ELT
- AWS S3
- AWS Glue
- AWS EMR
- Data Lake
- SQL
- Data Modeling
- Distributed Data Processing
- Performance Tuning
- Git
- CI/CD
- Agile
- CloudWatch
- IAM
- Data Quality
- Data Pipelines
- Big Data
- Cloud Computing
- Information Technology
- Consulting