Back to results

Specialist - Data Engineering

  • ON, Canada
  • Ontario, Canada, Canada

$87,896 to $95,125 USD / year · Full-time

Applications open in a new tab.

Job details

Pay
$87,896 to $95,125 USD / year
Job type
Full-time
Apply by
Experience
Seeking a Specialist with 5 to 7 years of experience in Apache Spark Scala and SparkSQL to design develop and optimize scalable big data processing solutions
Posting language
English
Posted

Original job description


Role description

Job Title: Sr. Big DATA Developer 


Work Location


Canada Mississauga, Ontario


Job Description:



  • Seeking a Specialist with 5 to 7 years of experience in Apache Spark Scala and SparkSQL to design develop and optimize scalable big data processing solutions

  • Develop and maintain scalable data processing pipelines using Apache Spark and SparkSQL

  • Utilize Scala programming skills to implement custom transformations and enhance Spark applications

  • Analyze large datasets to extract meaningful insights supporting data driven decision making

  • Collaborate with cross functional teams to integrate big data solutions into existing systems

  • Optimize Spark jobs for performance and efficiency in distributed computing environments

  • Ensure data quality and consistency across various data sources

  • Stay updated with the latest advancements in Spark Scala and related big data technologies to continuously improve processing capabilities 


Roles and Responsibilities



  • Design develop and deploy complex data processing workflows leveraging Apache Spark Scala and SparkSQL

  • Write efficient reusable and maintainable code for Spark applications

  • Troubleshoot and resolve performance bottlenecks in Spark jobs and data pipelines

  • Collaborate with data engineers data scientists and stakeholders to translate business requirements into technical solutions

  • Conduct code reviews and provide mentorship to junior team members on best practices and coding standards

  • Participate in architectural discussions and contribute to the evolution of big data platforms

  • Monitor and maintain the health availability and reliability of Spark clusters and data services Karat interview will be mandate



Other details

Vacancy Type: New Vacancy

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree Canada (“LTIMC”):


Benefits and Perks:



  • Comprehensive Medical Plan Covering Medical, Dental, Vision

  • Health Care Spending Account

  • Short Term and Long-Term Disability Coverage

  • Life Insurance

  • Annual vacation and other Paid Leaves

  • Maternity Leave Top Up Pay


The range displayed on each job posting reflects the total compensation range for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.



Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.

Accessibility and Reasonable Accommodation:
LTIMindtree has an accommodation process in place and provides accommodations for applicants with disabilities. If you require a specific accommodation because of a disability or a medical need, please write to us at applicantaccommodation.canada@ltimindtree.com so that arrangements can be made for the appropriate accommodations to be in place.
More about this job

Responsibilities

The specialist will design, develop, and deploy complex data processing workflows using Apache Spark, Scala, and SparkSQL. They will also troubleshoot performance bottlenecks and collaborate with cross-functional teams to integrate big data solutions.

Requirements

Candidates should have 5 to 7 years of experience in Apache Spark, Scala, and SparkSQL. They must be able to analyze large datasets and ensure data quality across various sources.

Skills

  • Apache Spark
  • Scala
  • SparkSQL
  • Data Processing
  • Data Pipelines
  • Data Quality
  • Performance Optimization
  • Collaboration
  • Code Review
  • Mentorship
  • Troubleshooting
  • Data Analysis
  • Big Data Technologies
  • Custom Transformations
  • Distributed Computing
  • Architectural Discussions

Benefits

  • Comprehensive Medical Plan
  • Covering Medical
  • Dental
  • Vision
  • Health Care Spending Account
  • Short Term and Long-Term Disability Coverage
  • Life Insurance
  • Annual Vacation and Other Paid Leaves
  • Maternity Leave Top Up Pay

Visa sponsorship

Not detected in the job text

Categories

  • Technology
  • Engineering
  • Data & Analytics
  • Software
  • Consulting

Keywords

  • Apache Spark
  • Scala
  • SparkSQL
  • Big Data
  • Data Processing
  • Data Pipelines
  • Data Quality
  • Performance Optimization
  • Collaboration
  • Code Review
  • Mentorship
  • Troubleshooting
  • Data Analysis
  • Distributed Computing
  • Architectural Discussions
  • Data Engineering
  • Insights Extraction

Report this job