Senior Data Engineer
- Mississauga, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Experience
- Mandatory Skills: Big Data , 10-12 Years over all experience
- Posting language
- English
- Posted
Original job description
Sr Data engineer/Data Analyst– Onsite
Location : Mississauga, ON
Duration: Fulltime
Job Description:
Mandatory Skills: Big Data , 10-12 Years over all experience
Required Skills
Strong hands-on experience in Python and PySpark.
Expert-level proficiency in SQL for data analysis, reporting, and optimization.
Strong experience with Big Data technologies and distributed computing frameworks.
Hands-on development experience in Scala.
Experience in data analysis, data profiling, and data quality validation.
Strong understanding of ETL/ELT processes and large-scale data pipelines.
Experience working with Spark, Hive, Hadoop, and related Big Data ecosystems.
Ability to analyze complex business requirements and translate them into technical solutions.
Strong debugging, performance tuning, and problem-solving skills
More about this job
Responsibilities
Develop and support large-scale data pipelines using Big Data technologies and distributed computing frameworks. Analyze data and business requirements, validate data quality, and optimize solutions for performance.
Requirements
Requires 10–12 years of overall experience, strong hands-on Python and PySpark skills, expert SQL proficiency, and hands-on Scala development experience. Candidates should also have experience with Spark, Hive, Hadoop, ETL/ELT, data analysis and profiling, data quality validation, debugging, and performance tuning.
Skills
- Python
- PySpark
- SQL
- Big Data
- Distributed Computing
- Scala
- Data Analysis
- Data Profiling
- Data Quality Validation
- ETL/ELT
- Data Pipelines
- Spark
- Hive
- Hadoop
- Debugging
- Performance Tuning
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Python
- PySpark
- SQL
- Big Data
- Distributed Computing
- Scala
- Data Analysis
- Data Profiling
- Data Quality Validation
- ETL/ELT
- Large-Scale Data Pipelines
- Spark
- Hive
- Hadoop
- Data Reporting
- SQL Optimization
- Debugging
- Performance Tuning
- Problem-Solving
- Business Requirements
- Technical Solutions