Big data Engineer
- Mississauga, ON, Canada
Salary: CAD 125-135K/Year · Full-time
Applications open in a new tab.
Job details
- Pay
- Salary: CAD 125-135K/Year
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Job Title: Big Data Lead
Location: Mississauga, ON
Work Arrangement: Hybrid-3 days/ week
Employment Type: Full-Time Perm
Salary: CAD 125-135K/Year
Domain: BFSI
Application Deadline: Oct. 30th, 2026
Skills:
8+ years of exp. in developing and maintaining scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently.
Key Skills:
- PySpark
- Spark SQL
- Python
- ETL / Data Pipelines
- ETL workflows
- Big Data Processing
- Distributed Computing
- Spark Performance Tuning & Optimization
- Data Transformation & Manipulation
- Cloud / On-Premises Data Processing
- Hadoop & Distributed Storage
- Unit Testing / Data Quality
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
More about this job
Responsibilities
Develop and maintain scalable data pipelines using PySpark and Spark SQL to process large datasets efficiently. Perform data transformation and processing across cloud or on-premises environments, with attention to performance and data quality.
Requirements
Requires 8+ years of experience developing and maintaining scalable data pipelines with PySpark and Spark SQL. Relevant skills include Python, ETL workflows, distributed computing, Hadoop, Spark optimization, unit testing, and data quality.
Skills
- PySpark
- Spark SQL
- Python
- ETL
- Data Pipelines
- ETL Workflows
- Big Data Processing
- Distributed Computing
- Spark Performance Tuning
- Data Transformation
- Data Manipulation
- Cloud Data Processing
- On-Premises Data Processing
- Hadoop
- Distributed Storage
- Unit Testing
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
Keywords
- Big Data
- PySpark
- Spark SQL
- Python
- ETL
- Data Pipelines
- ETL Workflows
- Large Datasets
- Distributed Computing
- Spark Performance Tuning
- Data Optimization
- Data Transformation
- Data Manipulation
- Cloud Data Processing
- On-Premises Data Processing
- Hadoop
- Distributed Storage
- Unit Testing
- Data Quality
- BFSI
- Mississauga
- Hybrid Work
- Full-Time Employment