Big Data Lead
- Mississauga, ON, Canada
$130,000 to $135,000 CAD / year · Full-time
Applications open in a new tab.
Job details
- Pay
- $130,000 to $135,000 CAD / year
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
Job Title: Big Data Lead
Location: Mississauga, ON
Work Arrangement: Hybrid (2-3 days a week)
Employment Type: Full Time
Salary Range: CAD $ 130k to 135k/ Annum + Benefits
Domain: BFSI
Application Deadline: Sept. 30th, 2026
SKILLS REQUIRED:
- Develop scalable data pipelines using PySpark & Spark SQL.
- Strong hands-on experience in Python for data manipulation and automation.
- Design and implement ETL workflows for structured/unstructured data.
- Work with Hadoop, distributed systems, and cloud storage.
- Perform Spark job optimization, performance tuning, and resource management.
- Develop unit tests and troubleshoot data pipeline issues.
- Collaborate with data engineers, analysts, and stakeholders to deliver data solutions.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
More about this job
Responsibilities
Develop scalable data pipelines and ETL workflows for structured and unstructured data using PySpark, Spark SQL, and Python. Optimize and troubleshoot Spark jobs and collaborate with data engineers, analysts, and stakeholders to deliver data solutions.
Requirements
The role requires strong hands-on Python experience, along with skills in PySpark, Spark SQL, Hadoop, distributed systems, and cloud storage. Candidates should be able to design ETL workflows, tune Spark performance, manage resources, develop unit tests, and troubleshoot pipeline issues.
Skills
- PySpark
- Spark SQL
- Python
- Data Manipulation
- Automation
- ETL Workflows
- Structured and Unstructured Data
- Hadoop
- Distributed Systems
- Cloud Storage
- Spark Job Optimization
- Performance Tuning
- Resource Management
- Unit Testing
- Troubleshooting
- Stakeholder Collaboration
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Management & Leadership
- Finance & Accounting
Keywords
- Big Data
- PySpark
- Spark SQL
- Python
- Data Pipelines
- Data Manipulation
- Automation
- ETL
- Structured Data
- Unstructured Data
- Hadoop
- Distributed Systems
- Cloud Storage
- Spark Optimization
- Performance Tuning
- Resource Management
- Unit Testing
- Data Pipeline Troubleshooting
- Data Engineering
- Data Analytics
- BFSI
- Hybrid Work
- Mississauga