Big Data Developer
- Mississauga, ON, Canada
$125,000 to $130,000 CAD / year · Contract
Applications open in a new tab.
Job details
- Pay
- $125,000 to $130,000 CAD / year
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Job Title: Big Data Developer Lead
Location: Mississauga, Ontario
Work Arrangement: Hybrid (3 days a week)
Employment Type: Fulltime
Salary: CAD 125-130k/annum+ Benefits
Domain: BFSI Domain
Application Deadline: Sept. 30th, 2026
SKILLS REQUIRED:
- Develop and maintain scalable data pipelines using PySpark and Spark SQL for large datasets.
- Build ETL workflows using Python to extract, transform, and load data from structured and unstructured sources.
- Optimize Spark jobs for performance, resource utilization, and faster execution.
- Work with Hadoop/cloud platforms and distributed data processing frameworks.
- Develop unit tests, monitor pipelines, troubleshoot issues, and ensure data quality and reliability.
- Collaborate with data engineers, analysts, and stakeholders to deliver efficient data solutions.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
More about this job
Responsibilities
Develop and maintain scalable data pipelines and Python-based ETL workflows for structured and unstructured data. Optimize and monitor distributed data processing, troubleshoot issues, ensure data quality, and collaborate with engineers, analysts, and stakeholders.
Requirements
The role requires experience developing data pipelines and ETL workflows with PySpark, Spark SQL, and Python, along with familiarity with Hadoop or cloud platforms and distributed processing frameworks. Candidates should be able to optimize Spark jobs, write unit tests, monitor pipelines, troubleshoot problems, and support reliable, high-quality data solutions.
Skills
- PySpark
- Spark SQL
- Python
- Data Pipeline Development
- ETL
- Spark Job Optimization
- Hadoop
- Cloud Platforms
- Distributed Data Processing
- Unit Testing
- Pipeline Monitoring
- Troubleshooting
- Data Quality
- Stakeholder Collaboration
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Finance & Accounting
Keywords
- Big Data
- PySpark
- Spark SQL
- Python
- Data Pipelines
- ETL
- Structured Data
- Unstructured Data
- Spark Optimization
- Resource Utilization
- Hadoop
- Cloud Platforms
- Distributed Data Processing
- Unit Testing
- Pipeline Monitoring
- Troubleshooting
- Data Quality
- Data Reliability
- Data Engineering
- Data Analytics
- BFSI