Closed listing
Spark and Scala Developer
- Toronto, ON, Canada
$55 to $60 CAD / hour · Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Pay
- $55 to $60 CAD / hour
- Job type
- Contract
- Closing date
- Experience
- 5+ years of software development experience.
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Job Title: Spark with Scala Developer (Java Background)
Location: Toronto, Canada
Duration: Long Term Contract
Job Summary
We are looking for an experienced Spark with Scala Developer with a strong Java background to design, develop, and optimize large-scale data processing applications. The ideal candidate will leverage their Java expertise and transition seamlessly into Scala-based Spark development, building high-performance, scalable, and reliable data solutions.
Key Responsibilities
- Design and develop big data applications using Apache Spark and Scala.
- Build and optimize ETL/data processing pipelines for large datasets.
- Develop scalable, high-performance solutions on distributed data platforms.
- Utilize Java expertise to enhance Spark applications and integrate existing Java libraries.
- Troubleshoot performance issues and optimize Spark jobs.
- Work closely with data engineers, architects, and business stakeholders.
- Ensure code quality through testing, code reviews, and best practices.
- Participate in system design, performance tuning, and production support.
Required Skills
- 5+ years of software development experience.
- Strong hands-on experience with Java development.
- Experience with Apache Spark and Scala.
- Good understanding of distributed computing concepts.
- Knowledge of JVM internals, memory management, and performance tuning.
- Experience with SQL and large-scale data processing.
- Familiarity with Hadoop ecosystem and cloud platforms is a plus.
- Strong problem-solving and analytical skills.
Preferred Qualifications
- Experience with Databricks, Kafka, or streaming technologies.
- Exposure to AWS, Azure, or Google Cloud platforms.
- Knowledge of CI/CD, Git, and Agile methodologies.
More about this job
Responsibilities
Design and develop large-scale data processing applications using Apache Spark and Scala. Optimize ETL pipelines and ensure high-performance, scalable solutions on distributed platforms.
Requirements
Requires 5+ years of software development experience with strong hands-on Java and Spark/Scala expertise. Candidates should have a solid understanding of distributed computing, JVM internals, and SQL.
Skills
- Spark
- Scala
- Java
- Big data
- ETL
- Distributed computing
- JVM internals
- Memory management
- Performance tuning
- SQL
- Hadoop
- Databricks
- Kafka
- Streaming technologies
- CI/CD
- Git
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Finance & Accounting
- Engineering
Keywords
- Spark
- Scala
- Java
- Big Data
- ETL
- Distributed Computing
- JVM
- Memory Management
- Performance Tuning
- SQL
- Hadoop
- Databricks
- Kafka
- Streaming
- AWS
- Azure
- Google Cloud
- CI/CD
- Git
- Agile
- Banking