Closed listing
Developer (Spark and Scala Exp)
- Toronto, ON, Canada
$40 to $45 CAD / hour · Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Pay
- $40 to $45 CAD / hour
- Job type
- Contract
- Closing date
- Experience
- 5+ years of software development experience.
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Job Title: Spark with Scala Developer (Java Background)
Location: Toronto, Canada
Duration: Long Term Contract
Job Summary
We are looking for an experienced Spark with Scala Developer with a strong Java background to design, develop, and optimize large-scale data processing applications. The ideal candidate will leverage their Java expertise and transition seamlessly into Scala-based Spark development, building high-performance, scalable, and reliable data solutions.
Key Responsibilities
- Design and develop big data applications using Apache Spark and Scala.
- Build and optimize ETL/data processing pipelines for large datasets.
- Develop scalable, high-performance solutions on distributed data platforms.
- Utilize Java expertise to enhance Spark applications and integrate existing Java libraries.
- Troubleshoot performance issues and optimize Spark jobs.
- Work closely with data engineers, architects, and business stakeholders.
- Ensure code quality through testing, code reviews, and best practices.
- Participate in system design, performance tuning, and production support.
Required Skills
- 5+ years of software development experience.
- Strong hands-on experience with Java development.
- Experience with Apache Spark and Scala.
- Good understanding of distributed computing concepts.
- Knowledge of JVM internals, memory management, and performance tuning.
- Experience with SQL and large-scale data processing.
- Familiarity with Hadoop ecosystem and cloud platforms is a plus.
- Strong problem-solving and analytical skills.
Preferred Qualifications
- Experience with Databricks, Kafka, or streaming technologies.
- Exposure to AWS, Azure, or Google Cloud platforms.
- Knowledge of CI/CD, Git, and Agile methodologies.
More about this job
Responsibilities
Design and develop large-scale big data applications using Apache Spark and Scala. Build and optimize ETL pipelines while ensuring high performance and reliability of data solutions.
Requirements
Requires 5+ years of software development experience with strong proficiency in Java, Scala, and Apache Spark. Candidates should have a solid understanding of distributed computing, SQL, and performance tuning.
Skills
- Apache Spark
- Scala
- Java
- Big Data
- ETL
- Data Processing
- Distributed Computing
- JVM Internals
- Memory Management
- SQL
- Databricks
- Kafka
- Streaming Technologies
- CI/CD
- Git
- Agile
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Engineering
- Finance & Accounting
Keywords
- Apache Spark
- Scala
- Java
- Big Data
- ETL
- Data Processing
- Distributed Computing
- JVM
- Memory Management
- SQL
- Hadoop
- Databricks
- Kafka
- Streaming
- AWS
- Azure
- Google Cloud
- CI/CD
- Git
- Agile
- Banking
- Software Development
- Performance Tuning
- Data Engineering