Find work in Canada.

330,343 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 32 mins ago
Spark Scala Java Developer
Apptoza Inc.
Toronto, ON
Contract
The ideal candidate will have experience developing data processing applications using Apache Spark and Scala.
Added 5 hours ago
Technology Lead - PySpark Developer
Infosys
ON
Infosys is seeking an experienced PySpark Developer to design, develop, and optimize scalable bigdata solutions. The candidate will work on building high-performance batch and real-time…
Added 16 hours ago
Senior Associate Data Engineering (Azure/Databricks) Hybrid
Publicis Sapient
Toronto, ON
Full-time
In-depth knowledge of Scala, Apache Spark, PySpark, Python, Java, and shell scripting.
Added 17 hours ago
Big Data Developer
Galent
Toronto, ON
Contract
Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Added 22 hours ago
Big Data Developer
Themesoft Inc.
Toronto, ON
Contract
Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Added 22 hours ago
Big Data Engineer
Themesoft Inc.
Toronto, ON
Contract
Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Added 23 hours ago
Technology Analyst - Pyspark developer
Infosys
ON
Infosys is seeking an experienced Spark Scala Developer to design, develop, and optimize scalable bigdata solutions. The candidate will work on building high-performance batch and real-time…
Added 1 day ago
Technology Lead - AWS Data Engineer
Infosys
BC
Infosys is seeking an experienced Data Engineer with 6+ years of experience in building scalable data platforms and ETL pipelines. The ideal candidate should have strong hands-on expertise…
Added 1 day ago
Member of Technical Staff 3
Nutanix
Vancouver, BC
$132,000 to $198,000 CAD / year
Full-time
Design and implement pre-requisite data engineering by authoring Jobs via Apache Spark.
Added 1 day ago
Member of Technical Staff 4
Nutanix
Vancouver, BC
$151,000 to $227,000 CAD / year
Full-time
Design and implement data engineering by authoring Jobs via Apache Spark to satisfy complex requirements.
Added 1 day ago
Staff Software Engineer, Risk Data Engineering
Stripe
Canada
Full-time
…volume, is deeply knowledgeable of key tools including Airflow/Spark/Kafka/Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe…
Added 1 day ago
Staff Software Engineer, Risk Data Engineering
Stripe
Toronto, ON
Full-time
…volume, is deeply knowledgeable of key tools including Airflow/Spark/Kafka/Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe…
Added 1 day ago
Spark Scala developer
Apptoza Inc.
Toronto, ON
Contract
Job Description We are seeking a skilled Spark Scala Developer to join our team. The ideal candidate will have experience developing data processing applications using Apache Spark and…
Added 1 day ago
Software Engineer
LanceSoft, Inc.
Toronto, ON
$70 CAD / hour
Contract
The ideal candidate will have experience developing data processing applications using Apache Spark and Scala.
Added 1 day ago
Developer (Spark and Scala Exp)
Confiar Services
Toronto, ON
$40 to $45 CAD / hour
Contract
We are looking for an experienced Spark with Scala Developer with a strong Java background to design, develop, and optimize large-scale data processing applications. The ideal candidate…
Added 9 days ago
Developer - Data, AI, Platform & Support
BMO
Toronto, ON · FCP
Full-time
Experience with SQL, NoSQL, Python , Spark/PySpark, Scala.
Added 7 days ago
Senior Manager, Engineering & Build
RBC
Toronto, ON
Full-time
Distributed processing: Production experience with Spark (PySpark/Scala) for large-scale batch processing and optimization.
Added 5 days ago
Data Engineer
Loopio Inc.
Remote, Canada
$103,500 to $140,000 CAD / year
Full-time · Remote
Loopio’s Data Engineering Team works together on a mission to transform the RFP response process into a rapid and seamless experience. Our team works across all platform portfolio features…
Added 5 days ago
ETL Data Engineer - Assistant Vice President
Citi
Mississauga, ON
Full-time
Experience developing applications using Spark, Scala, Java or Python is a plus
Added 5 days ago
Senior Software Developer
Royal Bank of Canada
Toronto, ON
Full-time
Experience developing secure server side services leveraging the following APIs: Spring, Spring Boot, Spark, Scala, RESTful Webservices, Apache Data Utilities (JSON, Avro, CSV/PSV,…
Added 5 days ago
Spark Scala Java Developer
Pacer Group
Toronto, ON
$55 to $60 CAD / hour
Contract
Experience developing scalable data processing applications using Apache Spark and Scala.
Added 6 days ago
Senior Software Developer
RBC
Toronto, ON
Full-time
Experience developing secure server side services leveraging the following APIs: Spring, Spring Boot, Spark, Scala, RESTful Webservices, Apache Data Utilities (JSON, Avro, CSV/PSV,…
Added 5 days ago
Spark Scala Java Developer
Pacer Group
Toronto, ON
$60 to $62 CAD / hour
Contract
Proficient in Scala and Java programming.Hands-on experience with Apache Spark (Core| SQL| DataFrames| Datasets).Familiarity with Maven for build and dependency management.Experience with…
Added 5 days ago
Scala Developer
Pacer Group
Toronto, ON
$60 to $65 CAD / hour
Contract
Job Title: Java Developer with Spark and Scala
Added 7 days ago
2027 Investor Services, PEY Data Analyst (12-16 months)
Royal Bank of Canada
Toronto, ON
Full-time
As the Data Analyst, you will provide expertise for Data Management spanning both platforms and projects. At the core of the role is a detailed understanding of Data management principles…

Themesoft Inc.

Big Data Developer

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 22, 2026
Posting language: English
Posted: Sep 22, 2026

Apply About employer

Applications open in a new tab.

Original job description

Role: Big Data Developer

Location: Toronto(Hybrid)

Mode: Contract

Responsibilities:

Big Data & Spark

Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Build and optimize ETL/ELT pipelines using Spark DataFrames, Datasets and Spark SQL
Tune Spark jobs for performance (partitioning, caching, broadcast joins, shuffle optimization)
Migrate Spark 2 applications to Spark 3 on Cloudera CDP platforms
Work with Parquet, ORC, Avro file formats on HDFS

SQL & Data Engineering

Write complex HiveQL / Spark SQL queries including window functions, CTEs, subqueries and aggregations
Design and maintain Hive external/managed tables and partitioned datasets
Optimize slow-running queries and resolve correlated subquery issues
Work with HDFS encryption zones and data governance requirements

Unix / Shell Scripting

Develop and maintain bash shell scripts for job orchestration and automation
Handle error management, return codes, logging and alerting in shell scripts
Manage HDFS operations (hdfs dfs commands), file transfers, and data validation
Manage Kerberos authentication (kinit, keytab handling)

API Extraction & Integration

Build scripts and pipelines to extract data from REST APIs using curl and Python
Handle OAuth2 token generation, bearer token refresh and API health checks
Parse and process JSON API responses and load into HDFS/Hive
Manage pagination, error handling and retry logic for API calls
Work with enterprise API gateways and URL parameter construction

AI & Copilot Capabilities

Leverage GitHub Copilot / AI coding assistants to accelerate development
Use AI tools for code review, SQL generation, script debugging and documentation
Contribute to AI-assisted data quality and anomaly detection pipelines
Explore and implement LLM-based automation for repetitive data engineering tasks

Scheduling & Orchestration

Schedule and manage jobs using AAP (Ansible Automation Platform) / Control-M / cron
Build and maintain Ansible playbooks for automated deployments
Manage deployment pipelines including artifact versioning, Vault secret injection and environment-specific configuration
Monitor job health, handle failures and implement alerting

Nice to Have:

Experience with Cloudera CDP (7.x) and migration from HDP
Knowledge of Kerberos, Vault, HDFS encryption zones
Familiarity with CI/CD pipelines (Helios, GitHub Actions)
Experience with MSSQL / JDBC connectivity from Spark
Understanding of AML / Financial regulatory data domains

Required Skills:

Big Data & Spark
SQL
Unix/Shell Scripting

Regards

Praveen Kumar

Talent Acquisition Group

praveen.r@themesoft.com| Themesoft Inc

Apply About employer

More about this job

Responsibilities

Design and develop large-scale data processing applications using Spark and Scala while optimizing ETL pipelines. Manage data orchestration, API integrations, and maintain HDFS operations within a Cloudera CDP environment.

Requirements

Requires extensive experience in Big Data technologies, Spark SQL, and Unix/Shell scripting. Proficiency in managing data governance, Kerberos authentication, and API extraction is essential for this role.

Skills

Big Data
Spark
Scala
Hadoop
ETL
Spark SQL
HiveQL
Unix
Shell Scripting
Python
REST APIs
Kerberos
Ansible
Data Engineering
HDFS
Cloudera CDP

Visa sponsorship

Not detected in the job text

Hiring contact

Praveen Kumar

Hiring contact email

praveen.r@themesoft.com

Keywords

Big Data
Spark
Scala
Hadoop
CDP
ETL
Spark SQL
HiveQL
HDFS
Unix
Shell Scripting
Python
REST APIs
OAuth2
Kerberos
Ansible
GitHub Copilot
Data Engineering
Data Governance
CI/CD
JSON
Parquet
Avro
ORC
Control-M
Vault
API Gateway
Automation
Data Quality
Performance Tuning

Report this job