Find work in Canada.

329,779 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added 3 mins ago
Sr. Integration Architect - Automation
Infotree Global Solutions
Toronto, ON
Contract
Job Title: Sr Integration Engineer (Intelligent Automation)
Added 3 mins ago
Senior Project Engineer, Transportation
R.V. Anderson Associates Limited
St. Catharines, ON
Full-time
…your unique skills and perspective will help drive change from operations to the C-suite, across a wide range of projects and…
Added 3 mins ago
Customer Service Quality Manager
Merrithew®
Toronto, ON · Scarborough, ON
$75,000 to $100,000 CAD / year
Full-time
…high-quality customer experience, and works closely with Quality, Operations, Engineering, Product Development, Supply Chain, and suppliers to resolve product-related…
Added 3 mins ago
Senior Project Engineer, Transportation
R.V. Anderson Associates Limited
London, ON
Full-time
…your unique skills and perspective will help drive change from operations to the C-suite, across a wide range of projects and…
Added 3 mins ago
Senior Project Engineer, Transportation
R.V. Anderson Associates Limited
Burlington, ON
Full-time
…your unique skills and perspective will help drive change from operations to the C-suite, across a wide range of projects and…
Added 3 mins ago
Senior Software Development Engineer, AWS Field Experiences AFX
Amazon Web Services (AWS)
Vancouver, BC
Full-time
…passionate, innovative, results-oriented Senior Software Development Engineer to design and build the services that make it simpler for our field team to manage, maintain, and operate at…
Added 5 mins ago
Senior Project Manager, Transportation
R.V. Anderson Associates Limited
Barrie, ON · London, ON · Toronto, ON · Burlington, ON · St. Catharines, ON · Vancouver, BC
Full-time
…your unique skills and perspective will help drive change from operations to the C-suite, across a wide of range of projects and…
Added 19 mins ago
Senior Product Manager
GoBolt
Toronto, ON
…designing and building the operating system for modern 3PL operations and helping set the strategic direction for how we solve it. You will sit in between complex physical operations and…
Added 19 mins ago
SecOps Engineer
CSC Generation
Toronto, ON
Full-time
…Engine, proprietary tools, and shared services to modernize operations, elevate customer experience, and expand margins. With $1B+ in revenue across 13 brands, our portfolio includes Sur La…
Added 19 mins ago
Industrial Water Process Engineer, Project Manager, Calgary
Hatch
Calgary, AB
…integration of water management strategies into mine planning and…
Added 19 mins ago
Dyke Construction Monitoring Technologist
Canadian Natural
Fort McMurray, AB
Full-time
…documented and communicated to Supervisor, Geotechnical and Lead Engineer, Geotechnical Operations…
Added 19 mins ago
Customer Quality and Service Supervisor
Merrithew International Inc.
Scarborough Bluffs Park, ON
Full-time
…high-quality customer experience, and works closely with Quality, Operations, Engineering, Product Development, Supply Chain, and suppliers to resolve product-related…
Added 19 mins ago
Customer Development Representative
Mouser
Kitchener, ON
Full-time
…of the newest products and technologies targeting the design engineer and buyer…
Added 33 mins ago
Cybersecurity Engineer, Entry Level (Canada)
Jobright.ai
Canada
Full-time
…job outcomes. They are seeking an entry-level Cybersecurity Engineer to monitor security incidents, perform vulnerability assessments, and collaborate with engineering teams to enhance…
Added 33 mins ago
Senior Geotechnical Engineer
Pinchin Canada
Toronto, ON
Full-time
Pinchin is seeking a Senior Geotechnical Engineer to join our Geotechnical Services team in one of our Southern Ontario offices. This position reports to the Geotechnical Services…
Added 33 mins ago
Manager of Facilities Operations, Maintenance & Capital Projects
Catholic District School Board of Eastern Ontario
Kemptville, ON
Full-time
NU-331Position: Manager of Facilities Operations, Maintenance & Capital Projects - PermanentLocation: Kemptville Board Office Hours of work: 35 hours/week Salary: $137,102 -…
Added 33 mins ago
Senior Full Stack Developer – Cloud & Platform Engineering
Yochana
Calgary, AB
Full-time
…learn it, because it is part of the estate you'll be helping to engineer and govern. More detail…
Added 33 mins ago
Senior Geotechnical Engineer
Pinchin Canada
St. Catharines, ON
Full-time
Pinchin is seeking a Senior Geotechnical Engineer to join our Geotechnical Services team in one of our Southern Ontario offices. This position reports to the Geotechnical Services…
Added 33 mins ago
Manager, Transportation, Parks, and Fleet
Town of New Tecumseth
New Tecumseth, ON
$114,766.49 to $143,467.68 CAD / year
Full-time
Responsible for overseeing and the functional operations and maintenance of four works facilities.
Added 33 mins ago
Chemical Manufacturing Engineer
Trylak
Delta, BC
Full-time
We are a leading specialty chemical manufacturer providing high-performance consumable solutions across industrial operations. Backed by a large parent corporation, our local manufacturing…
Added 34 mins ago
Supervisor, Technical Standards (Temporary - 12 Months)
Hydro Ottawa
Ottawa, ON
Full-time
…mentorship, technical progression, and professional licensure of Engineer Interns to secure the engineering talent…
Added 49 mins ago
Operations Engineer
Sitka Power
Victoria, BC
Full-time
Sitka Power is seeking an Operations Engineer to support the technical operation and continuous improvement of our generation fleet. This role blends traditional plant engineering…
Added 1 hour ago
Senior Geotechnical Engineer
Pinchin Canada
Oshawa, ON
Full-time
Pinchin is seeking a Senior Geotechnical Engineer to join our Geotechnical Services team in one of our Southern Ontario offices. This position reports to the Geotechnical Services…
Added 1 hour ago
Senior Geotechnical Engineer
Pinchin Canada
Hamilton, ON
Full-time
Pinchin is seeking a Senior Geotechnical Engineer to join our Geotechnical Services team in one of our Southern Ontario offices. This position reports to the Geotechnical Services…
Added 1 hour ago
Senior Geotechnical Engineer
Pinchin Canada
Mississauga, ON
Full-time
Pinchin is seeking a Senior Geotechnical Engineer to join our Geotechnical Services team in one of our Southern Ontario offices. This position reports to the Geotechnical Services…

Themesoft Inc.

Big Data Engineer

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 22, 2026
Posting language: English
Posted: Sep 22, 2026

Apply About employer

Applications open in a new tab.

Original job description

Position: Big Data Engineer

Location: Toronto, On - Hybrid

Skills

Big Data & Spark
SQL
Unix/Shell Scripting

Key Responsibilities

Big Data & Spark

Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Build and optimize ETL/ELT pipelines using Spark DataFrames, Datasets and Spark SQL
Tune Spark jobs for performance (partitioning, caching, broadcast joins, shuffle optimization)
Migrate Spark 2 applications to Spark 3 on Cloudera CDP platforms
Work with Parquet, ORC, Avro file formats on HDFS

SQL & Data Engineering

Write complex HiveQL / Spark SQL queries including window functions, CTEs, subqueries and aggregations
Design and maintain Hive external/managed tables and partitioned datasets
Optimize slow-running queries and resolve correlated subquery issues
Work with HDFS encryption zones and data governance requirements

Unix / Shell Scripting

Develop and maintain bash shell scripts for job orchestration and automation
Handle error management, return codes, logging and alerting in shell scripts
Manage HDFS operations (hdfs dfs commands), file transfers, and data validation
Manage Kerberos authentication (kinit, keytab handling)

API Extraction & Integration

Build scripts and pipelines to extract data from REST APIs using curl and Python
Handle OAuth2 token generation, bearer token refresh and API health checks
Parse and process JSON API responses and load into HDFS/Hive
Manage pagination, error handling and retry logic for API calls
Work with enterprise API gateways and URL parameter construction

AI & Copilot Capabilities

Leverage GitHub Copilot / AI coding assistants to accelerate development
Use AI tools for code review, SQL generation, script debugging and documentation
Contribute to AI-assisted data quality and anomaly detection pipelines
Explore and implement LLM-based automation for repetitive data engineering tasks

Scheduling & Orchestration

Schedule and manage jobs using AAP (Ansible Automation Platform) / Control-M / cron
Build and maintain Ansible playbooks for automated deployments
Manage deployment pipelines including artifact versioning, Vault secret injection and environment-specific configuration
Monitor job health, handle failures and implement alerting

Nice to Have

Experience with Cloudera CDP (7.x) and migration from HDP
Knowledge of Kerberos, Vault, HDFS encryption zones
Familiarity with CI/CD pipelines (Helios, GitHub Actions)
Experience with MSSQL / JDBC connectivity from Spark
Understanding of AML / Financial regulatory data domains

Regards

Patrick Fernandez

Talent Acquisition Group - Strategic Recruitment Manager

Apply About employer

More about this job

Responsibilities

Design and develop Spark-Scala applications for large-scale data processing while building and optimizing ETL/ELT pipelines. Manage job orchestration, API integration, and data governance requirements within Hadoop/CDP clusters.

Requirements

Requires proficiency in Big Data technologies, Spark SQL, and Unix shell scripting for automation and data validation. Experience with Cloudera CDP, Kerberos authentication, and REST API integration is highly preferred.

Skills

Big Data
Spark
Scala
Hadoop
SQL
HiveQL
Unix
Shell Scripting
ETL
Python
HDFS
Ansible
Kerberos
REST APIs
Data Engineering

Visa sponsorship

Not detected in the job text

Hiring contact

Patrick Fernandez

Keywords

Big Data
Spark
Scala
Hadoop
CDP
ETL
ELT
Spark SQL
HiveQL
Unix
Shell Scripting
HDFS
Kerberos
REST APIs
Python
JSON
GitHub Copilot
Ansible
Control-M
CI/CD
Data Engineering
Data Governance
Parquet
Avro
ORC
OAuth2
API Gateway
Automation
Data Quality
Anomaly Detection

Report this job