Find work in Canada.

328,899 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Save this search

Added just now
Maintenance Repair Analyst
The Seaboard Transport Group
Toronto, ON · North York, ON
Full-time
…theoretical engineering with practical shop reality; professional engineer, Certified Engineering Technologist/Technician, or comparable maintenance credential is an…
Added 1 min ago
Dynamics/Power Platform Engineer
J&M Group
Montreal, QC
Contract
We are hiring for a Dynamics/Power Platform Engineer. This role focuses on developing, customizing, and integrating Microsoft Dynamics 365 CE solutions with enterprise applications.
Added 1 min ago
Core SRE engineer
Zodiac Solutions, Inc
Montreal, QC
Full-time
Experience on Ansible Automation Platform administration highly desired.
Added 1 min ago
Data Engineer
Arkhya Tech. Inc.
Canada
Full-time
10+ years of experience as a Data Engineer or related role
Added 1 min ago
Senior Android Developer
MapsPeople
Toronto, ON
Full-time
You are a collaborative engineer who enjoys working on shared platforms rather than isolated features. You take pride in building clean, reliable SDKs that others depend on and enjoy…
Added 1 min ago
Principal Engineer, Software Engineering / AI Engineer
Quantum Technology Recruiting Inc. (QTR)
Toronto, ON
$285,000 to $325,000 USD / year
Full-time
Position: Principal Engineer, Software Engineering / AI Engineer
Added 14 mins ago
AI/ML Platform Engineer (Cloud Infrastructure)
K&K Global Talent Solutions INC.
ON · Ontario, Canada
Full-time
Position: AI/ML Platform Engineer (Cloud Infrastructure)
Added 14 mins ago
Maintenance Repair Analyst
The Seaboard Transport Group
Moncton, NB
Full-time
…theoretical engineering with practical shop reality; professional engineer, Certified Engineering Technologist/Technician, or comparable maintenance credential is an…
Added 14 mins ago
Maintenance Repair Analyst
The Seaboard Transport Group
Dartmouth, NS
Full-time
…theoretical engineering with practical shop reality; professional engineer, Certified Engineering Technologist/Technician, or comparable maintenance credential is an…
Added 15 mins ago
Software Engineer II
Socure
Toronto, ON · Greater Toronto Area, Canada
Full-time
The Agentic AI Foundations team is building the core platform, systems, and primitives that enable Socure to transition from traditional software workflows to agent-native operations. As a…
Added 15 mins ago
Tests and Validations Specialists
EERS
Montreal, QC
Full-time
…of product design. Reporting to the Senior Hardware Design Engineer, and under supervision of the EMC specialist, we expect them to perform a variety of tasks ranging from design to…
Added 15 mins ago
Senior Data Engineer
MatchBox Consulting Group
Vancouver, BC
Contract
MatchBox Consulting Group is currently seeking a Senior Data Engineer for a 6 month contract role with a client of ours located in Vancouver.
Added 15 mins ago
Big Data Engineer
Themesoft Inc.
Toronto, ON
Contract
Schedule and manage jobs using AAP (Ansible Automation Platform) / Control-M / cron
Added 15 mins ago
Platform Engineer - AI/ML Infrastructure
K&K Global Talent Solutions INC.
Toronto, ON
$110,000 to $120,000 CAD / year
Full-time
Position: Platform Engineer - AI/ML Infrastructure
Added 17 mins ago
Senior Full Stack Engineer
OpenTable
Toronto, ON
As an engineer on the Diner Growth – Blog Team, you’ll take ownership of evolving our CMS and web platform. You’ll work across the full stack-from our existing WordPress, PHP, and Apache…
Added 17 mins ago
Sr. Technical Systems Analyst – Database Activity Monitoring (GCS)
RBC
Toronto, ON · Vancouver, BC · Halifax, NS
Full-time
…complex problems and developing innovative security solutions. We engineer tailor-made detections that will reduce risk to our organization, employees, and clients. We are seeking a skilled…
Added 33 mins ago
Design Engineer, Expansion
Stripe
Canada
Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments,…
Added 33 mins ago
S&TCS Design Manager
Acciona
ON · CAN - Eglinton Crosstown West
Full-time
…seamlessly integrates Alstom’s proprietary CITYFLO 650 CBTC platform into both the new extension and the existing Line 5…
Added 46 mins ago
Ingénieur de données et spécialiste des plateformes/ Data Engineer & Platform Specialist
ALUMO
Montreal, QC
Full-time
The Data Engineer & Platform Specialist supports Alumo’s data architecture and engineering capability by designing, maintaining, and improving reliable data processes, platform…
Added 46 mins ago
Senior Software Engineer, Machine Learning
Chorus
Toronto, ON
Full-time
The platform underneath. Our Founding Engineer owns the data platform that feeds it all: ingesting client marketing data, keeping it clean and current, and making it fast enough to segment…
Added 46 mins ago
Intermediate Full-Stack Engineer
Trajekt Sports
Toronto, ON
Full-time
Enhance overall platform reliability, observability, and scalability
Added 48 mins ago
Lead Infrastructure Support Engineer (Linux/Azure)
CIBC
Toronto, ON
Full-time
…and development teams across the bank. As an Infrastructure Engineer, you'll manage and modernize a complex environment across Linux, Windows, virtualization, co-located data centres, and…
Added 48 mins ago
Senior Data Engineer
Ipsos
Canada
The Ipsos DataHub is a uniquely positioned group within Ipsos. It is a next-generation data platform designed to unlock the full value of data across the organization. By bringing together…
Added 1 hour ago
Manufacturing Engineer
AGI | Global Food Infrastructure
Swift Current No. 137, SK · Swift Current, SK
Full-time
…including seed, fertilizer, grain and feed systems and an expanding platform for food processing…
Added 1 hour ago
Forward Deployed Engineering Lead (TOR)
Doppel
Toronto, ON
$120,000 to $250,000 CAD / year
Full-time
Doppel is building the future of social engineering defense. Our AI-native platform uses agentic AI to protect executives, employees, customers, and brands from phishing, impersonation,…

Themesoft Inc.

Big Data Engineer

Toronto, ON, Canada

Job type: Contract
Apply by: Oct 22, 2026
Posting language: English
Posted: Sep 22, 2026

Apply About employer

Applications open in a new tab.

Original job description

Position: Big Data Engineer

Location: Toronto, On - Hybrid

Skills

Big Data & Spark
SQL
Unix/Shell Scripting

Key Responsibilities

Big Data & Spark

Design and develop Spark-Scala applications for large-scale data processing on Hadoop/CDP clusters
Build and optimize ETL/ELT pipelines using Spark DataFrames, Datasets and Spark SQL
Tune Spark jobs for performance (partitioning, caching, broadcast joins, shuffle optimization)
Migrate Spark 2 applications to Spark 3 on Cloudera CDP platforms
Work with Parquet, ORC, Avro file formats on HDFS

SQL & Data Engineering

Write complex HiveQL / Spark SQL queries including window functions, CTEs, subqueries and aggregations
Design and maintain Hive external/managed tables and partitioned datasets
Optimize slow-running queries and resolve correlated subquery issues
Work with HDFS encryption zones and data governance requirements

Unix / Shell Scripting

Develop and maintain bash shell scripts for job orchestration and automation
Handle error management, return codes, logging and alerting in shell scripts
Manage HDFS operations (hdfs dfs commands), file transfers, and data validation
Manage Kerberos authentication (kinit, keytab handling)

API Extraction & Integration

Build scripts and pipelines to extract data from REST APIs using curl and Python
Handle OAuth2 token generation, bearer token refresh and API health checks
Parse and process JSON API responses and load into HDFS/Hive
Manage pagination, error handling and retry logic for API calls
Work with enterprise API gateways and URL parameter construction

AI & Copilot Capabilities

Leverage GitHub Copilot / AI coding assistants to accelerate development
Use AI tools for code review, SQL generation, script debugging and documentation
Contribute to AI-assisted data quality and anomaly detection pipelines
Explore and implement LLM-based automation for repetitive data engineering tasks

Scheduling & Orchestration

Schedule and manage jobs using AAP (Ansible Automation Platform) / Control-M / cron
Build and maintain Ansible playbooks for automated deployments
Manage deployment pipelines including artifact versioning, Vault secret injection and environment-specific configuration
Monitor job health, handle failures and implement alerting

Nice to Have

Experience with Cloudera CDP (7.x) and migration from HDP
Knowledge of Kerberos, Vault, HDFS encryption zones
Familiarity with CI/CD pipelines (Helios, GitHub Actions)
Experience with MSSQL / JDBC connectivity from Spark
Understanding of AML / Financial regulatory data domains

Regards

Patrick Fernandez

Talent Acquisition Group - Strategic Recruitment Manager

Apply About employer

More about this job

Responsibilities

Design and develop Spark-Scala applications for large-scale data processing while building and optimizing ETL/ELT pipelines. Manage job orchestration, API integration, and data governance requirements within Hadoop/CDP clusters.

Requirements

Requires proficiency in Big Data technologies, Spark SQL, and Unix shell scripting for automation and data validation. Experience with Cloudera CDP, Kerberos authentication, and REST API integration is highly preferred.

Skills

Big Data
Spark
Scala
Hadoop
SQL
HiveQL
Unix
Shell Scripting
ETL
Python
HDFS
Ansible
Kerberos
REST APIs
Data Engineering

Visa sponsorship

Not detected in the job text

Hiring contact

Patrick Fernandez

Keywords

Big Data
Spark
Scala
Hadoop
CDP
ETL
ELT
Spark SQL
HiveQL
Unix
Shell Scripting
HDFS
Kerberos
REST APIs
Python
JSON
GitHub Copilot
Ansible
Control-M
CI/CD
Data Engineering
Data Governance
Parquet
Avro
ORC
OAuth2
API Gateway
Automation
Data Quality
Anomaly Detection

Report this job