Find work in Canada.

326,484 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 32 mins ago
Head of Technology and AI
Aequilibrium Software Inc.
Remote, Canada
Full-time · Remote
This is an active role with substantial client involvement. You will lead senior technology conversations, help originate and win engagements, work directly on selected client assignments,…
Added 1 hour ago
Principal, Infrastructure Architecture
Royal Bank of Canada
Toronto, ON
Full-time
You will provide direct support to development teams and to the Lead infrastructure Architect. May be called upon to perform the duties of the Lead Infrastructure Architect as events…
Added 1 hour ago
Linux Security Engineer
Zodiac Solutions, Inc
Toronto, ON
Full-time
individual performance in coordination with the Technology Project Manager.
Added 1 hour ago
Senior Data Engineer
AGLC
AB · Edmonton, AB
Full-time
…decision‑making, and innovative digital services. We are looking for a Senior Data Engineer to help shape the next evolution of our data ecosystem and lead the design of modern, scalable…
Added 2 hours ago
Senior Solution Architect - Maximo
Bevertec
Brampton, ON
$120 to $160 CAD / hour
Contract
We are seeking an experienced Senior Solution Architect to support a large-scale Enterprise Asset Management (EAM) Program, with a primary focus on an IBM Maximo implementation and other…
Added 2 hours ago
PLM Solution Architect
Capgemini Engineering
Mirabel, QC
Full-time
Proven experience as a Solution Architect, PLM Architect, or senior PLM consultant delivering enterprise-scale implementations within complex business environments.
Added 2 hours ago
Senior Java Developer - Assistant Vice President
Citi
Mississauga, ON
Full-time
We are seeking a highly skilled Assistant Vice President (AVP), Software Senior Engineer, to design, develop, and maintain robust middleware solutions. The ideal candidate will have deep…
Added 3 hours ago
Senior Bigdata Developer
Global ERP Solutions
Mississauga, ON
Full-time
We are looking for an experienced Senior Big Data Engineer with strong expertise in Scala, Apache Spark, and Apache Kafka to design and build large-scale, high-performance data processing…
Added 3 hours ago
Architectural Technologist
WF Group Inc.
Toronto, ON · Kitchener, ON · Richmond Hill, ON
Working under the direction of the Project Architect and alongside project designers, and in close collaboration with an integrated, multidisciplinary team, this role plays a critical part…
Added 4 hours ago
206438 - Solution Architect
Orion Innovation
Mississauga, ON
Full-time
Job Title: Solution Engineer / Solution Architect
Added 4 hours ago
Lead Software Engineer
TechDoQuest
Toronto, ON
Full-time
As the Senior Developer Lead for the Corporate Technology Finance portfolio, you will act as the principal technical authority, thought leader, and architect for our Oracle Financial…
Added 4 hours ago
Senior Developer Engineer/Leader
Xcelerated Consulting Group, LLC.
Montreal, QC
Contract
Project & Program Governance: Manage delivery timelines through accurate effort estimation, dependency management, risk identification, and proactive, transparent status reporting to senior…
Added 4 hours ago
206438 - Solution Architect
Orion Innovation
Toronto, ON
Job Title: Solution Engineer / Solution Architect
Added 5 hours ago
Principal Solution Architect
Ontario Power Generation
Oshawa, ON
Full-time
Reporting to the Senior Manager of Enterprise Architecture, this position is responsible to Architect and deliver a scalable, automated target-state digital landscape for post-modernization…
Added 6 hours ago
Senior Analyst, Strategic Finance / Analyste principal, Finances stratégiques
Vention
Montreal, QC
Full-time
Sitting at the nexus of business strategy, advanced analytics, and financial discipline, the Senior Analyst, Strategic Finance serves as the core quantitative engine evaluating commercial…
Added 8 hours ago
Senior Solutions Architect, IAM-2
Royal Bank of Canada
Toronto, ON
Full-time
Deliver architectures and designs in both agile and iterative waterfall project delivery models. Propose and lead delivery teams through phased solution delivery approaches to improve the…
Added 15 hours ago
Senior Solutions Manager
Vena Solutions
Canada
Full-time
As our Senior Solutions Manager, you will be architecting Proof of Concept solutions for our clients to demonstrate how the Vena platform works. You will quickly translate prospect…
Added 16 hours ago
Lead Full-Stack GenAI Developer (Contractor)
KData AI
Toronto, ON
Full-time
We are seeking a Senior Lead Full-Stack GenAI Developer for a 6-month contract engagement to lead the end-to-end hands-on build, integration, and deployment of enterprise GenAI and Agentic…
Added 16 hours ago
Senior Solutions Architect, IAM-2
RBC
Toronto, ON
Full-time
Deliver architectures and designs in both agile and iterative waterfall project delivery models. Propose and lead delivery teams through phased solution delivery approaches to improve the…
Added 17 hours ago
Senior .NET Architect
Actegro
Open Hall, NL
Full-time
We are currently looking for a creative and qualified person to join our team as a full-time Senior IT consultant. Solid technical background, prior experience in the professional services…
Added 17 hours ago
Application Architect – EHealth - RQ00386
S M Software Solutions Inc
Fredericton, NB
Internship
We are seeking an experienced Application Architect – EHealth with extensive experience in provincial healthcare, Electronic Health Records (EHR) applications, eHealth platforms,…
Added 17 hours ago
Application Architect – EHealth - RQ00386
S M Software Solutions Inc
Fredericton, NB
Internship
We are seeking an experienced Application Architect – EHealth with extensive experience in provincial healthcare, Electronic Health Records (EHR) applications, eHealth platforms,…
Added 17 hours ago
Application Architect – EHealth - RQ00386
S M Software Solutions Inc
Fredericton, NB
Internship
We are seeking an experienced Application Architect – EHealth with extensive experience in provincial healthcare, Electronic Health Records (EHR) applications, eHealth platforms,…
Added 20 hours ago
Senior Manager, Major Projects Advisory
KPMG
ON · Toronto, Ontario
Full-time
…national team of over 250 including economists, engineers, project management professionals, finance professionals, accountants, and…
Added 21 hours ago
Senior Data Modeler
OMERS
Toronto, ON · Head Office Toronto
Full-time
The OMERS Products and Technology team is seeking a self-motivated and highly experienced Senior Data Modeler to join the Pension Architecture team. The team is responsible for modernizing…

Global ERP Solutions

Senior Bigdata Developer

Mississauga, ON, Canada

Job type: Full-time
Apply by: Mar 28, 2027
Posting language: English
Posted: Sep 29, 2026

Apply About employer

Applications open in a new tab.

Original job description

We are looking for an experienced Senior Big Data Engineer with strong expertise in Scala, Apache Spark, and Apache Kafka to design and build large-scale, high-performance data processing systems. The ideal candidate will have hands-on experience in real-time and batch data pipelines and a deep understanding of distributed computing.

Provide consulting services on new initiatives (small to large of varying complexity).
Explore new emerging technologies and how they best suit our applications
Develop, code, document, and execute unit tests, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.
Ensure adequate technical documentation and training.
Optimize spark jobs and java applications.
Architect, design, and implement solutions that meet the stakeholder’s needs
Participate actively in requirements gathering, data modeling, and design sessions
Prepare high-level and detailed technical specifications for the projects in accordance with PLC, security, and architecture documentation objectives
Develop detailed plans and accurate estimates for the completion of build, system testing, and implementation phases of a project
Develop, code, document, and execute unit tests, systems, integration and acceptance tests, and testing tools for functions of high complexity
Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts

Knowledge and Experience

Develop and maintain scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently.
Write clean, reusable, and optimized code in Python for data manipulation, analysis, and automation tasks.
Design and implement ETL workflows to extract, transform, and load data from various structured and unstructured sources.
Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver solutions.
Optimize Spark jobs for performance tuning, resource utilization, and minimizing execution time.
Work with distributed computing frameworks to process and analyze big data in a cloud or on-premises environment.
Develop and maintain unit tests to ensure the accuracy and reliability of data pipelines and transformations.
Utilize Spark SQL for querying and managing large datasets stored in distributed systems like Hadoop or cloud storage.
Monitor and troubleshoot data pipeline issues, ensuring reliability and timely delivery of data.
Stay updated with the latest advancements in PySpark, Spark SQL, and big data technologies to improve existing systems.

What do you need to succeed?

Must Have

Experience in developing and optimizing Big Data applications using Scala and Spark on Cloudera/HDP.
Experience in building data pipelines
Experience in developing/designing micro-service architecture.
Working knowledge of Jenkins CI, Git, JIRA
Ability to seek improvements to all aspects of the development process

Apply About employer

More about this job

Responsibilities

Design, build, and optimize scalable batch and real-time data pipelines and distributed data-processing solutions using technologies such as Scala, Spark, Kafka, and Python. Gather requirements, develop and test complex software, prepare technical specifications and project estimates, and provide documentation, training, and technical consulting.

Requirements

Requires experience developing and optimizing Big Data applications with Scala and Spark on Cloudera or HDP, building data pipelines, and designing microservices architecture. Candidates should also have working knowledge of Jenkins CI, Git, and JIRA, and the ability to improve development processes.

Skills

Scala
Apache Spark
Apache Kafka
PySpark
Spark SQL
Python
Big Data
Data Pipelines
ETL
Distributed Computing
Microservices Architecture
Performance Optimization
Unit Testing
Jenkins CI
Git
JIRA

Visa sponsorship

Not detected in the job text

Keywords

Scala
Apache Spark
Apache Kafka
PySpark
Spark SQL
Python
Java
Cloudera
HDP
Big Data
Data Engineering
Data Pipelines
ETL
Batch Processing
Real-Time Processing
Distributed Computing
Microservices Architecture
Cloud Computing
Hadoop
Performance Tuning
Data Modeling
Unit Testing
Integration Testing
Acceptance Testing
Jenkins CI
Git
JIRA
Technical Documentation
Requirements Gathering
System Testing

Report this job