Find work in Canada.

327,545 jobs across our Canadian network. How we count

Jobs in Canada

25+ jobs

Email me new jobs Save this search

Added 2 mins ago
AI Solutions Engineer
Connor, Clark & Lunn Financial Group Ltd.
Vancouver, BC
Engineer prompts with discipline, write, test, evaluate, and iterate; document failure modes and edge cases
Added 2 mins ago
AI Solutions Engineer
Connor, Clark & Lunn Financial Group Ltd.
Toronto, ON
Engineer prompts with discipline, write, test, evaluate, and iterate; document failure modes and edge cases
Added 2 mins ago
Manager, Maintenance and Mechanical Operations
University of Ottawa
Ottawa, ON · Advanced Medical Research Centre (AMRC)
Full-time
Valid Third Class Operating Engineer license issued by TSSA.
Added 14 mins ago
Full Stack Engineer
ProxyLink
Toronto, ON
$100 to $105 USD / hour
Contract
…technical leads, QA teams, and other stakeholders throughout the Software Development Life Cycle…
Added 14 mins ago
Staff Software Engineer (Fullstack, BE-leaning)
Apostra
ON · United Counties of Stormont, ON
Contract
Our approach favors rapid experimentation over upfront perfection - we test, learn, and then formalize what works.
Added 16 mins ago
Software Engineer II, Toast International
Toast
ON
Title: Software Engineer II, Backend - Toast International
Added 16 mins ago
Senior Software Engineer, Backend - Toast International
Toast
ON
Senior Software Engineer, Backend - Toast International
Added 32 mins ago
GCP Cloud Engineer
TELUS Digital
Remote, Canada
$90,000 to $95,000 CAD / year
Full-time · Remote
We are seeking a highly skilled and motivated GCP Cloud Systems Engineer to lead the design, deployment, and operational excellence of our Google Cloud Platform (GCP) environment. A key…
Added 44 mins ago
QE Engineer
BayOne Solutions
Canada
Contract
We are looking for an experienced QE Engineer to own quality strategy and test coverage for an innovative Visual QA Agent platform. This role combines Playwright automation, visual testing,…
Added 44 mins ago
Full Stack Engineer
Stelvio Inc.
Saskatoon, SK
Full-time
Design, develop, test and debug software applications in line with project requirements.
Added 46 mins ago
Embedded Electrical Designer
Mycionics Inc.
Kitchener, ON
Full-time
…While we have dedicated team members for assembly and core software, the ideal candidate is a well-rounded engineer who remains comfortable jumping onto the bench to validate a prototype or…
Added 46 mins ago
Computer Modeling & Simulation Staff Specialist/Engineer
General Dynamics Land Systems–Canada
London, ON
Full-time
Computer Modeling & Simulation Staff Specialist/Engineer P55
Added 46 mins ago
Senior Full Stack Engineer / Toronto, ON (Onsite) - FTE
AceStack
Toronto, ON
Part-time
We are seeking a Senior Full Stack Engineer with strong hands-on experience in Java, Spring Boot, REST APIs, microservices, automated testing, and modern software engineering practices. The…
Added 46 mins ago
Senior Software Engineer
AVEE HEALTH
Vancouver, BC
Full-time
…while the direction, the tradeoffs and what ships remain the engineer's call. We try new tools and practices early and keep the ones that earn their…
Added 46 mins ago
Senior QA Automation Engineer – Contact Center (French Speaking)
N2P Systems
Toronto, ON
$110,000 to $120,000 CAD / year
Full-time
We are looking for a Senior QA Automation Engineer with strong experience in Contact Center platforms, IVR/routing automation, and test automation, along with French-speaking capability.
Added 1 hour ago
Senior Backend Developer - Spectra
GHGSat
Montreal, QC
Full-time
We are looking for a senior engineer who wants their work to matter, who takes pride in building software that is reliable and genuinely useful, and who makes the team around them better.
Added 1 hour ago
Optical Coherent System Engineer
Nokia
Ottawa, ON · Kanata, ON
Full-time
Active member of the cross-functional product development team involving software, electronics, optics, and test
Added 1 hour ago
Senior SCADA Engineer
HV Logic Ltd.
Calgary, AB
$125,000 to $170,000 CAD / year
Full-time
To support the growth of the company, HV Logic Ltd. currently has an opening for a Senior SCADA Engineer position, to work on challenging projects and contribute to the continued…
Added 1 hour ago
Sr. Staff/Staff Engineer, Digital Design
InnoPhase IoT
Vancouver, BC
Full-time
As a Sr. Staff/Staff Digital Design Engineer, you will be working with a team of design engineers to develop novel SoC products for connectivity and communication. You will also be a key…
Added 1 hour ago
Senior Software Engineer in Test
Okta
Toronto, ON
The Senior Software Development Engineer in Test Opportunity
Added 1 hour ago
Lead, Systems Engineering
L3Harris Technologies
Ottawa, ON
Leading the systems engineering group as part of a dynamic multi-disciplinary team including software, hardware, and systems engineering, the candidate will be responsible for systems…
Added 1 hour ago
Ingénieur Senior, Mécanique - Senior engineer, Mechanical
AJ Walter Aviation
Montreal, QC
Full-time
Design tools, test equipment, and software to test and certify those same components;
Added 1 hour ago
Senior Software Engineer in Test
Okta
Toronto, ON
$118,000 to $162,000 CAD / year
Full-time
The Senior Software Development Engineer in Test Opportunity
Added 1 hour ago
Software Engineer in Test
ALTEN Canada
ON · Ontario, Canada
Other
Key Purpose: To own end-to-end test automation strategy, execution, and quality assurance for our web applications while collaborating with development teams to ensure high-quality,…
Added 1 hour ago
AV Service Engineer - Control Systems & Device Integration
Evertz
Burlington, ON
Full-time
Evertz AV is looking for a Service Engineer to join our AV Service team with a specific focus on Control System customization and deployment with a specific focus on VUE, our…

Global ERP Solutions

Senior Bigdata Developer

Mississauga, ON, Canada

Job type: Full-time
Apply by: Mar 28, 2027
Posting language: English
Posted: Sep 29, 2026

Apply About employer

Applications open in a new tab.

Original job description

We are looking for an experienced Senior Big Data Engineer with strong expertise in Scala, Apache Spark, and Apache Kafka to design and build large-scale, high-performance data processing systems. The ideal candidate will have hands-on experience in real-time and batch data pipelines and a deep understanding of distributed computing.

Provide consulting services on new initiatives (small to large of varying complexity).
Explore new emerging technologies and how they best suit our applications
Develop, code, document, and execute unit tests, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.
Ensure adequate technical documentation and training.
Optimize spark jobs and java applications.
Architect, design, and implement solutions that meet the stakeholder’s needs
Participate actively in requirements gathering, data modeling, and design sessions
Prepare high-level and detailed technical specifications for the projects in accordance with PLC, security, and architecture documentation objectives
Develop detailed plans and accurate estimates for the completion of build, system testing, and implementation phases of a project
Develop, code, document, and execute unit tests, systems, integration and acceptance tests, and testing tools for functions of high complexity
Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts

Knowledge and Experience

Develop and maintain scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently.
Write clean, reusable, and optimized code in Python for data manipulation, analysis, and automation tasks.
Design and implement ETL workflows to extract, transform, and load data from various structured and unstructured sources.
Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver solutions.
Optimize Spark jobs for performance tuning, resource utilization, and minimizing execution time.
Work with distributed computing frameworks to process and analyze big data in a cloud or on-premises environment.
Develop and maintain unit tests to ensure the accuracy and reliability of data pipelines and transformations.
Utilize Spark SQL for querying and managing large datasets stored in distributed systems like Hadoop or cloud storage.
Monitor and troubleshoot data pipeline issues, ensuring reliability and timely delivery of data.
Stay updated with the latest advancements in PySpark, Spark SQL, and big data technologies to improve existing systems.

What do you need to succeed?

Must Have

Experience in developing and optimizing Big Data applications using Scala and Spark on Cloudera/HDP.
Experience in building data pipelines
Experience in developing/designing micro-service architecture.
Working knowledge of Jenkins CI, Git, JIRA
Ability to seek improvements to all aspects of the development process

Apply About employer

More about this job

Responsibilities

Design, build, and optimize scalable batch and real-time data pipelines and distributed data-processing solutions using technologies such as Scala, Spark, Kafka, and Python. Gather requirements, develop and test complex software, prepare technical specifications and project estimates, and provide documentation, training, and technical consulting.

Requirements

Requires experience developing and optimizing Big Data applications with Scala and Spark on Cloudera or HDP, building data pipelines, and designing microservices architecture. Candidates should also have working knowledge of Jenkins CI, Git, and JIRA, and the ability to improve development processes.

Skills

Scala
Apache Spark
Apache Kafka
PySpark
Spark SQL
Python
Big Data
Data Pipelines
ETL
Distributed Computing
Microservices Architecture
Performance Optimization
Unit Testing
Jenkins CI
Git
JIRA

Visa sponsorship

Not detected in the job text

Keywords

Scala
Apache Spark
Apache Kafka
PySpark
Spark SQL
Python
Java
Cloudera
HDP
Big Data
Data Engineering
Data Pipelines
ETL
Batch Processing
Real-Time Processing
Distributed Computing
Microservices Architecture
Cloud Computing
Hadoop
Performance Tuning
Data Modeling
Unit Testing
Integration Testing
Acceptance Testing
Jenkins CI
Git
JIRA
Technical Documentation
Requirements Gathering
System Testing

Report this job