Big Data Engineer
- Mississauga, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Location : Irving, TX / Mississauga, ON
Required Technical Skills :
Total Exp : 7+
- Core Languages: Mastery of Python (object-oriented design patterns, scripting) and strong proficiency in advanced SQL (window functions, CTEs, complex joins).
- Big Data Frameworks: Deep technical expertise in PySpark (Spark Core, Spark SQL, Spark Streaming), HDFS, Hive, and distributed system architectures
- Soft Skills: Outstanding problem-solving ability, proactive error resolution habits, and clean communication skills tailored for cross-functional collaboration
More about this job
Responsibilities
Apply Python, advanced SQL, and big data technologies to engineering work involving distributed data systems. Resolve errors proactively and collaborate with cross-functional teams through clear communication.
Requirements
Requires 7 or more years of experience, mastery of Python and strong proficiency in advanced SQL. Candidates should have deep expertise in PySpark, HDFS, Hive, and distributed system architectures, along with strong problem-solving and communication skills.
Skills
- Python
- Object-Oriented Design
- Scripting
- Advanced SQL
- Window Functions
- Common Table Expressions
- Complex Joins
- PySpark
- Spark Core
- Spark SQL
- Spark Streaming
- HDFS
- Hive
- Distributed Systems
- Problem-Solving
- Cross-Functional Communication
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Consulting
Keywords
- Big Data Engineering
- Python
- Object-Oriented Design Patterns
- Scripting
- Advanced SQL
- Window Functions
- Common Table Expressions
- Complex Joins
- PySpark
- Spark Core
- Spark SQL
- Spark Streaming
- HDFS
- Hive
- Distributed System Architectures
- Problem-Solving
- Error Resolution
- Cross-Functional Collaboration
- IT Services
- IT Consulting