Data Engineer - (Pyspark & Python)

Job Title: Data Engineer - (Pyspark & Python)

Job Location: Montreal, QC (Hybrid)

Job Overview:

We are seeking a skilled Senior Data Engineer with 5 to 7 years of experience specializing in Python and PySpark. In this role, you will design, build, and optimize robust data pipelines while serving as a primary technical point of contact for clients. The ideal candidate bridges the gap between complex data engineering and strategic client communication.

Key Responsibilities

• Data Pipeline Development: Design, develop, and maintain scalable data processing pipelines using Python and PySpark.

• Client Engagement: Act as the technical face of the team, gathering requirements, presenting data solutions, and managing stakeholder expectations.

• Optimization & Performance: Tune Spark jobs for optimal performance, troubleshooting bottlenecks in large-scale data environments.

• Collaboration: Partner with cross-functional teams, including data scientists, analysts, and project managers, to deliver business-critical data products.

Required Skills & Qualifications

• Experience: 5–7 years of professional experience in data engineering.

• Core Technical Skills: Strong proficiency in Python and hands-on expertise with PySpark (Spark SQL, DataFrames, RDDs).

• Client-Facing Skills: Proven experience in client-facing roles, with excellent verbal and written communication skills to articulate technical concepts to non-technical stakeholders.

• Data Ecosystems: Solid understanding of SQL, data warehousing concepts, and cloud data platforms (AWS, Azure, or GCP).

• Software Practices: Familiarity with Git, CI/CD pipelines, and writing clean, maintainable code.

Preferred Qualifications

• Experience working in an Agile/Scrum environment.

• Knowledge of orchestration tools like Apache Airflow.