Initially remote but then onsite from Mississauga, ON.
ONSITE INTERVIEW MUST
We are seeking a Senior Data Engineer to design, develop, and implement scalable data solutions and processing pipelines. The ideal candidate will have strong hands-on experience in data modeling, SQL, Python, and PySpark/Spark, with the ability to work closely with development, application, and business teams to translate data requirements into effective technical solutions.
Key Responsibilities
- Design and develop scalable data solutions, pipelines, and data processing frameworks.
- Create and maintain logical and physical data models in collaboration with developers and technical stakeholders.
- Translate business and application requirements into effective data models and data structures.
- Develop and implement data processing solutions using Python and PySpark/Spark.
- Write and optimize complex SQL queries for data processing and analysis.
- Implement data solutions across data warehouses and data lakes.
- Optimize data processing performance, data quality, and reliability.
- Collaborate with application, development, and business teams to understand data requirements and deliver scalable solutions.
- Support data initiatives related to analytics, Artificial Intelligence, and Machine Learning.
- Contribute to data governance, quality, and best practices across data solutions.
Required Qualifications & Skills
- 8+ years of experience in Data Engineering or a closely related field.
- Strong hands-on experience with Data Modeling, including logical and physical data models.
- Strong SQL development and optimization skills.
- Hands-on Python development experience.
- Strong hands-on experience with PySpark/Spark, including data processing and pipeline development.
- Experience working with Data Warehouses and/or Data Lakes.
- Strong understanding of data engineering concepts, data processing, and scalable data solutions.
- Ability to collaborate effectively with technical and business stakeholders.
Preferred Qualifications
- Experience with Generative AI (GenAI) or Machine Learning initiatives.
- Exposure to or hands-on experience with Google ADK.
- Experience with cloud platforms such as GCP, AWS, or Azure.
- Experience with ETL/ELT frameworks and modern data engineering technologies.
- Previous experience in the Banking or Financial Services industry is highly preferred.