Job#: 3057559
Job Description:
Databricks Data Engineer
Overview:
Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise Databricks data hub. This Engineer will focus on building data pipelines, ingesting and transforming data from multiple source systems, and developing Bronze/Silver/Gold layers within a medallion architecture, while also supporting the migration of existing workloads from Hive Metastore to Unity Catalog.
A successful candidate will bring strong hands-on Databricks data engineering experience, including SQL, Python/PySpark, data migration and ETL development, with experience working in Azure Data Factory and Unity Catalog environments.
Responsibilities:
- Design, develop, enhance, and maintain data pipelines within the Databricks platform.
- Build and support data processing across Bronze, Silver, and Gold layers following medallion architecture practices.
- Support the migration of existing jobs and workloads from Hive Metastore to Unity Catalog.
- Ingest, transform, and migrate data from multiple enterprise sources, including Db2, SQL Server, structured data feeds, card networks, and file-based sources.
- Develop data transformations using SQL, Python, and PySpark.
- Build curated datasets, materialized/metric views, and downstream data feeds to support data consumers.
- Support Azure Data Factory (ADF) pipelines and integrations as needed as part of the broader data migration environment.
- Troubleshoot pipeline failures, data issues, transformation logic, and other technical problems encountered during migration.
- Assist with transitioning users and workloads into the Unity Catalog environment, including supporting appropriate data access.
- Partner with the team’s Data Architect, who will own the underlying data modeling and architecture decisions.
- Collaborate with downstream teams responsible for BI and data consumption while remaining primarily focused on data engineering and migration.
- Participate in the assessment and migration of existing workloads as the team identifies current jobs, users, dependencies, and data that must transition to the new environment.
Requirements:
- Strong hands-on experience working as a Databricks Data Engineer or in a comparable data engineering role.
- Strong experience designing, developing, and maintaining ETL/ELT and data ingestion pipelines.
- Hands-on experience building data pipelines using a Bronze/Silver/Gold medallion architecture.
- Strong development skills with SQL.
- Hands-on development experience with Python and PySpark.
- Experience migrating and transforming data from relational and/or file-based source systems.
- Hands-on experience with Azure Data Factory (ADF) for data movement, integration, and/or pipeline orchestration.
- Experience working with SQL Server or similar relational database technologies as upstream data sources.
- Understanding of Databricks tables, objects, and data engineering workflows.
- Strong troubleshooting and problem-solving skills, particularly around real-world data migration and ETL scenarios.
- Ability to work effectively within a larger engineering environment where architecture, data engineering, ADF, and BI responsibilities may be distributed across different teams.
Nice to Have:
- Hands-on experience with Databricks Unity Catalog, including working with Unity Catalog objects, tables, and access controls.
- Previous experience migrating workloads from Hive Metastore to Unity Catalog.
- Experience with DB2 or other legacy/enterprise data sources.
- Experience within highly regulated environments where data governance, security, and retention requirements are important.
- Databricks certifications, such as Databricks Certified Data Engineer or Databricks Certified Developer for Apache Spark.
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.
Everforth Apex Benefits Overview: In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA.
© 2026 Everforth, Inc. All rights reserved.
Everforth Apex Systems is part of the Commercial Segment of Everforth, Inc.
NYSE: EFOR
4400 Cox Road
Suite 200
Glen Allen, Virginia 23060
Everforth Apex is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Benefits Department at [email protected] or 804-523-8228. (Do not submit resumes or solicit consultants to this email address). UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex.
