RQ11258 - Sr. Software Developer - ETL
- Toronto, ON, Canada
$70.82 to $106.25 CAD / hour
Applications open in a new tab.
Job details
- Pay
- $70.82 to $106.25 CAD / hour
- Experience
- 10+ years of experience in:
- Posting language
- English
Original job description
RQ11258 - Sr. Software Developer - ETL
9-month contract (188 business days) - possible extension
ONSITE 5 days - 5700 Yonge Street
Security Level: CRJMC
Must-haves:
10+ years of experience in:
- Designing and developing scalable Medallion Data Lakehouse architectures.
- Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks.
- Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.
- Strong knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling.
- CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines.
- Power BI
Nice-to-have:
- Public Sector Enterprise Architecture artifacts (or similar)
Description:
· Design technical solutions for data acquisition and storage into our centralized data repository.
· Develop ELT scripts, design data-driven logic and conduct unit testing.
· Conduct database modeling and design as to improve overall performance.
· Produce design artifacts and documentation which will allow future support of the implemented solutions.
· Investigate and resolve incidents and identify whether the problem is caused by the data loading code or is due to bad data received from the data provider.
· Execute service requests related to routine and ad-hoc data loads.
· Provide the data quality check and report on the data quality issue.
AI Disclaimer: Source Code may use artificial intelligence (AI) tools to assist in certain aspects of its recruiting and business operations.
Note: The higher end of the range is intended for absolutely exceptional candidates who meet all must-have requirements and most or all nice-to-have qualifications. The client will evaluate candidates based on both rate expectations and overall skill set when shortlisting.
INCORPORATED RATE RANGE (7.25 billable hours per day)
- $88.52/hr - $106.25/hr Inc.
T4 RATE RANGE (7.25 billable hours per day)
- $70.82/hr - $85.00/hr T4
More about this job
Responsibilities
The Senior Software Developer at Source Code will design data acquisition and storage solutions, build and test ELT pipelines, and resolve data loading incidents. The role also covers database design, documentation and data quality checks.
Requirements
Candidates need 10+ years of experience with Medallion Lakehouse architecture, Delta Lake and Databricks, ETL/ELT pipelines in Azure Data Factory and dbt, relational and dimensional modeling, CI/CD for data pipelines, and Power BI. Public sector enterprise architecture artifacts are an asset.
Skills
- Databricks
- Delta Lake
- PySpark
- Delta Live Tables
- Azure Data Factory
- dbt
- SQL
- SQL Server
- Azure Synapse
- PostgreSQL
- Dimensional modeling
- Relational database design
- CI/CD
- Azure DevOps
- GitHub Actions
- Power BI
- Data ingestion
- Data transformation
- Unit testing
- Data quality checks
- Incident investigation
- Technical documentation
- ETL
- ELT
- Data lakehouse design
Categories
- Software
- Technology
- Data & Analytics
- Consulting
Keywords
- ETL
- ELT
- Senior Software Developer
- Data Engineer
- Databricks
- Delta Lake
- Medallion Architecture
- Lakehouse
- Azure Data Factory
- PySpark
- Delta Live Tables
- dbt
- SQL Server
- Synapse
- PostgreSQL
- Dimensional modeling
- Azure DevOps
- GitHub Actions
- Power BI
- Data warehouse
Seniority
Senior
Tools
- Databricks
- Delta Lake
- Azure Data Factory
- dbt
- Power BI
- Azure DevOps
- GitHub Actions
- SQL Server
- Azure Synapse
- PostgreSQL
Languages
- English