Data Engineer

Data Engineer

Location: Union Station (61 Front St W, Toronto) with minimum 2 days on site.

Duration: 12+ months extendable contract

Job Description:

Mandatory Requirements

5+ years of experience in:

• Database development or data engineering for enterprise level solutions
• Hands-on experience working with:

• SSIS and/or Microsoft Azure Data Factory (ADF) and other related Azure Services
• Microsoft Azure Synapse and/or SQL Data Warehouse and SQL Server 2016 or later.
• CI/CD pipelines (Azure DevOps)

Other Certifications / Skills

• A university degree in Computer Science, or the equivalent, combined with directly related experience in a business or computer related discipline.
• Optimize, analyze and improve data integration packages
• Expert understanding and enterprise scale experience working with Data Warehouse (DW) and Business Intelligence (BI) implementations
• Strong understanding of data modelling techniques and data warehouse/data lake design
• Experience with data quality, data cleansing and data stewardship processes and techniques
• Ability to solve complex data problems by analysis, develop appropriate solutions and clearly communicate those solutions to the team.
• Ability to work efficiently and provide accurate time estimates for work to be undertaken.
• Well-developed interpersonal, oral and written communication skills, strong analytical and problem-solving skills.
• Developing Microsoft Power BI reports or other data visualization tools is an asset

Assignment Duties

• Work with the Enterprise Data project team in designing, developing and maintaining the TTC enterprise data warehouse, data marts, data lakes
• Responsible for designing, developing, supporting, and documenting SSIS and/or Azure Data Factory (ADF) packages to integrate data from multiple systems
• Responsible for designing, developing and documenting complex T-SQL, stored procedures, views, triggers, indexes, etc.
• Responsible for designing and implementing data quality processes
• Assist in the data modelling of the data warehouse/data mart/data lake solution(s)
• Advanced data analysis to provide meaningful data driven insights
• Work closely with the business analyst(s), and other team members, to understand requirements
• Convert business requirements to technical specifications.
• Perform knowledge transfer meetings and sessions.
• Research, propose, document, and share technical solutions with the team.
• Recommend and implement improvements to data quality, automation, and workflows
• Provide accurate time estimates for work to be undertaken