Data Engineer

Description of Assignment:

Data Engineer will be responsible for supporting and developing data pipelines, analytics ready data sets and business intelligence solution(s).

Data Engineer will follow TTC design & development methodologies and documentation standards.

Hybrid work environment according to office policy. Currently at Union Station (61 Front St W, Toronto) with minimum 2 days on site.

Qualifications:

• Mandatory Requirements
• 5+ years of experience in:
• Database development or data engineering for enterprise level solutions

Hands-on experience working with:

• SSIS and/or Microsoft Azure Data Factory (ADF) and other related Azure Services
• Microsoft Azure Synapse and/or SQL Data Warehouse and SQL Server 2016 or later.
• CI/CD pipelines (Azure DevOps)

Other Certifications / Skills:

• A university degree in Computer Science, or the equivalent, combined with directly related experience in a business or computer related discipline.
• Optimize, analyze and improve data integration packages
• Expert understanding and enterprise scale experience working with Data Warehouse (DW) and Business Intelligence (BI) implementations
• Strong understanding of data modelling techniques and data warehouse/data lake design
• Experience with data quality, data cleansing and data stewardship processes and techniques
• Ability to solve complex data problems by analysis, develop appropriate solutions and clearly communicate those solutions to the team.
• Ability to work efficiently and provide accurate time estimates for work to be undertaken.
• Well-developed interpersonal, oral and written communication skills, strong analytical and problem-solving skills.
• Developing Microsoft Power BI reports or other data visualization tools is an asset

Assignment Duties:

• Work with the Enterprise Data project team in designing, developing and maintaining the TTC enterprise data warehouse, data marts, data lakes
• Responsible for designing, developing, supporting, and documenting SSIS and/or Azure Data Factory (ADF) packages to integrate data from multiple systems
• Responsible for designing, developing and documenting complex T-SQL, stored procedures, views, triggers, indexes, etc.
• Responsible for designing and implementing data quality processes
• Assist in the data modelling of the data warehouse/data mart/data lake solution(s)
• Advanced data analysis to provide meaningful data driven insights
• Work closely with the business analyst(s), and other team members, to understand requirements
• Convert business requirements to technical specifications.
• Perform knowledge transfer meetings and sessions.
• Research, propose, document, and share technical solutions with the team.
• Recommend and implement improvements to data quality, automation, and workflows
• Provide accurate time estimates for work to be undertaken

Deliverables:

• Detailed technical design and functional specifications.
• Completed system components 'unit tested' and ready for System, QA and User Acceptance testing.
• Technical support during the various stages of testing (system integration, QA, User Acceptance)
• Implementation preparation.
• Technical documentation
• Post implementation support
• Status Reports