Report Developer - Junior
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
The Government of Ontario is undertaking a large-scale Data and AI transformation initiative through the Ontario Data Platform (ODP).
The organization is seeking a Junior Report Developer / Data Engineer to develop, maintain, and optimize enterprise data solutions using Azure cloud technologies.
The successful candidate will build scalable data pipelines, develop ETL/ELT processes, support data integration, and enable analytics and reporting capabilities across government organizations.
Key responsibilitiesData Engineering and ETL Development
-
Design and maintain batch and near-real-time data pipelines.
-
Develop data ingestion frameworks.
-
Build and optimize ETL/ELT processes.
-
Implement data validation, monitoring, and reconciliation.
Databricks Development
-
Develop Databricks notebooks, workflows, and processing jobs.
-
Build Spark-based data transformation pipelines.
-
Implement Bronze, Silver, and Gold medallion architecture.
-
Manage Delta Lake tables and optimize performance.
-
Monitor and troubleshoot Databricks jobs.
Azure Data Storage and Integration
-
Develop data solutions using Azure Data Lake Storage (ADLS).
-
Implement data integration with source systems.
-
Apply partitioning, optimization, and archival strategies.
-
Support metadata management and data governance.
Software Development and Automation
-
Develop reusable scripts and automation frameworks.
-
Work with Azure DevOps, Git, and CI/CD pipelines.
-
Perform code reviews, testing, and deployment activities.
-
Maintain technical documentation.
-
Follow secure coding and software engineering standards.
Collaboration
-
Work with architects, data scientists, analysts, and business stakeholders.
-
Participate in Agile ceremonies and sprint planning.
-
Contribute to solution design and architecture reviews.
-
Provide technical guidance and knowledge sharing.
Skill
Requirement
Azure Data Factory (ADF)
Data pipeline development
Azure Data Lake Storage (ADLS)
Cloud data storage
Databricks
Notebook and workflow development
Apache Spark / PySpark
Distributed data processing
Python
Scripting and development
SQL
Data querying and transformation
Delta Lake
Lakehouse and table management
ETL / ELT
Data integration and transformation
Azure DevOps
CI/CD and deployment
Git
Version control
REST APIs
Data integration
Data Governance
Security, privacy, access control
Additional requirements:
-
Degree or diploma in Computer Science, Software Engineering, IT, or related discipline.
-
Knowledge of Lakehouse architecture.
-
Experience with automated testing and deployment.
-
Understanding of data quality and data governance.
More about this job
Responsibilities
Develop, maintain, and optimize scalable data pipelines and ETL/ELT processes using Azure, Databricks, Spark, and Delta Lake. Support data integration, quality, governance, automation, deployment, and analytics while collaborating with technical and business stakeholders.
Requirements
A degree or diploma in Computer Science, Software Engineering, IT, or a related discipline is required, along with knowledge of Lakehouse architecture. The role also calls for experience with automated testing and deployment and an understanding of data quality and governance.
Skills
- Azure Data Factory
- Azure Data Lake Storage
- Databricks
- Apache Spark
- PySpark
- Python
- SQL
- Delta Lake
- ETL/ELT
- Azure DevOps
- Git
- CI/CD
- REST APIs
- Data Governance
- Data Quality
- Data Pipeline Development
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Government & Public Sector
Keywords
- Azure Data Factory
- Azure Data Lake Storage
- Databricks
- Apache Spark
- PySpark
- Python
- SQL
- Delta Lake
- ETL/ELT
- Data Pipelines
- Data Ingestion
- Data Integration
- Lakehouse Architecture
- Medallion Architecture
- Bronze, Silver, And Gold Layers
- Azure DevOps
- Git
- CI/CD
- REST APIs
- Data Governance
- Data Quality
- Data Validation
- Metadata Management
- Automated Testing
- Cloud Data Storage
- Distributed Data Processing
- Agile
- Data Transformation
- Data Security
- Data Privacy