Position: Cloud Data Engineer
Location: Toronto, ON
Job ID#: RQ11576
Duration: 12 Months
Role Overview
We are seeking an experienced Cloud Data Engineer to support the design, development, implementation, and optimization of modern cloud-based data platforms and services. The successful candidate will contribute to enterprise data initiatives, including data pipeline development, cloud modernization, metadata management, governance integration, and DataOps automation.
Key Responsibilities
- Design
and develop data pipelines from source systems through to end-user
consumption.
- Optimize
and enhance data pipeline performance and reliability.
- Develop
scalable ETL/ELT processes, data pipelines, and integration solutions.
- Implement
DataOps practices, including deployment automation, testing, monitoring,
and operational support.
- Design
and support cloud-native data engineering solutions and modern data
platform architectures.
- Implement
metadata, lineage, and data quality capabilities within cloud data
environments.
- Develop
integration solutions using APIs, event-driven architectures, batch
processing, and streaming technologies.
- Automate
metadata collection, data movement, and operational processes.
- Support
cloud modernization and enterprise data migration initiatives.
- Collaborate
with architects, data modelers, and governance teams to operationalize
data standards, metadata, and common data models.
- Troubleshoot
complex technical issues and develop practical solutions.
- Support
performance optimization and scalability initiatives for cloud data
platforms.
Qualifications
General Skills
- Demonstrated
experience designing, implementing, and supporting cloud-based data
platforms and services.
- Experience
with cloud data platforms, data management, and data exchange
technologies.
- Experience
with commercial and open-source database development and management
technologies.
- Experience
managing Data as a Service (DaaS), Database as a Service (DBaaS), Data
Warehouse as a Service (DWaaS), and related storage platforms.
- Experience
with data pipeline and workflow development, orchestration, deployment,
and automation.
- Strong
programming skills with the ability to integrate multiple platforms and
automate tasks.
- Experience
implementing DataOps principles, best practices, and Agile delivery
methodologies.
- Experience
with CI/CD processes and data provisioning automation.
- Experience
supporting digital products, data analysis, data exchange, data
provisioning, and data security.
- Extensive
experience designing, developing, and implementing data migration and
conversion solutions involving very large datasets.
- Experience
working with OLAP and OLTP environments.
- Experience
supporting cloud SaaS, PaaS, and IaaS environments.
- Experience
designing data warehouses, data lakes, data lakehouses, fact/dimension
models, and data mappings.
- Experience
managing cloud data services including storage, repositories, key vaults,
virtual machines, and related infrastructure.
- Experience
with structured, semi-structured, and unstructured data ingestion and
provisioning solutions.
- Experience
with performance monitoring and tuning of DataOps environments.
- Excellent
analytical, communication, presentation, problem-solving, and stakeholder
engagement skills.
- Proven
ability to deliver work within deadlines and contribute effectively in
team environments.
Deliverables
The selected candidate will contribute to:
- Data
pipelines and integration services
- Automated
metadata collection and synchronization processes
- Cloud
data platform implementation and configuration
- Data
quality and lineage enablement
- CI/CD
and DataOps automation
- Data
migration and interoperability services
- Cloud-hosted
data products and reusable data services
- Metadata
and governance platform integrations
Preferred Skills
- Experience
with Databricks, Delta Lake, and Databricks SQL.
- Knowledge
of Medallion Architecture.
- Experience
with Microsoft Fabric and Azure Data Services.
- Experience
with Microsoft Purview.
- Experience
with Informatica or equivalent integration platforms.
- Experience
operationalizing common data models and metadata repositories.
- Experience
with graph technologies and semantic repositories.
- Knowledge
of AODA and accessibility-related standards.
- Ability
to adapt quickly to changing priorities and tight deadlines.
- Previous
public sector experience is considered an asset.
Work Arrangement
About Symbiotic Digital.
Symbiotic Digital provides the IT Experts you need that solve problems and get things done. See what the top 2% in their field can do for you. (Symbiotic Digital is a division of Symbiotic Group Inc.) We serve
customers in two ways, we provide:
- Digital
Experts: IT Consulting expertise. Bright Minds That Produce Proven Results
- Recruitment:
Find The Right People You Need
Serving IT & Business leaders, Symbiotic Digital provides a business system that enable us to provide the Expert Technical staff needed to solve challenging business and IT problems. IT leaders in the most reputable organizations in Canada have relied on Symbiotic Digital to help them staff difficult assignments with proven Experts uniquely evaluated by our proven QMS- Quality Management System Staff Development Model. We are a 100% Indigenous owned company.
Learn more online at https://www.symbioticgroup.com/home-sd/.
Please submit your most recent resume to: RecDep@symbioticgroup.com
View All Jobs online at: https://www.symbioticgroup.com/view-jobs/
