Data Engineer
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
- 6 8+ years in production data pipeline L1/L2 support.
- Hands-on with GCP Pub/Sub, Dataflow (Apache Beam), Datastream, and Cloud SQL PostgreSQL.
- Experience with CDC (Debezium/Datastream), CSV ingestion, CRM data, and API-based enrichment.
- Monitor and troubleshoot data pipelines, failures, delays, DLQs, alerts, and data inconsistencies.
- Perform incident management, RCA, data reconciliation, reruns, and production fixes within SLA.
- Support staging and harmonized data layers, testing, deployments, and operational housekeeping.
- Maintain runbooks, monitoring, and known-issue documentation.
- Good Java programming skills for pipeline support and minor enhancements.
More about this job
Responsibilities
Provide L1/L2 production support for data pipelines, focusing on monitoring, troubleshooting failures, and resolving data inconsistencies. Perform incident management, root cause analysis, and maintain operational documentation and runbooks.
Requirements
Requires 8+ years of experience in production data pipeline support with hands-on expertise in GCP tools and CDC. Proficiency in Java programming is required for pipeline support and minor enhancements.
Skills
- GCP Pub/Sub
- Dataflow
- Apache Beam
- Datastream
- Cloud SQL PostgreSQL
- CDC
- Debezium
- Java
- Incident Management
- Root Cause Analysis
- Data Reconciliation
- Pipeline Monitoring
- API Enrichment
- CRM Data
- CSV Ingestion
- Production Support
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Engineering
- Consulting
Keywords
- Data Engineer
- GCP
- Pub/Sub
- Dataflow
- Apache Beam
- Datastream
- Cloud SQL
- PostgreSQL
- CDC
- Debezium
- Java
- L1 Support
- L2 Support
- SLA
- DLQ
- Data Pipeline
- CRM
- API
- Incident Management
- RCA
- Data Reconciliation
- IT Services
- IT Consulting