Databricks Engineer-Canada
- Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Posting language
- English
- Posted
Original job description
About V4C
At V4C, we empower enterprise organizations to unlock the full value of their data. As a fast-growing technology consultancy, our Databricks practice partners with industry leaders to architect modern data platforms, build high-performance data pipelines, and accelerate enterprise AI and analytics initiatives.
We are seeking a production-focused Senior Data Engineer with exceptional communication skills and a proven track record of delivering reliable data pipelines. In this role, you will have end-to-end production ownership of our data platforms, ensuring high data quality and robust system performance. The ideal candidate prioritizes practical problem-solving and hands-on execution over high-level architecture. You excel at debugging complex data issues and can clearly
communicate technical resolutions using a direct, impact-driven approach.
Key Responsibilities
Core Technical Expertise
At V4C, we empower enterprise organizations to unlock the full value of their data. As a fast-growing technology consultancy, our Databricks practice partners with industry leaders to architect modern data platforms, build high-performance data pipelines, and accelerate enterprise AI and analytics initiatives.
We are seeking a production-focused Senior Data Engineer with exceptional communication skills and a proven track record of delivering reliable data pipelines. In this role, you will have end-to-end production ownership of our data platforms, ensuring high data quality and robust system performance. The ideal candidate prioritizes practical problem-solving and hands-on execution over high-level architecture. You excel at debugging complex data issues and can clearly
communicate technical resolutions using a direct, impact-driven approach.
Key Responsibilities
- Pipeline Development: Build, optimize, and maintain robust data pipelines using SQL, dbt, and Python
- Data Quality & Testing: Implement rigorous data-quality checks and automated testing frameworks within dbt to proactively catch anomalies
- Production Ownership: Monitor production workflows, manage alerts, and rapidly debug pipeline failures from root cause to permanent fix
- Data Transformation: Write efficient PySpark transformations to process large-scale datasets within our Lakehouse environment
- Collaboration & Communication: Translate complex data issues into clear, concise action plans for both technical teammates and business stakeholders
Core Technical Expertise
- SQL & dbt: Expert-level SQL skills and extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt
- Python: Strong proficiency in writing clean, maintainable Python scripts for data manipulation, automation, and API integrations
- PySpark: Decent, practical experience utilizing PySpark for data transformation and basic performance tuning (e.g., handling joins, DataFrame API)
- Lakehouse Knowledge: Functional understanding of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations
- Strong Communication: Exceptional written and spoken communication skills. Ability to explain problems and results directly and concisely
- Debugging & Problem Solving: Superior troubleshooting skills with a methodical approach to identifying root causes and validating fixes
- Production Mindset: Experience owning pipelines end-to-end, including CI/CD deployment, monitoring, and handling schema drift
More about this job
Responsibilities
Build, optimize, and maintain data pipelines using SQL, dbt, Python, and PySpark, while implementing data-quality checks and automated tests. Own production workflows end to end by monitoring systems, resolving pipeline failures, and communicating clear action plans to technical and business stakeholders.
Requirements
Requires expert SQL and extensive hands-on dbt experience, strong Python proficiency, and practical PySpark and Lakehouse knowledge. Candidates should have strong troubleshooting and communication skills, plus experience with production ownership, CI/CD, monitoring, and schema drift.
Skills
- SQL
- dbt
- Python
- PySpark
- Data Pipeline Development
- Data Quality Testing
- Delta Lake
- Lakehouse Technologies
- Data Transformation
- Production Monitoring
- Debugging
- Root Cause Analysis
- CI/CD
- Schema Drift Management
- Performance Tuning
- Communication
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Consulting
Keywords
- Databricks
- SQL
- dbt
- Python
- PySpark
- Delta Lake
- Lakehouse
- Data Pipelines
- Data Engineering
- Data Quality
- Automated Testing
- Schema Tests
- Snapshots
- Data Transformation
- API Integrations
- Production Monitoring
- Alert Management
- Debugging
- Root Cause Analysis
- CI/CD
- Schema Drift
- DataFrame API
- Performance Tuning
- ACID Transactions
- MERGE Operations
- Enterprise AI
- Analytics
- Data Platforms