Technology Lead - Databricks
- Burnaby, BC, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Education
- Bachelor’s degree
- Experience
- At least 4 years of Information Technology experience
- Posting language
- English
- Posted
Original job description
Infosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong expertise in Azure data services, Databricks, PySpark, and modern data engineering practices to support enterprise analytics and data modernization initiatives.
Required Qualifications
Estimated annual compensation range for the candidate based in the below location will be:
Ontario - $ 92740 to $ 123375
British Columbia - $ 90450 to $ 136500
Additional Required Qualifications
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
- At least 4 years of Information Technology experience
- Candidate must be located within commuting distance of Mississauga, ON / Calgary, AB / Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.
- Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.
- Build and maintain data ingestion frameworks using Azure Data Factory (ADF).
- Develop batch and real-time data processing solutions using Spark and Event Hubs.
- Implement Delta Lake and Medallion Architecture (Bronze, Silver, Gold).
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Develop data quality, validation, and reconciliation frameworks.
- Collaborate with business, analytics, and data science teams to deliver data solutions.
- Implement security, governance, and access controls using Unity Catalog and RBAC.
- Build CI/CD pipelines and automate deployments for data platforms.
- Troubleshoot production issues and support ongoing operational excellence.
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Microsoft Azure Fundamentals (AZ-900)
- Databricks Certified Data Engineer Associate/Professional
Estimated annual compensation range for the candidate based in the below location will be:
Ontario - $ 92740 to $ 123375
British Columbia - $ 90450 to $ 136500
Additional Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
More about this job
Responsibilities
Design, develop, and optimize scalable cloud-based data solutions using Azure Databricks and modern data engineering practices. Collaborate with cross-functional teams to build data pipelines, ensure data quality, and maintain operational excellence.
Requirements
Requires at least 4 years of IT experience and a bachelor's degree or equivalent professional experience. Candidates must be authorized to work in Canada without employer-based visa sponsorship.
Skills
- Azure Databricks
- Data Engineering
- PySpark
- Azure Data Factory
- Spark
- Event Hubs
- Delta Lake
- Medallion Architecture
- ETL/ELT Pipelines
- Unity Catalog
- RBAC
- CI/CD
- Data Quality
- Cloud Computing
- Data Modernization
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Consulting
Keywords
- Azure Databricks
- Data Engineering
- PySpark
- Azure Data Factory
- Spark
- Event Hubs
- Delta Lake
- Medallion Architecture
- ETL
- ELT
- Unity Catalog
- RBAC
- CI/CD
- Data Quality
- Cloud Computing
- DP-203
- AZ-900
- Data Modernization
- Data Analytics
- Automation
- Governance
- Security
- Information Technology
- Consulting
- Digital Transformation