Azure Databricks Architect
- Toronto, ON, Canada
Contract
Applications open in a new tab.
Job details
- Job type
- Contract
- Apply by
- Posting language
- English
- Posted
Original job description
Azure Databricks Architect
Type: Long Term Contract
Role Overview:
We are seeking a Principal Azure Databricks Architect to design, architect, and deliver scalable, high-performance data solutions on Microsoft Azure. The ideal candidate will have strong hands-on expertise in Azure Databricks, ADLS, Java/Scala-based REST APIs, and Kafka/Messaging, along with the ability to provide technical leadership across data engineering initiatives.
Key Responsibilities
- Design and implement scalable Azure data architectures using Azure Databricks and ADLS.
- Develop and integrate Java/Scala-based REST APIs for data and application services.
- Design and implement real-time data pipelines using Kafka and Message Queues (MQ).
- Lead Databricks-based data engineering and transformation solutions across enterprise environments.
- Define architecture standards, design patterns, security, performance, and scalability best practices.
- Collaborate with data engineers, application teams, architects, and business stakeholders.
- Troubleshoot complex data, integration, and performance issues.
- Provide technical guidance and mentorship to a small team of engineers.
Must-Have Skills
- Strong experience with Azure Data Lake Storage (ADLS)
- Extensive hands-on experience with Azure Databricks
- Strong development experience with Java/Scala and REST APIs
- Hands-on experience with Kafka and/or Message Queues (MQ)
- Strong understanding of cloud-based data architecture and distributed data processing
- Experience designing scalable and highly available enterprise data solutions
Good to Have
- Experience with Python APIs and scripting
- Experience leading or mentoring small technical teams
- Knowledge of Azure data services and modern data engineering practices
- Experience with CI/CD, DevOps, and infrastructure automation
Education
Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
More about this job
Responsibilities
Design and deliver scalable Azure data architectures and Databricks-based engineering solutions, including REST API integrations and real-time pipelines using Kafka or message queues. Establish architecture and engineering best practices, troubleshoot complex issues, collaborate across teams, and mentor engineers.
Requirements
Requires extensive hands-on experience with Azure Databricks and ADLS, strong Java or Scala development and REST API experience, and experience with Kafka or message queues. Candidates should understand cloud data architecture and distributed processing and be able to design scalable, highly available enterprise solutions; a bachelor's or master's degree in a related field is specified.
Skills
- Azure Databricks
- Azure Data Lake Storage
- Java
- Scala
- REST APIs
- Apache Kafka
- Message Queues
- Cloud Data Architecture
- Distributed Data Processing
- Data Engineering
- Real-Time Data Pipelines
- Python
- CI/CD
- DevOps
- Infrastructure Automation
- Technical Leadership
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Management & Leadership
- Finance & Accounting
Keywords
- Azure Databricks
- Microsoft Azure
- Azure Data Lake Storage
- ADLS
- Java
- Scala
- REST APIs
- Apache Kafka
- Message Queues
- MQ
- Python
- Cloud Data Architecture
- Distributed Data Processing
- Data Engineering
- Data Transformation
- Real-Time Data Pipelines
- Enterprise Data Solutions
- Scalability
- High Availability
- Security
- Performance Optimization
- CI/CD
- DevOps
- Infrastructure Automation
- Technical Leadership
- Mentoring
- Banking