Closed listing
Sr Platform Engineer -Azure/Databricks
- Toronto, ON, Canada
Contract
This opening has closed.
The original listing is kept below for reference.
Job details
- Job type
- Contract
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
Role : Sr Platform Engineer -Azure/Databricks
Location : Toronto, ON (Hybrid)
Key Responsibilities
We are seeking a seasoned Principal Cloud Engineer [Individual Contributor] who thrives in restricted Azure setups – where native features are locked down, so you’ll code workarounds like custom microservices to replicate them. Focus on automating Databrick workspace onboarding via IAM modules, using Terraform for IaC despite limitations, and build ingestion pipelines that bypass disabled tools with Python or similar. Need proven coding chops to trigger those behaviors securely, plus banking or fintech experience handling compliance in tricky environments.
- Strong Expertise in Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github), Obs (Dynatrace),
- Nice to have : Java, Kafka , Casandra, Microservices, API, Flink, ZeroMQ, Protocol Buffers
- Able to write the complex code and fix the issues
- Should have strong problem solving capability
- Collaborate with stakeholders to understand requirements and deliver robust solutions independently
- Responsible for both development and strong expertise to debug and fix any post production issues for their developed code
- Functional experience of Retail Banking, capital markets, securities processing will be advantage
- Must have skills – findable only
- Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github),
- Must have skills that can be trained
- Obs (Dynatrace)
- Nice to have skills
- Terraform
- Java,
- Kafka ,
- Microservices,
- API
- Distributed Storage System (like ADLS, S3, Google Storage)
- Airflow
We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law. https://www.e-verify.gov/sites/default/files/everify/posters/IER_RighttoWorkPoster.pdf
More about this job
Responsibilities
Automate Databricks workspace onboarding using IAM modules, develop infrastructure as code with Terraform, and build secure ingestion pipelines and custom services to work around restricted Azure features. Independently deliver robust solutions, collaborate with stakeholders, and debug and resolve production issues in developed code.
Requirements
The role requires strong expertise in Azure, Databricks, Python, PySpark, SparkSQL, and CI/CD using Jenkins or GitHub, along with the ability to write complex code and troubleshoot issues. Experience with compliance in banking or fintech environments is sought; observability with Dynatrace is trainable, while Terraform and several distributed systems and integration technologies are listed as nice to have.
Skills
- Azure
- Databricks
- Python
- PySpark
- SparkSQL
- CI/CD
- Jenkins
- GitHub
- Dynatrace
- Terraform
- IAM
- Microservices
- API Development
- Debugging
- Problem Solving
- Banking Compliance
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Data & Analytics
- Engineering
- Finance & Accounting
Keywords
- Azure
- Databricks
- Python
- PySpark
- SparkSQL
- CI/CD
- Jenkins
- GitHub
- Dynatrace
- Terraform
- Infrastructure as Code
- IAM
- Microservices
- API
- Kafka
- Cassandra
- Flink
- ZeroMQ
- Protocol Buffers
- ADLS
- Amazon S3
- Google Cloud Storage
- Airflow
- Data Ingestion
- Distributed Storage
- Retail Banking
- Capital Markets
- Securities Processing
- Compliance
- Observability