Closed listing
Data Analyst - Expert
- Toronto, ON, Canada
Pay Rate: $89.88/hr -$103.89/hr · Full-time
This opening has closed.
The original listing is kept below for reference.
Job details
- Pay
- Pay Rate: $89.88/hr -$103.89/hr
- Job type
- Full-time
- Closing date
- Posting language
- English
- Posted
Similar jobs hiring now
Search current openingsOriginal job description
Archived listing. The details below describe a past opening.
- Location: Toronto, ON - (Hybrid 1- Thursday and 4th Friday of the month – may change due to business requirements)
- Pay Rate: $89.88/hr -$103.89/hr
- Contract Length: 6 Months with possibility for extension
Responsibilities
- Develop and maintain data solutions using ADF, Databricks, Azure Functions, Python, and Spark.
- Build ADF-to-Databricks data pipelines using Medallion Architecture and Delta Lake.
- Design and manage Unity Catalog, data governance, security, and permissions.
- Migrate Databricks environments from Hive Metastore to Unity Catalog.
- Create and manage Delta tables, schemas, and data security configurations.
- Implement CI/CD and deployment pipelines using Azure DevOps/GitHub Enterprise.
- Work with Azure services including ADLS, Azure SQL, Synapse, ADF/SHIR, and Databricks.
- Perform performance tuning, cost optimization, monitoring, and troubleshooting.
- Lead a small team, conduct technical problem-solving sessions, and work independently.
- Collaborate effectively with stakeholders using strong communication skills.
- 7+ Years experience with ADF, Databricks and Azure Functions (C#)
- In depth development experience python/notebook on Databricks/Spark/panda
- Expert working knowledge of Unity Catalog and data governance setup/configuration
- Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
- Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
- Creating delta table schema/tables with proper design/properties & security permissions
- DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
- In depth experience on Azure Entra ID for SSO/RBAC setup
- In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
- Familiar to work in lock down windows environment for highly regulated industry
- Ability to work independently and lead a small team.
- Proven ability to work independently with minimum supervision
- Ability to lead a small team and technical problem-solving sessions
- Excellent Communication skills
- ADF orchestrations with Databricks.
- Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
- CI/CD, security
- Monitoring
- Previous Banking experience or experience in a financial institution.
- Nice to have experience on Delta Live Table.
- Financial Services Industry experience is an Asset.
Raise is an established hiring firm with over 65 years of experience. We believe strongly in making the world a better place through work, which is why we’re a certified B Corporation and donate 10% of our profits to charity.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer and request accommodation: https://raise.jobs/accommodations/
In order to submit candidates for roles, our clients will sometimes require personal information to confirm the identity of applicants and their legal status to work. Raise will never ask you for personal or banking information unless you have been selected for a job. If you are ever unsure about the legitimacy of this or another job posting by Raise (or have any other questions), please contact us at +1 800-567-9675 or hello@raiserecruiting.com
#FIN24
More about this job
Responsibilities
Develop and maintain data solutions using ADF, Databricks, and Python while implementing Medallion Architecture and Unity Catalog. Lead a small team in technical problem-solving and collaborate with stakeholders to ensure effective data governance and performance optimization.
Requirements
Requires 7+ years of experience with ADF, Databricks, and Azure Functions, along with in-depth knowledge of Python, Spark, and data security configurations. Candidates must possess strong communication skills and the ability to work independently in a regulated environment.
Skills
- ADF
- Databricks
- Azure Functions
- Python
- Spark
- Unity Catalog
- Medallion Architecture
- Delta Lake
- Azure DevOps
- GitHub Enterprise
- Azure SQL
- Synapse
- Data Governance
- CI/CD
- Performance Tuning
- Team Leadership
Visa sponsorship
Not detected in the job text
Categories
- Data & Analytics
- Technology
- Software
- Finance & Accounting
- Management & Leadership
Keywords
- ADF
- Databricks
- Azure Functions
- Python
- Spark
- Medallion Architecture
- Delta Lake
- Unity Catalog
- Data Governance
- Azure DevOps
- GitHub Enterprise
- Azure SQL
- Synapse
- ADLS
- Azure Entra ID
- SSO
- RBAC
- CI/CD
- Performance Tuning
- Data Analyst
- Cloud Computing
- PaaS
- Banking
- Financial Services
- Delta Live Table