Data Engineer
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
Job Summary:
- 3-5 years as an Application Developer/Support with good knowledge and understanding of Software Development Life Cycle, databases, batch processing, knowledge of firewalls, FTP, and SFTP. Experience in application production support, including logical thinking, organizational skills, and troubleshooting skills.
- Azure cloud development and design working knowledge on the following items:
- Azure App services: Web apps, API-Apps
- Azure Network Security groups: To identify the NSG rules that are required to be allowed or denied
- Azure monitor: To configure alerts on various metrics and analyze for troubleshooting
- Azure data lake: Reading from and writing to different sources using Azure SDK/APIs/configuration
- Azure data factory: Pipelines, data sets, linked services, integrated with Self-hosted integration runtime, mapping, authoring, and monitoring data flow
- Azure SQL/Azure SQL MI: Azure SQL feature differences and SQL programming
- Azure Function App: HTTP Triggered apps, Timer triggered apps
- Azure Key Vault: Storing and retrieving secrets programmatically.
- Writing and troubleshooting complex SQL queries and Stored Procedures is required
- Working knowledge in partitioning, indexes, statistics, explain/execution plans, etc
- Experience in creating Power BI Reports and analytics is a plus
- Experience building and integrating with external systems using REST API connectors is a plus
- Knowledge and experience of using GIT and Azure DevOps
- Ability to independently analyze, troubleshoot, and resolve technical issues
- Strong problem-solving and communication skills
- Ability to adapt to new technologies as required
- PowerShell / Azure CLI scripting – Automation of routine tasks, deployment scripts, and production support troubleshooting.
- Azure Log Analytics & KQL (Kusto Query Language) – Querying logs, diagnosing pipeline failures, and production incident investigation.
- Application Insights – Tracing end-to-end request flows and identifying performance bottlenecks in APIs and Functions.
- CI/CD pipeline authoring (YAML in Azure DevOps) – Building and maintaining build/release pipeline definitions, not just consuming them.
- Infrastructure as Code (Bicep / ARM templates) – Basic ability to read, modify, and deploy infrastructure changes.
- Production support is required for this role
More about this job
Responsibilities
The Data Engineer will be responsible for application production support and troubleshooting, as well as developing and designing solutions in Azure. This includes working with various Azure services and ensuring the performance and reliability of applications.
Requirements
Candidates should have 3-5 years of experience in application development and support, with a strong understanding of the Software Development Life Cycle and databases. Proficiency in Azure services and SQL programming is essential, along with problem-solving and communication skills.
Skills
- Azure App Services
- Azure Network Security
- Azure Monitor
- Azure Data Lake
- Azure Data Factory
- Azure SQL
- Azure Function App
- Azure Key Vault
- SQL Queries
- Power BI
- REST API
- GIT
- Azure DevOps
- PowerShell
- Azure CLI
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Data & Analytics
- Software
- Consulting
Keywords
- Data Engineer
- Application Developer
- Databases
- Batch Processing
- Firewalls
- FTP
- SFTP
- Azure Cloud
- Azure SDK
- Azure APIs
- Pipelines
- Data Sets
- Linked Services
- Integrated Runtime
- Mapping
- Monitoring
- Stored Procedures
- Partitioning
- Indexes
- Statistics
- Execution Plans
- Power BI Reports
- REST API Connectors
- GIT
- Azure DevOps
- PowerShell Scripting
- Azure CLI
- Azure Log Analytics
- KQL