Event Streaming Engineer - Kafka / Azure Event Hubs
- Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Posting language
- English
- Posted
Original job description
About the Role
We are looking for a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka.
Responsibilities
- Design event-driven integrations, including Kafka connectivity, topic mapping, partitioning, and schema management.
- Configure Event Hubs, partitions, consumer groups, retention, and throughput settings in collaboration with Cloud Engineering.
- Implement secure authentication, Microsoft Entra ID, RBAC, and least-privilege access controls.
- Develop event ingestion and downstream consumer integrations using Kafka-compatible interfaces or Azure SDKs.
- Implement retry, recovery, duplicate handling, replay, and end-to-end reliability testing.
- Establish monitoring, alerting, operational runbooks, and technical documentation.
Required Skills
- Hands-on experience with Azure Event Hubs and Apache Kafka.
- Strong knowledge of Kafka producers, consumers, topics, partitions, offsets, and delivery semantics.
- Experience with event-driven architecture, serialization, and schema compatibility.
- Practical knowledge of Azure security, identity, RBAC, and credential management.
- Ability to independently design, develop, troubleshoot, and test end-to-end integrations.
Preferred Skills
- C#/.NET development for Kafka integrations or bridge solutions.
- Experience with JSON, Avro, and schema registries.
- Familiarity with Azure Monitor, Log Analytics, Terraform/Bicep, and CI/CD.
- Knowledge of high availability, disaster recovery, and production support.
- Azure or Kafka certifications are an advantage.
More about this job
Responsibilities
Design and implement event-driven integrations using Azure Event Hubs and Apache Kafka, including topic and schema management, security controls, and downstream consumer connections. Build reliable integrations with retry, recovery, duplicate handling, and replay, and establish monitoring, alerting, runbooks, documentation, and end-to-end testing.
Requirements
Requires hands-on experience with Azure Event Hubs and Apache Kafka, strong knowledge of Kafka concepts and delivery semantics, and practical expertise in event-driven architecture, serialization, schema compatibility, and Azure security. The role also requires the ability to independently design, develop, troubleshoot, and test integrations; C#/.NET, schema registries, Azure monitoring, infrastructure as code, CI/CD, and relevant certifications are preferred or advantageous.
Skills
- Azure Event Hubs
- Apache Kafka
- Event-Driven Architecture
- Kafka Producers and Consumers
- Topics and Partitions
- Offsets and Delivery Semantics
- Schema Management
- Azure Security
- Microsoft Entra ID
- Role-Based Access Control
- C#/.NET
- JSON and Avro
- Azure Monitor
- Log Analytics
- Terraform and Bicep
- CI/CD
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
Keywords
- Azure Event Hubs
- Apache Kafka
- Event-Driven Integration
- Event-Driven Architecture
- Kafka Connectivity
- Topics
- Partitions
- Consumer Groups
- Offsets
- Retention
- Throughput
- Schema Management
- Schema Compatibility
- Serialization
- Microsoft Entra ID
- Role-Based Access Control
- Least-Privilege Access
- Kafka Producers
- Kafka Consumers
- Azure SDKs
- C#/.NET
- JSON
- Avro
- Schema Registries
- Azure Monitor
- Log Analytics
- Terraform
- Bicep
- CI/CD
- High Availability