About the Role
We are looking for a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka.
Responsibilities
- Design event-driven integrations, including Kafka connectivity, topic mapping, partitioning, and schema management.
- Configure Event Hubs, partitions, consumer groups, retention, and throughput settings in collaboration with Cloud Engineering.
- Implement secure authentication, Microsoft Entra ID, RBAC, and least-privilege access controls.
- Develop event ingestion and downstream consumer integrations using Kafka-compatible interfaces or Azure SDKs.
- Implement retry, recovery, duplicate handling, replay, and end-to-end reliability testing.
- Establish monitoring, alerting, operational runbooks, and technical documentation.
Required Skills
- Hands-on experience with Azure Event Hubs and Apache Kafka.
- Strong knowledge of Kafka producers, consumers, topics, partitions, offsets, and delivery semantics.
- Experience with event-driven architecture, serialization, and schema compatibility.
- Practical knowledge of Azure security, identity, RBAC, and credential management.
- Ability to independently design, develop, troubleshoot, and test end-to-end integrations.
Preferred Skills
- C#/.NET development for Kafka integrations or bridge solutions.
- Experience with JSON, Avro, and schema registries.
- Familiarity with Azure Monitor, Log Analytics, Terraform/Bicep, and CI/CD.
- Knowledge of high availability, disaster recovery, and production support.
- Azure or Kafka certifications are an advantage.