Kafka Support Specialist
- Toronto, ON, Canada
- Greater Toronto Area, Canada, Canada
Applications open in a new tab.
Job details
- Apply by
- Experience
- Experience: 2+ years of experience in production support, or focused on enterprise data streaming platforms.
- Posting language
- English
- Posted
Original job description
As a Kafka Support Specialist, you will join the Enterprise Event Streaming team responsible for supporting, monitoring, and maintaining high-throughput, mission-critical streaming architectures.
In this role, you will play a key part in maintaining the health and resilience of the event-driven infrastructure, ensuring high availability, performance, and operational consistency across Enterprise Event Streaming pipelines powered by Confluent Kafka.
Key Responsibilities
- Production Support & Incident Management: Provide Tier 1 / Tier 2 production support for enterprise event streaming platforms, including real-time incident diagnosis, resolution, and root cause analysis (RCA).
- Kafka Operations & Maintenance: Monitor, troubleshoot, and optimize Confluent Kafka clusters, brokers, schemas, producers, and consumer applications across distributed environments.
- Consumer & Producer Troubleshooting: Assist application teams with configuring, debugging, and optimizing Kafka Consumers and Producers, ensuring standard delivery patterns and robust error-handling mechanisms (e.g., dead-letter queues, retry topics).
- Platform Monitoring & Reliability: Monitor pipeline latency, consumer lag, cluster throughput, and system health using enterprise observability and alerting tools (e.g., Grafana, Prometheus, Datadog, Splunk).
- Change Management & Deployment: Support release management, application deployments, configuration updates, and infrastructure upgrades across production and non-production environments following ITIL/Agile processes.
- Collaboration & Onboarding: Work closely with engineering and development teams to onboard new data pipelines, establish operational best practices, and maintain reliable data flow across business units.
Key Qualifications
- Experience: 2+ years of experience in production support, or focused on enterprise data streaming platforms.
- Event Streaming Expertise: Hands-on experience with the Confluent Kafka ecosystem, including Kafka Brokers, Schema Registry, Kafka Connect, and Kafka Streams.
- Kafka Producers & Consumers: Deep understanding of Kafka Producer and Consumer architecture, offset management, partitioning strategies, serialization/deserialization (Avro, JSON, Protobuf), and delivery guarantees.
- Monitoring & Observability: Strong experience leveraging observability stacks to track consumer lag, identify bottleneck issues, and detect broker anomalies.
- Scripting & Automation: Proficiency in shell scripting (Bash) and Python (or Java/Scala) to automate routine support tasks, health checks, and monitoring scripts.
- Operating Systems & Infrastructure: Solid background in Linux/Unix environments, network troubleshooting, and enterprise security standards (SSL/TLS, SASL, Kerberos).
More about this job
Responsibilities
Provide Tier 1 and Tier 2 production support for Confluent Kafka streaming platforms, including incident diagnosis, resolution, root cause analysis, monitoring, troubleshooting, and optimization. Support deployments and platform changes, help application teams troubleshoot producers and consumers, and collaborate with engineering teams to onboard pipelines and maintain reliable data flows.
Requirements
Requires 2+ years of production support or enterprise data streaming experience and hands-on knowledge of the Confluent Kafka ecosystem, producer and consumer architecture, delivery guarantees, and serialization formats. Candidates should also have observability experience, scripting skills in Bash and Python or Java/Scala, and a background in Linux/Unix, network troubleshooting, and enterprise security protocols.
Skills
- Confluent Kafka
- Kafka Brokers
- Schema Registry
- Kafka Connect
- Kafka Streams
- Kafka Producers And Consumers
- Offset Management
- Partitioning Strategies
- Avro
- JSON
- Protobuf
- Grafana
- Prometheus
- Datadog
- Splunk
- Bash
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Customer Service & Support
- Data & Analytics
Keywords
- Enterprise Event Streaming
- Confluent Kafka
- Kafka Brokers
- Schema Registry
- Kafka Connect
- Kafka Streams
- Kafka Producers
- Kafka Consumers
- Offset Management
- Partitioning
- Avro
- JSON
- Protobuf
- Dead-Letter Queues
- Retry Topics
- Consumer Lag
- Pipeline Latency
- Cluster Throughput
- Grafana
- Prometheus
- Datadog
- Splunk
- Bash
- Python
- Java
- Scala
- Linux/Unix
- SSL/TLS
- SASL
- Kerberos