Kafka Administrator
- Toronto, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
We are seeking an experienced Kafka Administrator to manage, optimize, and support enterprise-scale Apache Kafka environments. The ideal candidate will have strong expertise in Kafka cluster administration, performance tuning, security, high availability, and production support in distributed systems
Must Have Technical/Functional Skills
Must Have Technical/Functional Skills
- Apache Kafka Administration
- Kafka Cluster Installation, Configuration, and Management
- Topic, Partition, and Replication Management
- Kafka Broker Administration and Performance Tuning
- Kafka Connect
- Schema Registry
- Consumer Group Management
- Kafka Security (SSL/TLS, SASL, ACLs)
- High Availability and Disaster Recovery Configuration
- Kafka Monitoring and Alerting
- Linux/Unix Administration
- Shell Scripting (Bash) and/or Python Scripting
- Troubleshooting and Root Cause Analysis of Kafka Production Issues
- Capacity Planning and Cluster Scaling
- Log Analysis and Performance Optimization
- Experience with Monitoring Tools (Prometheus, Grafana, Splunk, ELK, Datadog)
- Understanding of Distributed Systems and Event-Driven Architecture
- Production Support and Incident Management
- Kafka Upgrades, Patching, and Maintenance Activities
- Install, configure, administer, and maintain Apache Kafka clusters across Development, Testing, UAT, and Production environments.
- Manage Kafka brokers, topics, partitions, replication factors, and consumer groups to ensure platform stability and performance.
- Monitor Kafka cluster health, availability, capacity, and resource utilization using enterprise monitoring tools.
- Perform Kafka performance tuning, capacity planning, and cluster scaling activities to support growing business workloads.
- Troubleshoot and resolve Kafka infrastructure, messaging, connectivity, and performance-related issues.
- Configure and manage Kafka security controls including SSL/TLS, SASL authentication, ACLs, and encryption standards.
- Support Kafka Connect, Schema Registry, and other ecosystem components required for data integration.
- Implement and maintain High Availability (HA) and Disaster Recovery (DR) solutions for Kafka platforms.
- Perform Kafka upgrades, patching, migration, and platform maintenance activities with minimal business impact.
- Collaborate with application, data engineering, infrastructure, and DevOps teams to onboard and support Kafka-based applications.
- Develop and maintain operational procedures, runbooks, architecture documentation, and support guides.
- Configure and manage monitoring, logging, alerting, and incident management processes for Kafka environments.
- Support production deployments, release activities, and environment readiness assessments.
- Perform root cause analysis for production incidents and implement preventive measures to improve platform reliability.
- Automate administrative and operational tasks using Shell scripting, Python, or other automation tools.
- Ensure platform compliance with organizational security, governance, audit, and regulatory requirements.
- Participate in on-call support and provide timely resolution for critical production issues.
- Drive continuous improvement initiatives to enhance Kafka platform performance, scalability, security, and operational efficiency.
- Teamwork
- Willingness to learn
More about this job
Responsibilities
Install, configure, and maintain enterprise-scale Apache Kafka clusters across multiple environments. Monitor cluster health, perform performance tuning, and ensure high availability and security for data integration.
Requirements
Requires strong expertise in Kafka administration, including broker management, security controls, and monitoring tools. Proficiency in Linux/Unix and scripting languages like Bash or Python is essential for automation and troubleshooting.
Skills
- Apache Kafka Administration
- Kafka Cluster Management
- Performance Tuning
- Kafka Connect
- Schema Registry
- Kafka Security
- High Availability
- Disaster Recovery
- Linux/Unix Administration
- Shell Scripting
- Python Scripting
- Prometheus
- Grafana
- Splunk
- ELK
- Datadog
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Data & Analytics
- Consulting
- Engineering
Keywords
- Apache Kafka
- Kafka Broker
- Topic Management
- Partitioning
- Replication
- SSL/TLS
- SASL
- ACLs
- Distributed Systems
- Event-Driven Architecture
- Capacity Planning
- Root Cause Analysis
- Incident Management
- Prometheus
- Grafana
- Splunk
- ELK
- Datadog
- Bash
- Python
- Linux
- Unix
- High Availability
- Disaster Recovery
- Schema Registry
- Kafka Connect
- IT Services
- IT Consulting