Kafka Developer/Administrator
- Mississauga, ON, Canada
Full-time
Applications open in a new tab.
Job details
- Job type
- Full-time
- Apply by
- Posting language
- English
- Posted
Original job description
Position: Kafka Developer/Administrator
Location: Mississauga, ON (Onsite)
Employment Type: Full Time
Experience Required: 7 + Years
Role Summary:
We are seeking an experienced Kafka Developer/Administrator to design, implement, manage, and optimize enterprise-scale Apache Kafka platforms across Development, UAT, Testing, and Production environments. The ideal candidate will have strong expertise in Kafka administration, performance tuning, security, automation, troubleshooting, and supporting highly available, mission-critical messaging systems.
Required Skills:
- Strong hands-on experience with Apache Kafka Administration and Support.
- Expertise in Kafka architecture, brokers, topics, partitions, replication, and consumer groups.
- Experience with Kafka Connect, Schema Registry, and distributed messaging systems.
- Knowledge of Kafka security (SSL/TLS, SASL, ACLs).
- Proficiency in Linux/Unix environments and scripting using Shell or Python.
- Experience with monitoring and observability tools such as Prometheus, Grafana, Splunk, or similar.
- Strong troubleshooting, performance tuning, and capacity planning skills.
- Familiarity with cloud platforms, DevOps practices, and CI/CD pipelines is preferred.
Key Responsibilities:
- Install, configure, administer, and maintain Apache Kafka clusters across multiple environments.
- Manage Kafka brokers, topics, partitions, replication, and consumer groups to ensure platform reliability and performance.
- Monitor cluster health, capacity, availability, and resource utilization.
- Perform performance tuning, capacity planning, scaling, upgrades, patching, and migrations.
- Troubleshoot and resolve Kafka infrastructure, connectivity, messaging, and performance issues.
- Implement and manage Kafka security including SSL/TLS, SASL, ACLs, and encryption standards.
- Support Kafka ecosystem components such as Kafka Connect, Schema Registry, and related integrations.
- Design and maintain High Availability (HA) and Disaster Recovery (DR) solutions.
- Collaborate with application, infrastructure, DevOps, and data engineering teams for application onboarding and support.
- Develop automation using Shell Scripting and Python to streamline operational activities.
- Maintain monitoring, logging, alerting, incident management processes, and operational documentation.
- Perform root cause analysis for production incidents and drive continuous platform improvements.
- Participate in on-call support and ensure timely resolution of critical production issues.
Preferred Background:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Experience supporting large-scale, highly available Kafka environments.
- Kafka-related certifications are a plus.
More about this job
Responsibilities
Install, administer, monitor, secure, and optimize Kafka clusters across development, testing, UAT, and production environments, including scaling, upgrades, high availability, and disaster recovery. Troubleshoot incidents, automate operational tasks, maintain monitoring and documentation, and collaborate with application, infrastructure, DevOps, and data engineering teams to support reliable production services.
Requirements
Requires 7 or more years of experience and strong hands-on expertise administering and supporting Apache Kafka, including its architecture, brokers, topics, partitions, replication, consumer groups, and ecosystem components. Candidates should also have Linux/Unix and Shell or Python scripting skills, knowledge of Kafka security and monitoring tools, and strong troubleshooting and performance-tuning abilities; a related bachelor's degree is preferred.
Skills
- Apache Kafka Administration
- Kafka Architecture
- Kafka Connect
- Schema Registry
- Kafka Security
- SSL/TLS
- SASL
- Access Control Lists
- Linux/Unix
- Shell Scripting
- Python
- Prometheus
- Grafana
- Splunk
- Performance Tuning
- Capacity Planning
Visa sponsorship
Not detected in the job text
Categories
- Technology
- Software
- Engineering
Keywords
- Apache Kafka
- Kafka Administration
- Kafka Brokers
- Topics
- Partitions
- Replication
- Consumer Groups
- Kafka Connect
- Schema Registry
- Distributed Messaging
- SSL/TLS
- SASL
- Access Control Lists
- Linux/Unix
- Shell Scripting
- Python
- Prometheus
- Grafana
- Splunk
- Performance Tuning
- Capacity Planning
- High Availability
- Disaster Recovery
- DevOps
- CI/CD
- Monitoring
- Incident Management
- Root Cause Analysis
- Cloud Platforms