About the role
Data rarely sits still. It streams in through Kafka, flows through NiFi, gets transformed by Spark, and lands where Hive and Trino make it queryable at scale. When any part of that journey slows down or breaks, our customers' businesses feel it.
As a Product Specialist – Streaming & SQL Platforms, you'll be the expert who keeps that data moving for customers running Acceldata's Open Data Platform (ODP). You'll own complex escalations end to end, from ingestion and streaming through processing and SQL. You'll diagnose hard performance and stability problems, guide customers through migrations and upgrades, and make sure their mission-critical pipelines run reliably at enterprise scale.
This is a hands-on, customer-facing role for someone who thrives under pressure, enjoys finding root causes, and wants deep exposure to the platforms behind some of the world's largest data estates.
What you'll do
- Own L3 escalations across the data flow. Take complex issues in Kafka, NiFi, Spark, Hive, and Trino from first response to root cause and permanent fix.
- Keep streams and ingestion healthy. Troubleshoot Kafka brokers, partitions, replication, and consumer lag, as well as NiFi flows, back-pressure, provenance, and cluster coordination.
- Optimise processing and SQL performance. Analyse Spark jobs (executors, memory, shuffle, data skew) and tune Hive and Trino queries, plans, and resource usage for low latency and high throughput.
- Lead migrations and upgrades to ODP. Plan for stability before cutover, support customers hands-on during the move, and tune performance afterwards.
- Work across the full platform stack. This includes HDFS/Ozone storage, YARN and Kubernetes resource management, Kerberos and Ranger security, and Ambari-based operations in large on-prem environments.
- Be the customer's trusted technical voice. Lead troubleshooting calls during high-severity incidents, write clear RCAs, and bring recurring issues and product gaps back to Engineering.
- Scale your expertise. Build runbooks, KB articles, and diagnostic playbooks that strengthen the wider support team.
What you'll bring
Must-have
- 8+ years of hands-on experience supporting or operating distributed data platforms in production.
- Deep expertise in at least two of Kafka, NiFi, Spark, and Hive/Trino, with working knowledge of the rest.
- Strong Linux skills, JVM troubleshooting experience (GC, heap and thread dumps), and confidence with log analysis.
- Practical experience with platform security, including Kerberos, Ranger, and TLS/SSL.
- Scripting skills in Python, Bash, or Scala.
- Calm, clear communication with customers during critical incidents.
Nice-to-have
- Experience migrating or upgrading large-scale, enterprise open-source data platforms, including moves between distributions or major versions.
- Familiarity with Kubernetes and containerized data workloads.
- Exposure to open table formats (Iceberg, Delta Lake, Hudi) and data observability concepts.
- Contributions to Apache open-source projects.
Why Acceldata
At Acceldata, you won't just support a product. You'll stand behind the platform that some of the most data-intensive enterprises in the world trust with their most critical workloads. We're pioneers in data observability and builders of an open, enterprise-grade data platform, and we're shaping how organizations run, scale, and trust their data in the age of AI.
- Work where it matters most. Every escalation you solve keeps real businesses running, from financial transactions to real-time analytics at massive scale.
- Go deeper than anywhere else. Work hands-on with the internals of Kafka, NiFi, Spark, Hive, and Trino alongside the engineers who build and harden the platform.
- Grow your expertise and your career. Gain exposure to complex, high-impact environments, with a clear path toward Principal Specialist, Solutions Architect, or technical leadership roles.
- Join a team that has your back. Collaborate with a global group of experts who share knowledge openly, value ownership, and celebrate solving the hard problems together.
If you want your expertise to be the reason a customer's data keeps moving, we'd love to hear from you.
Equal opportunity
Acceldata is an equal opportunity employer. We are committed to building a diverse and inclusive team and welcome applications from all qualified candidates regardless of race, colour, ancestry, place of origin, ethnic origin, citizenship, creed or religion, sex, sexual orientation, gender identity, gender expression, age, marital or family status, disability, or any other characteristic protected under applicable Canadian human rights legislation.
We are committed to providing accommodations throughout the recruitment and selection process. If you require accommodation at any stage, please let us know, and we will work with you to meet your needs in accordance with applicable provincial accessibility and human rights legislation.
Use of AI in our hiring process
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.