About Us
Acceldata is the market leader in Enterprise Data Observability. Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley.
Our Enterprise Data Observability Platform - the first of its kind - helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today’s most critical technologies, including AI, LLMs, Analytics, and DataOps.
Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey’s, Dun & Bradstreet, and many more.
About The Role
Data rarely sits still. It streams in through Kafka, flows through NiFi, gets transformed by Spark, and lands where Hive and Trino make it queryable at scale. When any part of that journey slows down or breaks, our customers' businesses feel it.
As a Product Specialist – Streaming & SQL Platforms, you'll be the expert who keeps that data moving for customers running Acceldata's Open Data Platform (ODP). You'll own complex escalations end to end, from ingestion and streaming through processing and SQL. You'll diagnose hard performance and stability problems, guide customers through migrations and upgrades, and make sure their mission-critical pipelines run reliably at enterprise scale.
This is a hands-on, customer-facing role for someone who thrives under pressure, enjoys finding root causes, and wants deep exposure to the platforms behind some of the world's largest data estates.
What You'll Do
- Own L3 escalations across the data flow. Take complex issues in Kafka, NiFi, Spark, Hive, and Trino from first response to root cause and permanent fix.
- Keep streams and ingestion healthy. Troubleshoot Kafka brokers, partitions, replication, and consumer lag, as well as NiFi flows, back-pressure, provenance, and cluster coordination.
- Optimise processing and SQL performance. Analyse Spark jobs (executors, memory, shuffle, data skew) and tune Hive and Trino queries, plans, and resource usage for low latency and high throughput.
- Lead migrations and upgrades to ODP. Plan for stability before cutover, support customers hands-on during the move, and tune performance afterwards.
- Work across the full platform stack. This includes HDFS/Ozone storage, YARN and Kubernetes resource management, Kerberos and Ranger security, and Ambari-based operations in large on-prem environments.
- Be the customer’s trusted technical voice. Lead troubleshooting calls during high-severity incidents, write clear RCAs, and bring recurring issues and product gaps back to Engineering.
- Scale your expertise. Build runbooks, KB articles, and diagnostic playbooks that strengthen the wider support team.
What You'll Bring
- 8+ years of hands-on experience supporting or operating distributed data platforms in production.
- Deep expertise in at least two of Kafka, NiFi, Spark, and Hive/Trino, with working knowledge of the rest.
- Strong Linux skills, JVM troubleshooting experience (GC, heap and thread dumps), and confidence with log analysis.
- Practical experience with platform security, including Kerberos, Ranger, and TLS/SSL. Scripting skills in Python, Bash, or Scala.
- Calm, clear communication with customers during critical incidents.
Nice-to-have
- Experience migrating or upgrading large-scale, enterprise open-source data platforms, including moves between distributions or major versions.
- Familiarity with Kubernetes and containerized data workloads.
- Exposure to open table formats (Iceberg, Delta Lake, Hudi) and data observability concepts.
- Contributions to Apache open-source projects.
At Acceldata, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.
is all about working with some of the best minds in the industry and experiencing a culture that values an ‘out-of-the-box’ mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be!
We also believe in providing our employees with the right tools and resources to help them excel at their jobs. We offer:
- PTO Plan with unlimited negative balance
- RRSP Plan
- Up to 100% employer-paid benefit options for health, dental, and vision coverage
- Supplemental Benefits
- Apple Air Mac Equipment
- Office gym access (includes workout equipment, basketball court, and showers)
- Becoming part of the team that coined the term “Data Observability”!
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.