talk-data.com talk-data.com

K

Speaker

Karthikeyan Ramasamy

1

talks

Head of Streaming Databricks

Karthik Ramasamy is the Head of Streaming at Databricks. Before Databricks, he was a Senior Director of Engineering, managing the Pulsar team at Splunk. He was the CEO of Streamlio focused on building Apache Pulsar and led the acquisition of Streamlio by Splunk. Before Streamlio, he was the technical lead for real-time infrastructure at Twitter where he created Twitter Heron. He worked with companies such as Greenplum and Juniper in building parallel databases, big data infrastructure and networking. He founded Locomatix that specialized in streaming processing on Hadoop and Cassandra, which was acquired by Twitter. Karthik has a Ph.D. in computer science from the University of Wisconsin, Madison, with a focus on big data and databases.

Bio from: Data + AI Summit 2025

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →
Delivering Sub-Second Latency for Operational Workloads on Databricks

As enterprise streaming adoption accelerates, more teams are turning to real-time processing to support operational workloads that require sub-second response times. To address this need, Databricks introduced Project Lightspeed in 2022, which recently delivered Real-Time Mode in Apache Spark™ Structured Streaming. This new mode achieves consistent p99 latencies under 300ms for a wide range of stateless and stateful streaming queries. In this session, we’ll define what constitutes an operational use case, outline typical latency requirements and walk through how to meet those SLAs using Real-Time Mode in Structured Streaming.