talk-data.com
Databricks Summit
lightning_talk
2025-06-12 at 00:20
Introducing Simplified State Tracking in Apache Spark™ Structured Streaming
Event:
Data + AI Summit 2025
Speakers
Topics
Description
This presentation will review the new change feed and snapshot capabilities in Apache Spark™ Structured Streaming’s State Reader API. The State Reader API enables users to access and analyze Structured Streaming's internal state data. Readers will learn how to leverage the new features to debug, troubleshoot and analyze state changes efficiently, making streaming workloads easier to manage at scale.