talk-data.com talk-data.com

Meetup talk 2025-10-01 at 06:50

Partial Updates, Snapshots: Why Not Both?

Description

When we start publishing events, there's an important decision to make: Do we send only the changes that triggered the event (partial updates), or do we send the entire entity after the change (a full snapshot)? Each option has trade-offs: partial updates are efficient but incomplete, while snapshots are comprehensive but heavy. In this talk, we'll explore how to get the best of both worlds by using ClickHouse to automatically build snapshots from partial updates.