talk-data.com talk-data.com

M

Speaker

Mattias Moser

1

talks

Data Engineer & Architect 84.51 LLC

Mattias is a seasoned data engineer and architect with over a decade of experience building large-scale data pipelines in the retail industry. His journey spans from Netezza and Hadoop to open source Spark, and for the past five years, he's specialized in Databricks. He combines deep hands-on engineering with architectural vision.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 1 activities

Search activities →
Better Together: Change Data Feed in a Streaming Data Flow

Traditional streaming works great when your data source is append-only, but what if your data source includes updates and deletes? At 84.51 we used Lakeflow Declarative Pipelines and Delta Lake to build a streaming data flow that consumes inserts, updates and deletes while still taking advantage of streaming checkpoints. We combined this flow with a materialized view and Enzyme incremental refresh for a low-code, efficient and robust end-to-end data flow.We process around 8 million sales transactions each day with 80 million items purchased. This flow not only handles new transactions but also handles updates to previous transactions.Join us to learn how 84.51 combined change data feed, data streaming and materialized views to deliver a “better together” solution.84.51 is a retail insights, media & marketing company. We use first-party retail data from 60 million households sourced through a loyalty card program to drive Kroger’s customer-centric journey.