talk-data.com talk-data.com

Event

PyData Eindhoven 2025

2025-12-09 – 2025-12-09 PyData

Activities tracked

1

Filtering by: Geert Jongen ×

Sessions & talks

Showing 1–1 of 1 · Newest first

Search within this event →
From Data Lake Entanglement to Data Mesh Decoupling: Scaling a Self-Service Data Platform

From Data Lake Entanglement to Data Mesh Decoupling: Scaling a Self-Service Data Platform

2025-12-09 Watch
talk

Our data platform journey started with a classic data lake — easy to ingest, hard to evolve. As domains scaled, tight coupling across source systems, pipelines, and data products slowed everything down. In this talk, we share how we re-architected toward a domain-oriented data mesh using PySpark, Delta Lake and DQX to achieve true decoupling. Expect practical lessons on designing independent data products, managing lineage and governance, and scaling self-service without chaos.