talk-data.com talk-data.com

PyData talk 2025-09-30 at 13:15

You Don’t Need Spark for That: Pythonic Data Lakehouse Workflows

Description

Have you ever spun up a Spark cluster just to update three rows in a Delta table? In this talk, we’ll explore how modern Python libraries can power lightweight, production-grade Data Lakehouse workflows—helping you avoid over-engineering your data stack.