talk-data.com talk-data.com

Meetup talk 2025-12-02 at 19:10

How I Learned to Stop Worrying and Love Generators

Description

Python's generators offer a simple, elegant way to build lightweight data pipelines. In this talk, we’ll break down generator functions and expressions and walk through practical Data Engineering examples: streaming large datasets in chunks, transforming records without exhausting memory, and using yield for clean setup and teardown. A concise tour of how generators can make data workflows more efficient—and more elegant.