talk-data.com talk-data.com

Event

Airflow Summit 2021

2021-07-01 Airflow Summit Visit website ↗

Activities tracked

52

Airflow Summit 2021 program

Filtering by: Airflow ×

Sessions & talks

Showing 51–52 of 52 · Newest first

Search within this event →

Writing Dry Code in Airflow

2021-07-01
session
Sarah Krasnik (Perpay)

Engineering teams leverage the factory coding pattern to write easy-to-read and repeatable code. In this talk, we’ll outline how data engineering teams can do the same with Airflow by separating DAG declarations from business logic, abstracting task declarations from task dependencies, and creating a code architecture that is simple to understand for new team members. This approach will set analytics teams up for success as team and Airflow DAG sizes grow exponentially.

You don’t have to wait for someone to fix it for you

2021-07-01
session

Rachael, a new Airflow contributor, and Leah, an experienced Airflow contributor, share the story of Rachael’s first contribution, highlighting the importance of contributions from new users and the positive impact that non-code contributions have in an open source community.