Airflow Asset originated from data lineage and evolved into its current state, being used as a scheduling concept (data-aware, event-based scheduling). It has even more potential. This talk discusses how other parts of Airflow, namely Connection and Object Storage, contain concepts related to Asset, and we can tie them all together to make task authoring flow even more naturally. Planned topics: Brief history on Asset and related constructs. Current state of Asset concepts. Inlets, anyone? Finding inspiration from Pydantic et al. My next step for Asset.
talk-data.com
T
Speaker
Tzu-ping Chung
2
talks
Staff Software Engineer Astronomer & Airflow PMC Member
Frequent Collaborators
Filtering by:
Airflow Summit 2025
×
Filter by Event / Source
Talks & appearances
Showing 2 of 3 activities
with
Jed Cunningham
,
Tzu-ping Chung
,
Kaxil Naik
,
Brent Bovenzi
(Astronomer)
,
Buğra Öztürk
,
Ash Berlin-Taylor
(Astronomer)
,
Vikram Koka
(Astronomer)
,
Daniel Standish
,
Pierre Jeambrun
,
Vincent Beck
,
Constance Martineau
,
Amogh Rajesh Desai
,
Jens Scheffler
Apache Airflow® 3 is here, bringing major improvements to data orchestration. In this keynote, core Airflow contributors will walk through key enhancements that boost flexibility, efficiency, and user experience. Vikram Koka will kick things off with an overview of Airflow 3, followed by deep dives into DAG versioning (Jed Cunningham), enhanced backfilling (Daniel Standish), and a modernized UI (Brent Bovenzi & Pierre Jeambrun). Next, Ash Berlin-Taylor, Kaxil Naik, and Amogh Desai will introduce the Task Execution Interface and Task SDK, enabling tasks in any environment and language. Jens Scheffler will showcase the Edge Executor, while Constance Martineau, Tzu-ping Chung and Vincent Beck will demo event-driven scheduling and data assets. Finally, Buğra Öztürk will unveil CLI enhancements for automation and debugging. This keynote sets the stage for Airflow 3—don’t miss the chance to learn from the experts shaping the future of workflow orchestration!