talk-data.com talk-data.com

W

Speaker

Wei Lee

1

talks

Senior Software Engineer at Astronomer & Airflow Committer
Filtering by: Airflow Summit 2024 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 2 activities

Search activities →

Airflow executes all tasks on the workers, including deferrable operators that must run on the workers before deferring to the triggerer. However, running some tasks directly from the triggerer can be beneficial in certain situations. This presentation will explain how deferrable operators function and examine ways to modify the Airflow implementation to enable tasks to run directly from the triggerer.