Airflow executes all tasks on the workers, including deferrable operators that must run on the workers before deferring to the triggerer. However, running some tasks directly from the triggerer can be beneficial in certain situations. This presentation will explain how deferrable operators function and examine ways to modify the Airflow implementation to enable tasks to run directly from the triggerer.
talk-data.com
W
Speaker
Wei Lee
1
talks
Senior Software Engineer at Astronomer & Airflow Committer
Filtering by:
Airflow Summit 2024
×
Filter by Event / Source
Talks & appearances
Showing 1 of 2 activities