talk-data.com
Airflow Summit
session
2023-07-01
Reducing Cost with Async/Deferrable Operators
Event:
Airflow Summit 2023
Topics
Description
At Condé Nast, we have heavily leveraged async/deferrable operators to reduce our Airflow-associated costs. By implementing async/deferrable operators in all of our pipelines, we have been able to realize a cost reduction of 54% compared with our previous usage of non-async/deferrable operators.