talk-data.com talk-data.com

Airflow Summit session 2020-07-01

How do we reason about the reliability of our data pipeline in Wrike

Topics

Description

In this talk we will share some of the lessons we have learned after using Airflow for a couple of years and growing from 2 users to 8 teams. We cover: establishing a reliable review process on AirFlow, managing multiple Airflow configurations, data versioning.