Go over the yesterday, today and tomorrow for Airflow in Airbnb. Share our learnings and vision in Airflow core and around Airflow in its eco system. Starting with the history of Airflow in Airbnb, briefly describe how Airflow is used and the high level overview of Airflow in Airbnb. Then going into out current setup of Airflow, short term plans, learnings and best practises of Airflow. And finally talk about our the roadmap and vision of Airflow in Airbnb. Aside with Airflow core, we would love to also talk about what we’ve done inside the Airflow ecosystem, including frameworks built on top of Airflow, workflow development tools, etc. The recording for this session is not available.
talk-data.com
K
Speaker
Kevin Yang
2
talks
Engineering Manager
Airbnb | Airflow PMC member
Filter by Event / Source
Talks & appearances
2 activities · Newest first
with
Yingbo Wang
(Airbnb)
,
Conor Camp
(Airbnb)
,
Ping Zhang
,
Cong Zhu
(Airbnb)
,
Kevin Yang
(Airbnb | Airflow PMC member)
with
Tao Feng
(Lyft | Airflow PMC member)
,
Dan Davydov
(Twitter | Airflow PMC member)
,
Kevin Yang
(Airbnb | Airflow PMC member)
In this talk, colleagues from Airbnb, Twitter and Lyft share details about how they are using Apache Airflow to power their data pipelines. Slides: Tao Feng (Lyft) Dan Davydov (Twitter)