Pinterest has been part of the Airflow community for two years and has worked on many custom solutions to address usability, scalability, and efficiency constraints. This session is to discuss how Pinterest has further expanded on those previous solutions. We will discuss how we work to further reduce system latencies, improve user development through added search features, support for cross cluster operations, and improved debuggability tooling, and system level efficiency improvements to auto retry failed tasks that meet certain criteria.
talk-data.com
D
Speaker
Dinghang Yu
1
talks
Software Engineer
Pinterest
Frequent Collaborators
Filtering by:
Airflow Summit 2022
×
Filter by Event / Source
Talks & appearances
Showing 1 of 4 activities