Autoscaling in Airflow - what we learnt based on Cloud Composer case. We would like to present how we approach the autoscaling problem for Airflow running in Kubernetes in Cloud Composer: how we calculate our autoscaling metric, what problem we had for scaling down and how did we solve it. Also we share an ideas on what and how we could improve the current solution
talk-data.com
A
Speaker
Anita Fronczak
1
talks
Google, Software Engineer
Filtering by:
Airflow Summit 2021
×
Filter by Event / Source
Talks & appearances
Showing 1 of 2 activities