talk-data.com talk-data.com

Topic

Grafana

data_visualization monitoring dashboards

1

tagged

Activity Trend

4 peak/qtr
2020-Q1 2026-Q1

Activities

Showing filtered results

Filtering by: Noam Elfanbaum ×

At Bluevine we use Airflow to drive our ML platform. In this talk, Noam presents the challenges and gains we had at transitioning from a single server running Python scripts with cron to a full blown Airflow setup. This includes: supporting multiple Python versions, event driven DAGs, performance issues and more! Some of the points that I’ll cover are: Supporting multiple Python versions Event driven DAGs Airflow Performance issues and how we circumvented them Building Airflow plugins to enhance observability Monitoring Airflow using Grafana CI for Airflow DAGs (super useful!) Patching Airflow scheduler Slides