talk-data.com talk-data.com

Event

Airflow Summit 2022

2022-07-01 Airflow Summit Visit website ↗

Activities tracked

1

Airflow Summit 2022 program

Filtering by: Ash Berlin-Taylor ×

Top Topics

Airflow 52 Cloud Computing 7 Data Quality 6 Kubernetes 6 AI/ML 5 CI/CD 5 API 4 Spark 4 BigQuery 4 Python 4 TensorFlow 3 Git 3 dbt 3 Astronomer 2 Fivetran 2

Top Speakers

Jarek Potiuk 3 Rafal Biegacz 2 John Jackson 2 Filip Knapik 2 Leah Cole 2 Ross Turk 2 Kaxil Naik 1 Ash Berlin-Taylor 1 Maxime Beauchemin 1 Brent Bovenzi 1 Daniel Imberman 1 Ephraim Anierobi 1

Sessions & talks

Showing 1–1 of 1 · Newest first

Search within this event →

Dynamic Dags -- The New Horizon

2022-07-01
session
Ash Berlin-Taylor
Airflow

In Airflow 2.3 the ability to change the number of tasks dynamically opens up some exciting new ways of building DAGs and lets us create new patterns that just weren’t possible before. In this session I will cover a little bit about AIP-42 and the interface for Dynamic Task Mapping, and cover some common use cases and patterns.