talk-data.com talk-data.com

S

Speaker

Sumit Maheshwari

1

talks

Tech Lead at Uber, PMC Apache Airflow
Filtering by: Airflow Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 3 activities

Search activities →

Yes, you read that right — 200,000 pipelines, nearly 1 million task executions per day, all powered by a single Airflow instance. In this session, we’ll take you behind the scenes of one of the boldest orchestration projects ever attempted: how Uber’s data platform team is executing what might be the largest Apache Airflow migration in history — and doing it straight to Airflow 3. From scaling challenges and architectural choices to lessons learned in high-throughput orchestration, this is a deep dive into the tech, the chaos, and the strategy behind making data fly at unprecedented scale.