Shubham Mehta

Activities

2

talks

Senior Product Manager AWS Analytics

Filtering by: Airflow Summit 2024 ×

Filter by Event / Source

Airflow Summit 2024 2 Airflow Summit 2023 1

Talks & appearances

Showing 2 of 3 activities

Search activities →

Airflow 3 - Roadmap Discussion

2024-07-01 · Airflow Summit 2024

session

with Michał Modras (Google) , Kaxil Naik , Madison Swain-Bowden (Automattic) , Shubham Mehta (AWS Analytics) , Constance Martineau

Airflow

Join us in this panel with key members of the community behind the development of Apache Airflow where we will discuss the tentative scope for the next generation, i.e. Airflow 3.

Scaling AI Workloads with Apache Airflow

2024-07-01 · Airflow Summit 2024

session

with Rajesh Bishundeo , Shubham Mehta (AWS Analytics)

AI/ML Airflow AWS Data Management

AI workloads are becoming increasingly complex, with unique requirements around data management, compute scalability, and model lifecycle management. In this session, we will explore the real-world challenges users face when operating AI at scale. Through real-world examples, we will uncover common pitfalls in areas like data versioning, reproducibility, model deployment, and monitoring. Our practical guide will highlight strategies for building robust and scalable AI platforms leveraging Airflow as the orchestration layer and AWS for its extensive AI/ML capabilities. We will showcase how users have tackled these challenges, streamlined their AI workflows, and unlocked new levels of productivity and innovation.