This talk discusses how to build an Airflow based data platform that can take advantage of popular ML tools (Jupyter, Tensorflow, Spark) while creating an easy-to-manage/monitor As the field of data science grows in popularity, companies find themselves in need of a single common language that can connect their data science teams and data infrastructure teams. Data scientists want rapid iteration, infrastructure engineers want monitoring and security controls, and product owners want their solutions deployed in time for quarterly reports. This talk will discuss how to build an Airflow based data platform that can take advantage of popular ML tools (Jupyter, Tensorflow, Spark) while creating an easy-to-manage/monitor ecosystem for data infrastructure and support team. In this talk, we will take an idea from a single-machine Jupyter Notebook to a cross-service Spark + Tensorflow pipeline, to a canary tested, production-ready model served on Google Cloud Functions. We will show how Apache Airflow can connect all layers of a data team to deliver rapid results.
talk-data.com
Topic
TensorFlow
machine_learning
deep_learning
neural_networks
1
tagged
Activity Trend
10
peak/qtr
2020-Q1
2026-Q1
Top Events
O'Reilly AI & ML Books
9
O'Reilly Data Engineering Books
8
O'Reilly Data Science Books
6
Data Engineering Podcast
5
Databricks DATA + AI Summit 2023
4
Airflow Summit 2022
3
ADSP: Algorithms + Data Structures = Programs
2
Google Cloud Next '25
2
DataTalks.Club
2
Airflow Summit 2020
1
PyData Berlin 2025
1
Women in AI and Data Science Conference 2025
1
Filtering by:
Airflow Summit 2020
×