talk-data.com talk-data.com

Airflow Summit session 2022-07-01

Workshop: Running Airflow within Cloud Composer

Event: Airflow Summit 2022

Speakers

Leah Cole

Developer Relations Engineer

Rafal Biegacz

Senior Engineering Manager (Cloud Composer, Google)

Filip Knapik

Google Cloud Composer Product Manager

Bartosz Jankiewicz

Engineering Manager (Cloud Composer, Google)

Przemek Więch

Software Engineer at Google

Topics

AI/ML Airflow BigQuery CI/CD Cloud Computing Dataflow GCP Cloud Composer

Description

This workshop is sold out Hands on workshop showing how easy it is to deploy Airflow in a public Cloud. Workshop consists of 3 parts: Setting up Airflow environment and CI/CD for DAG deployment Authoring a DAG Troubleshoot Airflow DAG/Task execution failures This workshop will be based on Cloud Composer ( https://cloud.google.com/composer ) This workshop is mostly targeted at Airflow newbies and users who would like to learn more about Cloud Composer and how to develop DAGs using Google Cloud Platform services like BigQuery, Vertex AI, Dataflow.