talk-data.com talk-data.com

A

Speaker

Austin Bennett

1

talks

Bamboozoology

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →

DAG integrity is critical. So are coding conventions, consistency in standards for the group. In this talk, we will share the various lessons learned for testing/verifying our DAGs as part of our GitHub workflows [ for testing as part of the pull request process, and for automated deployment - eventually to production - once merged ]. We will dig into how we have unlocked additional efficiencies, catch errors before they get deployed, and generally how we are better off for having both Airflow & plenty of checks in our CI, before we merge/deploy.