talk-data.com talk-data.com

S

Speaker

Sam Bail

1

talks

Independent Data Professional Superconductive
Filtering by: Airflow Summit 2021 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 2 activities

Search activities →

Data quality has become a much discussed topic in the fields of data engineering and data science, and it has become clear that data validation is absolutely crucial to ensuring the reliability of any data products and insights produced by an organization’s data pipelines. This session will outline patterns for combining three popular open source tools in the data ecosystem - dbt, Airflow, and Great Expectations - and use them to build a robust data pipeline with data validation at each critical step.