talk-data.com talk-data.com

YouTube 2023-10-24 at 20:02

The more, the merrier: Managing a dynamic, expanding, self-service dbt project - Coalesce 2023

Description

In the past year at Whatnot, the team has watched their dbt project grow from three developers and fewer than 50 models, to 50 developers and more than 1000 models. In this talk, Alice Leach, a data engineer at Whatnot, discusses the knowledge the team has acquired during this time and the solutions they have built to address the challenges that come with scaling projects. This is broken down into three “G”s: guard rails (robust CI/ CD processes, model monitoring and automated clean up); guidelines (modular workspaces, macros and documentation); and gadgets (dbt code generation and the operations and hooks in place to allow the dbt project to interface with other tools).

Speaker: Alice Leach, Data Engineer, Whatnot

Register for Coalesce at https://coalesce.getdbt.com