talk-data.com

On Survivor, it's all fun and games until someone fails and a challenge is lost. People scramble, they frantically search for hidden immunity idols (and sometimes even crazier things happen).

Within data teams, everything is fine until that one Slack alert comes in about a failed run. Chaos doesn't need to ensue between analytics and data engineers when triaging an error with the warehouse or upstream infrastructure. Order fulfillment? Orders are initiated by a user in a web app. Fraud detection? The logic is usually based on ML models that require training and testing. Workflows are connected, making disparate systems a necessity to connect.

The keys to success on Survivor, and on data teams: create links to find hidden immunity idols—I mean, the root cause of why a workflow failed.

Run double duty during this talk: learn about Survivor social science and how to bridge the gap between analytics and data engineering beyond the warehouse for a one-happy-family feeling.

Speaker: Sarah Krasnik Bedell, Growth Lead, Prefect

Register for Coalesce at https://coalesce.getdbt.com

Most recently leading a data engineering team at Perpay, Sarah has built and managed data platforms end to end by working closely with internal engineering, product, and operational teams. She recently left her role to pursue a wide variety of endeavors, including writing on her Substack (https://sarahsnewsletter.substack.com/). In this conversation with Tristan and Julia, Sarah dives into how configuration-as-code can automate away data work, why you might want to consider adding a data lake to your architecture, and how those looking to build a self-serve data culture can look to self-serve frozen yogurt shops for inspiration. For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. The Analytics Engineering Podcast is sponsored by dbt Labs.