Step with Venkat into a world where data is always fresh, queries run in 1ms, and analytics engineers build web-scale, real-time data apps. As Engineering Director at Facebook, Venkat helped build the RocksDB real-time database that powered growth to 5 billion queries per second(!)—and now with his colleagues at Rockset, he's bringing that real-time database infrastructure to the rest of us. In this conversation, Tristan, Julia and Venkat explore the fundamental technological advances that are empowering analytics engineers to enter the real-time future. For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. The Analytics Engineering Podcast is sponsored by dbt Labs.
talk-data.com
Topic
Analytics
63
tagged
Activity Trend
Top Events
Robert Chang is a product manager for the data platform at Airbnb, where he helped build and roll out Minerva, Airbnb's internal metrics store. They use Minerva to track over 12,000(!) metrics and 4,000(!) dimensions with consistency across the organization. In this conversation with Tristan and Julia, Robert dives into why they built it, what it took to get it done—and crucially, what you should do if your company doesn't have the resources to build your own internal metrics store. For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. The Analytics Engineering Podcast is sponsored by dbt Labs.
For over a decade, technologists thought that the hard thing about harnessing the exploding amount of data would be about technology: how to store it all, how to process it all, how to analyze it all. Turns out that’s not the hard part. Just as in the wider world, organizations are going through an epistemic crisis: they’re having a hard time knowing what is true and what is false.
Most organizations might not have flat-earthers, fake news, and state-sponsored Twitter bots conducting information warfare, but their challenges determining what’s true are just as existential. Solving them will require good tooling, but even moreso will require a set of core values and supporting cultural norms.
In this video, Tristan Handy, CEO and co-founder of Fishtown Analytics asks: what does that future look like?