talk-data.com talk-data.com

Event

dbt Coalesce 2022

2022-10-11 YouTube Visit website ↗

Activities tracked

81

Filtering by: dbt ×

Sessions & talks

Showing 51–75 of 81 · Newest first

Search within this event →
What classes from roleplaying games can teach us about a career in data

What classes from roleplaying games can teach us about a career in data

2022-10-25 Watch
video
Ian Fahey (dbt Labs)

Roleplaying games? Roleplaying games in data? You read that right. To Ian, there's more commonality in roleplaying games and the data world than most of us think. In this session, Ian Fahey (dbt Labs) will draw on his vast experiences in roleplaying games and analytics engineering work to walk through the adventuring classes of "the world's most popular tabletop roleplaying game" (Dungeons and Dragons) and talk about how they can inform data professionalism.

Check the slides here:https://docs.google.com/presentation/d/16Wm4ChDPORvEkDxUu3-mHBYRLJtwUTRdP7rj-LIrUB4/edit#slide=id.g1571952a68b_0_12

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Adapting data at the speed of business with Sigma & dbt

Adapting data at the speed of business with Sigma & dbt

2022-10-25 Watch
video
Jake Hannan (Sigma Computing)

For too long, there's been contention between business and data teams. Incoming requests to a data team span from adding one specific column for one specific use case, to updating logic for a point in time question—the priorities stack up, and data teams find themselves sifting through a myriad of lower-level requests, unable to work on higher, more transformational deliverables. At Sigma, we're flipping the script by enabling analysts and stakeholders alike to iterate and explore in a familiar spreadsheet UI, with the scale and performance unlocked by modern cloud data warehouses. In this talk, we'll cover how we deploy Sigma internally (powered by dbt and dbt cloud metadata) to truly give the power to generate insights from data back to the business, and create a more effective feedback loop when working with our own data team.

Check the slides here: https://docs.google.com/presentation/d/11jGG6OSwwjtT6gRVpse9VSPjW_mIpYPUfRBx5TSttjk/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Announcing dbt's Second Language: When and Why We Turn to Python

Announcing dbt's Second Language: When and Why We Turn to Python

2022-10-25 Watch
video

For the first time in dbt, you can now run Python models, making it possible to supplement the accessibility of SQL with a new level of power and flexibility.

When is it useful to use Python, and when should you stick with SQL instead? What might a multilingual dbt project look like in practice, and what could it make possible for your team?

Join Jeremy Cohen, Cody Peterson, and Leah Antkiewicz to explore these questions in this interactive session.

Check the slides here: https://docs.google.com/presentation/d/1e3wB7EQ0EXugGhfCjVCp_dDFEbY_uKyVjMqG1o7alnA/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Automating CI/CD in dbt Cloud: Sunrun's story

Automating CI/CD in dbt Cloud: Sunrun's story

2022-10-25 Watch
video
Jared Stout (Sunrun) , James Sorensen (Sunrun)

Does a two-step deployment workflow for developing, testing, and deploying code to dbt Cloud sound possible? Sunrun thinks so. Join James Sorensen and Jared Stout to learn how they used Github Actions and API integrations with dbt Cloud and Jira to entirely automate the CI/CD workflow, saving the team time and worry when moving through SOX certification.

Check the slides here: https://docs.google.com/presentation/d/1ZecU0-TN8SxNFpdKdkVksuDjpUy6XiaulqBdfqhLb68/edit#slide=id.g15507761f0b_0_10

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Automating dbt Development with Pre-Commit

Automating dbt Development with Pre-Commit

2022-10-25 Watch
video
Hassan Al-Rabea (Montreal Analytics) , Cecile Chow (Montreal Analytics)

Automation will make your dbt development faster and safer — but how do you get started? In this workshop we'll introduce you to the "Software Development Life Cycle" and some of the automation opportunities it offers from pre-commit to CI and beyond.

This workshop is ideal for the decision maker who is planning for their team or for the intermediate to advanced dbt developer who wants to become more efficient and learn a thing or two from software workflows. We'll talk about how automation can minimize the risk of code changes, shorten your time to merge, and improve quality and standardization throughout your projects.

Bring your laptop with dbt 1.0+ installed to follow along or just come and watch the walk-through! You'll start this workshop with a simple dbt project and end with local pre-commit automation on your computer and a framework for further improvement and iteration.

Check the step-by-step workshop guide here: https://blog.montrealanalytics.com/automating-dbt-development-workflows-with-pre-commit-b6c7ca708f7

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Building a “Relevance Engine” with dbt and AI/ML

Building a “Relevance Engine” with dbt and AI/ML

2022-10-25 Watch
video
Gaurav Saraf (Sisu Data)

Supplying users with the most relevant data is a time-consuming challenge. By combining the power of dbt with machine learning (ML) analysis, companies are able to focus on the most relevant segments in the data that have the greatest impact on key metrics and how they change over time. Leveraging the Sisu Decision Intelligence Engine, dbt users, analysts, and data scientists focus their efforts where they have the greatest impact. Sisu's AI/ML-powered automated analytics identifies relevant data and predicts changes, helping focus data exploration, speed insights, and drive successful outcomes.

Check Notion document here: https://www.notion.so/6382db82046f41599e9ec39afb035bdb

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Building turnkey dashboards for core financial metrics with dbt: A Little Modeling Goes a Long Way

Building turnkey dashboards for core financial metrics with dbt: A Little Modeling Goes a Long Way

2022-10-25 Watch
video
Matthew Hoss (Element Biosciences)

Let’s get down to business! Most business users don't want to be bogged down in the data modeling and complexities that us data folk work so hard to accomplish and overcome. Instead, business users and leadership members want the dashboards and numbers they care about. In this session, Matthew Hoss (Element Biosciences) shares his four-step approach to modeling and creating turnkey cost dashboards, all sitting on top of a Netsuite/Fivetran/Snowflake/dbt/Tableau data stack, that help business users get the answers they need, quickly.

Check the slides here: https://docs.google.com/presentation/d/1VVZwm2Kloy1aeewqbB--7WfxIifnpIZflx9V8Q2N-x0/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

But really, what is transformation?

But really, what is transformation?

2022-10-25 Watch
video
Allan Campopiano (Deepnote)

Many transformations are fine candidates for concretizing with dbt. But there are transformations that live in the data science world that are not well-suited for dbt—and probably for good reason. Consider the total set of all transformations, from mandatory pre-processing steps to sophisticated statistical transformations (e.g., converting data types versus computing robust measures of central tendency). The question quickly becomes: How do data teams decide which transformations to push down to dbt and which to leave up in the notebook?

In this panel discussion led by Allan Campopiano (Deepnote), analytics engineers, data engineers, and data scientists discuss what transformation means to them, where and when transformation happens in their stack, and how to collaborate effectively between high- and low-level forms of transformation.

Check the slides here: https://docs.google.com/presentation/d/1uqi1C2gpBnsMp-BTvjltmjlnedWKqEzwonZjrewOWNk/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

dbt and MDS in small-batch academic research: a working example

dbt and MDS in small-batch academic research: a working example

2022-10-25 Watch
video
Šimon Podhajský (iLife Technologies)

Academia/open science is an as-yet untapped market for analytics engineering, as well as one that could majorly benefit from the tight coupling of data transformation and software engineering best practices. But introducing dbt into this context comes with its own set of challenges. In this session, Šimon Podhajský (iLife Technologies), explains what’s slowing progress here,, and what academics can do to progress this work.

Check the slides here: https://docs.google.com/presentation/d/1aw_cs6V0n-oT9Lp7Vq3MNcRbthEFJEYwcvkCBfuzlR0/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

dbt as a Serverless Service

dbt as a Serverless Service

2022-10-25 Watch
video
Kiran Sheshadri (4 Mile Analytics)

Are you sold on dbt, but unsure as to how you’ll handle deployment, orchestration and job scheduling? Are you evaluating dbt and looking for an easy way to spin up a proof of concept while seeking buy in from stakeholders? Look no further! In this workshop we will show you how to containerize your dbt project and execute jobs using GCP’s serverless computing products Cloud Run, Build and Scheduler. If you have an interest in dbt orchestration, devops, or serverless cloud architecture, this workshop is for you!

Check the slides here: https://docs.google.com/presentation/d/1NiG0MFkOvw5MNpCZFF74VDuX-jHZpO4a8bHUadukoPI/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

dbt Labs + Snowflake: Why SQL and Python go perfectly well together

dbt Labs + Snowflake: Why SQL and Python go perfectly well together

2022-10-25 Watch
video
Torsten Grabs (Snowflake)

As data science and machine learning adoption grew over the last few years, Python moved up the ranks catching up to SQL in popularity in the world of data processing. SQL and Python are both powerful on their own, but their value in modern analytics is highest when they work together. This was a key motivator for us at Snowflake to build Snowpark for Python: to help modern analytics, data engineering, and data science teams generate insights without complex infrastructure management for separate languages.

Join this session to learn more about how dbt's new support for Python-based models and Snowpark for Python can help polyglot data teams get more value from their data through secure, efficient and performant metrics stores, feature stores, or data factories in the Data Cloud.

Check Notion document here: https://www.notion.so/6382db82046f41599e9ec39afb035bdb

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Democratizing data at Zillow with dbt, Airflow, Spark, and Kubernetes

Democratizing data at Zillow with dbt, Airflow, Spark, and Kubernetes

2022-10-25 Watch
video
Deepak Konidena (Zillow)

Building data pipelines is difficult—and adding a data governance and observability framework doesn’t make it any easier. But that was the task ahead for Deepak Konidena during his early days at Zillow. In this session, he’ll share how the platform they build on top of dbt, Airflow, Spark, and Kubernetes—ZSQL—eliminated the need for internal data teams to build their own DAGs, models, schemas and lineage from scratch, while also providing an easy way to enforce data quality, monitor changes, and alert on disruptions.

Check the slides here: https://docs.google.com/presentation/d/18HEil3_nXD8nYBhcg4m-Kpy8I8Na6MXI/edit?usp=sharing&ouid=110293204340061069659&rtpof=true&sd=true

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Demystifying event streams: Transforming events into tables with dbt

Demystifying event streams: Transforming events into tables with dbt

2022-10-25 Watch
video
Charlie Summers (Merit)

Pulling data directly out of application databases is commonplace in the MDS, but also risky. Apps change quickly, and application teams might update database schemas in unexpected ways, leading to pipeline failures, data quality issues, data delivery slow-downs. There is a better way. In his session, Charlie Summers (Merit) describes how their organization transforms application event streams into analytics-ready tables, more resilient to event scheme changes.

Check the slides here:https://docs.google.com/presentation/d/1K5PcoVshiHKZs_xI3K4P5JRNYTkbmnQJPMl8NmBlGfo/edit

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Detecting Data Anomalies via an Inspection Layer

Detecting Data Anomalies via an Inspection Layer

2022-10-25 Watch
video
John Rensberger (Red Pill Analytics) , Neal Achord (Red Pill Analytics)

Let's face it, we can't get enough data these days and often ingest from various sources like vendors, IoT devices, and more. Unfortunately, you've likely encountered times when the data just isn't what you're expecting. For instance; when the data has nulls, duplicates, is arranged differently than the schema specification, or others - this can be a weak point for many data pipelines. We'll showcase a way to handle this using dbt native methods to implement an inspection layer to ensure erroneous data sets can be flagged and quarantined while the rest can load uninterrupted.

Check the slides here: https://docs.google.com/presentation/d/11Q9wwMfyz6xuxMXCPizFg4DKSY_zOIHPNOrsNI8oBn8/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Driving actionable insights

Driving actionable insights

2022-10-25 Watch
video
Christian Franklin (phData) , Cory Koster (phData)

See how visual data modeling and dbt combine to improve interaction and understanding between analytics engineering practitioners, product owners, and business partners. We will demonstrate conceptual and logical modeling techniques and diagrams to establish common understanding, enhance business partner collaboration, enhance translation of requirements, and ultimately complement analytics engineering within dbt to improve time to value. Demonstrate how to pair data modeling concepts (conceptual, logical, physical) and tools (SqlDBM) to engage your customers and inform the analytics engineering with dbt and Snowflake. We will show how this workbench and tools complement the analytics lifecycle for engineers and data consumers alike. The workbench includes a dbt, a visual modeling tool, and phData Toolkit CLI.

This session requires pre-registration. Sign up here. If session is filled you are welcome to come to the room and join the waitlist onsite. Open seats will be made available 10 minutes after session start.

Check the slides here: https://docs.google.com/presentation/d/1fJhaMGvD7TvVft4nEJYhMRhyanQTw3lbzLrgZFsmj-0/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Hands-on: the dbt Semantic Layer

Hands-on: the dbt Semantic Layer

2022-10-25 Watch
video
Cameron Afzal (dbt Labs)
dbt

The long-awaited dbt Semantic Layer is finally here. By defining metrics centrally in dbt, data teams can trust that business logic referenced anywhere will be exactly the same everywhere. Experience it in action in this hands-on session with the dbt Labs product team and dbt Labs partners.

Check the slides here: https://docs.google.com/presentation/d/1lOH6Sb8DQnnlmZkYOlqqHgQeXKkUEQCm_LOxsjBRJlM/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

How the Content Analytics team at Spotify avoids data indigestion in BigQuery with dbt

How the Content Analytics team at Spotify avoids data indigestion in BigQuery with dbt

2022-10-25 Watch
video
Nick Baker (Spotify) , Mitchell Silverman (Spotify) , Brian Pei (Spotify)

When the content analytics team at Spotify adopted dbt and shifted away from an internally developed transformation tool, they needed to figure out how to access data produced by other teams using sharded partitions. Enter: Waluigi. Nick Baker, Brian Pei, and Mitchell Silverman show us how an internal package used to safely and smoothly ingest the data they need also helped empower other data teams to more easily adopt dbt and leverage the data they produce.

Check the slides here: https://docs.google.com/presentation/d/1uAzfKa2Usbbr7J6jcI-IwdK1gPTKEsWSgZEfTU5bulM/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Jumpstart dbt: How to Achieve Speed and Scale

Jumpstart dbt: How to Achieve Speed and Scale

2022-10-25 Watch
video
Virendra Singh (Cisco) , Alex Garbarini (Cisco)

For enterprises integrating dbt into their transformation technology stack, of paramount importance is how to achieve speed and scale. Sure, dbt will "infinitely scale" due to its underlying cloud native deployment- but only in reference to hosting, execution, and other platform services. HOW does one onboard hundreds or thousands of users with repeatability, conformity, and engineering excellence by design? HOW does an organization integrate dependent platforms and services? Centrally monitor? Share reusable assets? Maintain security?... This talk identifies how Cisco enabled automated services and processes to achieve that scale. Walk away knowing what's in store for you if onboarding dbt, headwinds we faced, and the success Cisco is seeing in our chosen deployment paradigm.

Check the slides here: https://docs.google.com/presentation/d/1e4fG0_60APnCmFDV5a8X7sPOCbKlto3L/edit?usp=sharing&ouid=110293204340061069659&rtpof=true&sd=true

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Operational AI for the Modern Data Stack

Operational AI for the Modern Data Stack

2022-10-25 Watch
video
Tristan Zajonc (Continual)

The opportunities for AI and machine learning are everywhere in modern businesses, but today's MLOps ecosystem is drowning in complexity. In this talk, we'll show how to use dbt and Continual to scale operational AI — from customer churn predictions to inventory forecasts — without complex engineering or operational burden.

Check the slides here: https://docs.google.com/presentation/d/1vNcQxCjAK4xZVZC1ZHzqBzPiJE7uwhDIVWGeT9Poi1U/edit#slide=id.g15b1f544dd5_0_1500

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Streaming with dbt: the Jaffle Shop don’t stop!

Streaming with dbt: the Jaffle Shop don’t stop!

2022-10-25 Watch
video
Anna Glander (Materialize) , Marta Paes (Materialize)

In between JVM languages, high-maintenance frameworks and academic papers, streaming remains a hard beast to tame for most of us. What if nothing had to change, and streaming just meant…still writing dbt models? At Materialize, we’re exploring how to make the most of dbt for streaming — from real-time analytics to continuous testing, and beyond! Join us to learn how to get started with no blood, sweat or tears, using the Jaffle Shop as a playground. Our toolbox? A database that feels like Postgres but works like all the streaming systems you’ve been avoiding, some SQL and a dash of magic.

Check the slides here: https://docs.google.com/presentation/d/11PANQElVxtzqgzmRCcQfZy24vdMeYDokpxr7LdlrbrE/edit#slide=id.g105b4fffa32_0_942

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Testing: Our assertions vs. reality

Testing: Our assertions vs. reality

2022-10-25 Watch
video
Mariah Rogers (Palmetto)
dbt

Testing data models is sometimes like trying to form a bust from clay made of cornstarch and water. Right when you think you've got it into the right shape and set it on a shelf, it completely melts into a puddle of mush. Our practice of testing transformations on top of shifting, changing data falls apart in the same way over and over again, yet we don't learn our lesson. Come learn from Mariah Rogers (Palmetto) why we're doing model testing wrong, how we can change our ways to do it better, and what problems will be essential for the dbt Community to solve together to bridge the gap.

Check the slides here: https://docs.google.com/presentation/d/1oTWnOJxCSRN7ihgI-SflQCBkA7cwmcpGvryOh1vWKoc/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

When the Real World Messes with Your Schedule: Event Driven Dbt Models for the MDS

When the Real World Messes with Your Schedule: Event Driven Dbt Models for the MDS

2022-10-25 Watch
video

The real world is unreliable. Planes take off late, trains leave early, and cars break down. Sometimes, we need to get data from a source without a standard connector. Sometimes, a schedule really doesn't cut it. In this talk, we'll build a pipeline that responds to events to ensure that data is delivered quickly and reliably. We'll also ensure it can handle failure and keep bad data from clogging the plumbing.

Check the slides here: https://docs.google.com/presentation/d/1W9p7H4l0fUr7iAJ3GxEGUTmWGtmc_iu02N-MKb2BSFM/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Why rent when you can own? Build your modern data lakehouse with true optionality

Why rent when you can own? Build your modern data lakehouse with true optionality

2022-10-25 Watch
video
Tom Nats (dbt Labs) , Brian Zhan (dbt Labs)

With Trino (formerly PrestoSQL) and dbt combined, you can get faster access to your data and the ability to analyze data across multiple data sources with ease. Extract, load and transform data in your data lakehouse easier than ever before using dbt’s Trino adapter. Join Brian Zhan and Tom Nats as they talk about the new dbt connector for Trino and how it works, along with a demo showing how easy it is to deploy, build and serve up analytics using dbt and Starburst Galaxy.

Check the slides here: https://docs.google.com/presentation/d/1-A-mfc1RIj87ypz6KeZvxK62QLaGthmMqBPy10vNnDk/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Workshop: Advanced Testing

Workshop: Advanced Testing

2022-10-25 Watch
video
Lauren Benezra (dbt Labs) , Bennie Regenold (dbt Labs)
dbt

Do you want to take your dbt project beyond simple unique and not-null tests, but don’t know where to start? Join the dbt Labs team for a deep dive into testing. You’ll learn how to customize tests to fit your unique needs, lean on the amazing dbt community for pre-built tests you can add straight to your project, and flex your Jinja skills by creating your own custom tests. By the end of this course you’ll be walking tall knowing that the data you’re providing to your customers is clean, reliable, and consistent.

Check the slides here: https://docs.google.com/presentation/d/1TCehN5TxHYIuE6gk3rCGx1f9kLkkcXM7TnfcDejUnqo/edit?usp=sharing

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.

Workshop: Build your first dbt Python model

Workshop: Build your first dbt Python model

2022-10-25 Watch
video
Nicholas Yager (dbt Labs) , Wasila Quader (dbt Labs)

Description: dbt now supports Python models! In this hands-on workshop you’ll learn how to build your first Python models in dbt, alongside SQL at the center of your transformations.

You’ll learn how to: - Build your Python transformation in a notebook - Add this transformation as a model in your dbt project - Decide between building models in SQL or in Python

Prerequisites: - Basic familiarity with Python and DataFrames - If you want to use your own Warehouse and dbt project, make sure that you have dbt 1.3 installed and have followed the “additional setup” from our docs

Check the slides here: https://docs.google.com/presentation/d/133CVwwAxc5qT80ZJwngQ_ZSikOkCttvzWwGpdZCgOHQ/edit#slide=id.g1693e59a4f4_0_0

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.