talk-data.com talk-data.com

Event

Dbt Coalesce 2024

2024-10-11 YouTube Visit website ↗

Activities tracked

5

Filtering by: Data Engineering ×

Sessions & talks

Showing 1–5 of 5 · Newest first

Search within this event →
Coalesce 2024: How Cox Automotive turbocharged data engineering with ELT

Coalesce 2024: How Cox Automotive turbocharged data engineering with ELT

2024-10-16 Watch
video
Somnath Chatterjee (Cox Automotive) , Brett Darcy (Cox Automotive)

A migration story with the underlying philosophy, and strategic approach to move from a low-code ETL tool like Alteryx to a modern data engineering mindset with dbt. This transition is not just about adopting new tools but embracing a code-first philosophy that promotes best practices in software engineering, such as modularity, reusability, and transparency.

Speakers: Somnath Chatterjee Lead Data Engineer Cox Automotive

Brett Darcy Lead Software Engineer Cox Automotive

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

Coalesce 2024: Scaling data transformations with dbt: Symend's journey towards efficiency

Coalesce 2024: Scaling data transformations with dbt: Symend's journey towards efficiency

2024-10-16 Watch
video
Ramanpreet Singh (Symend)

Symend is a leading customer engagement solution that has adopted dbt at wide scale with over 70,000 model runs processing 186 million records daily across multiple environments in a multi-tenant environment. To manage this complexity, they rely on dbt Cloud to streamline processes and drive efficiency and have revolutionized data operations to achieve unprecedented efficiency, reliability, and speed at massive scale.

Raman will share insights, experiences, and best practices for leveraging dbt at scale, including how they have achieved a 70% decrease in daily warehouse computing costs, a 60% reduction in data engineering hours, and a dramatic 90% decrease in debugging issues. In addition, he'll share using dbt Cloud has not only reduced latency and improved data rebuild times, but has also instilled trust in our data and data teams, enabling them to ship data products faster and at a lower cost.

Speaker: Ramanpreet Singh Engineer Manager, Analytics Symend

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

Coalesce 2024: From Core to Cloud: Unlocking dbt at Warner Brothers Discovery (CNN)

Coalesce 2024: From Core to Cloud: Unlocking dbt at Warner Brothers Discovery (CNN)

2024-10-16 Watch
video
Mamta Gupta (Warner Brothers Discovery) , Zachary Lancaster (Warner Brothers Discovery)

Since the beginning of 2024, the Warner Brothers Discovery team supporting the CNN data platform has been undergoing an extensive migration project from dbt Core to dbt Cloud. Concurrently, the team is also segmenting their project into multi-project frameworks utilizing dbt Mesh. In this talk, Zachary will review how this transition has simplified data pipelines, improved pipeline performance and data quality, and made data collaboration at scale more seamless.

He'll discuss how dbt Cloud features like the Cloud IDE, automated testing, documentation, and code deployment have enabled the team to standardize on a single developer platform while also managing dependencies effectively. He'll share details on how the automation framework they built using Terraform streamlines dbt project deployments with dbt Cloud to a ""push-button"" process. By leveraging an infrastructure as code experience, they can orchestrate the creation of environment variables, dbt Cloud jobs, Airflow connections, and AWS secrets with a unified approach that ensures consistency and reliability across projects.

Speakers: Mamta Gupta Staff Analytics Engineer Warner Brothers Discovery

Zachary Lancaster Manager, Data Engineering Warner Brothers Discovery

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

Coalesce 2024: Securing data access with dbt lineage and dbt grants

Coalesce 2024: Securing data access with dbt lineage and dbt grants

2024-10-16 Watch
video

Carta prioritizes ensuring that their data is accessible only to the right individuals. Previously, they used functional groups to manage data access, but this approach often fell short in perfectly governing granular data sets. Recently, Carta developed a new access management system utilizing dbt lineage and dbt grants. These tools enable them to automatically propagate data access tags defined in dbt sources. This innovative system allows them to confidently ensure that individuals have appropriate access to data.

Speaker: Marco Albuquerque Senior Engineering Manager - Data Engineering Carta

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

Coalesce 2024: How SurveyMonkey sharpens dbt performance and governance with data observability

Coalesce 2024: How SurveyMonkey sharpens dbt performance and governance with data observability

2024-10-16 Watch
video
Samiksha Gour (SurveyMonkey)

The data team at SurveyMonkey, the global leader in survey software, oversees heavy data transformation in dbt Cloud — both to power current business-critical projects, and also to migrate legacy workloads. Much of that transformation work is taking raw data — either from legacy databases or their cloud data warehouse (Snowflake) — and making it accessible and useful for downstream users. And to Samiksha Gour, Senior Data Engineering Manager at SurveyMonkey, each of these projects is not considered complete unless the proper checks, monitors, and alerts are in place.

Join Samiksha in this informative session as she walks through how her team uses dbt and their data observability platform Monte Carlo to ensure proper governance, gain efficiencies by eliminating duplicate testing and monitoring, and use data lineage to ensure upstream and downstream continuity for users and stakeholders.

Speaker: Samiksha Gour Senior Data Engineering Manager SurveyMonkey

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements