talk-data.com talk-data.com

Topic

CI/CD

Continuous Integration/Continuous Delivery (CI/CD)

devops automation software_development ci_cd

9

tagged

Activity Trend

21 peak/qtr
2020-Q1 2026-Q1

Activities

Showing filtered results

Filtering by: dbt Coalesce 2023 ×
Supercharging analytics engineers to balance quality & speed via automated CI checks - Coalesce 2023

Supercharge your analytics engineering with the power of automated CI checks. Learn how FINN, a global car subscription service, has harnessed the capabilities of automated CI checks to maintain the delicate balance between swift development and robust data pipeline quality as they've scaled their data teams. Dive into insights and strategies to ensure quality without sacrificing speed and discover how to improve your data operations.

Speakers: Chiel Fernhout, Software Engineer, Datafold; Jorrit Posor, Tech Lead Data Engineering, FINN GmbH; Felix Kreitschmann, Senior PM, Data, FINN Auto

Register for Coalesce at https://coalesce.getdbt.com

Enterprise MDS deployment at scale: dbt & DevOps - Coalesce 2023

Behind any good DataOps within a Modern Data Stack (MDS) architecture is a solid DevOps design! This is particularly pressing when building an MDS solution at scale, as reliability, quality and availability of data requires a very high degree of process automation while remaining fast, agile and resilient to change when addressing business needs.

While DevOps in Data Engineering is nothing new - for a broad-spectrum solution that includes data warehouse, BI, etc seemed either a bit out of reach due to overall complexity and cost - or simply overlooked due to perceived issues around scaling often attributed to the challenges of automation in CI/CD processes. However, this has been fast changing with tools such as dbt having super cool features which allow a very high degree of autonomy in the CI/CD processes with relative ease, with flexible and cutting edge features around pre-commits, Slim CI, etc.

In this session, Datatonic covers the challenges around building and deploying enterprise-grade MDS solutions for analytics at scale and how they have used dbt to address those - especially around near-complete autonomy to the CI/CD processes!

Speaker: Ash Sultan, Lead Data Architect, Datatonic

Register for Coalesce at https://coalesce.getdbt.com

Hands-on tips to get started with CI in dbt Cloud - Coalesce 2023

Learn best practices for improving your data workflows at scale. In this session, the dbt Labs team shares tactical ideas for setting up CI for the first time and shipping with confidence, as well as tips to take your implementation to the next level.

Speaker: Joel Labes, Senior Developer Experience Advocate, dbt Labs

Register for Coalesce at https://coalesce.getdbt.com

Identifying novel data issues that go undetected through CI/CD with dbt and Datafold - Coalesce 2023

Join the team from Moody's Analytics as they take you on a personal journey of optimizing their data pipelines for data quality and governance. Like many data practitioners, Ryan and Ravi understand the frustration and anxiety that comes with accidentally introducing bad code into production pipelines—they've spent countless hours putting out fires caused from these unexpected changes.

In this session, Ryan and Ravi recount their experiences with a previous data stack that lacked standardized testing methods and visibility into the impact of code changes on production data. They also share how their new data stack is safeguarded by Datafold's data diffing and continuous integration (CI) capabilities, which enables their team to work with greater confidence, peace of mind, and speed.

Speakers: Gleb Mezhanskiy, CEO, Datafold; Ravi Ramadoss, Director of Data Engineering, Moody's Analytics CRE; Ryan Kelly, Data Engineer, Moody's Analytics CRE

Register for Coalesce at https://coalesce.getdbt.com

Powering MuleSoft's (a Salesforce Company) modern data analytics framework with dbt - Coalesce 2023

In this session, Yijun Cao and Dakota Kelley highlight how dbt plays a key role in MuleSoft’s modern data analytics framework. As MuleSoft continues to grow, the data platform engineering team encountered some challenges with the data transformations. The session dives deeper into the specific challenges faced by the team and demonstrates how dbt’s features including CI/CD, testing, documentation and lineage help overcome these challenges.

Speakers: Yijun Cao, Data Platform Engineer, Salesforce; Dakota Kelley, Solution Architect, phData

Register for Coalesce at https://coalesce.getdbt.com

Better CI for better data quality - Coalesce 2023

Continuous Integration (CI) in dbt Cloud makes it easy to test every change you make prior to deploying. It’s a hallmark of mature analytics workflows. We’ve made some major improvements to dbt Cloud CI, so it’s easier than ever to prevent breaking changes, save on costs, and keep those pesky stakeholders happy.

Join the dbt Labs product team on this magical journey to a world of better data quality, and see for yourself what CI can do for you.

Speaker: Grace Goheen, Product Manager, dbt Labs

Register for Coalesce at https://coalesce.getdbt.com

Data and monolith: Scaling a computationally slim 1500+ model beast - Coalesce 2023

Learn how ClickUp uses dbt, dbt packages, and Snowflake to save on storage and compute costs using Slim CI and how they empower a data warehouse centric culture across Sales, Marketing, Product Growth, Finance, and RevOps all while maintaining one monolithic dbt build job.

Speaker: Michael Revelo, Data Platform Lead , ClickUp

Register for Coalesce at https://coalesce.getdbt.com

On the benefits and virtues of drilling pilot holes - Coalesce 2023

A significant proportion of dbt Cloud users do not have a dbt CI job set up. Among those who do, many don’t leverage powerful functionality like state comparison and deferral to implement Slim CI, likely causing teams to miss errors and building unnecessary tables. Setting up Slim CI in dbt Cloud can be especially challenging for larger-scale data organizations who have multiple data environments, git branches, and targets. Watch this session to learn how you can build and evolve a strong, lasting data environment using Slim CI.

Speakers: Leo Folsom, Solutions Engineer, Datafold

Register for Coalesce at https://coalesce.getdbt.com

The more, the merrier: Managing a dynamic, expanding, self-service dbt project - Coalesce 2023

In the past year at Whatnot, the team has watched their dbt project grow from three developers and fewer than 50 models, to 50 developers and more than 1000 models. In this talk, Alice Leach, a data engineer at Whatnot, discusses the knowledge the team has acquired during this time and the solutions they have built to address the challenges that come with scaling projects. This is broken down into three “G”s: guard rails (robust CI/ CD processes, model monitoring and automated clean up); guidelines (modular workspaces, macros and documentation); and gadgets (dbt code generation and the operations and hooks in place to allow the dbt project to interface with other tools).

Speaker: Alice Leach, Data Engineer, Whatnot

Register for Coalesce at https://coalesce.getdbt.com