Airflow is a popular choice for organizations looking to integrate open-source dbt within their existing data infrastructure. This talk will explore two primary methods of running dbt in Airflow: job-level and model-level. We’ll discuss the tradeoffs associated with each approach, highlighting the simplicity and efficiency of job-level orchestration, contrasted with the enhanced observability and control provided by model-level orchestration. We’ll also explain how the balance has shifted in recent years, with improvements to dbt core making model-level more efficient and innovative Airflow extensions like Cosmos making it easier to implement. Finally, we’ll provide benchmarks to help you determine which paradigm is the best fit for your needs.

The days of unrestrained cloud spending are coming to an end. In the coming months, data teams will increasingly be asked to better understand, monitor and reduce their data warehouse spend. The problem? Practitioners aren't equipped with the tools to do this well. In this talk, Ian Whitestone (Shopify) and Jonathan Talmi (Snapcommerce) will share their own end-to-end process for cutting warehouse spend, diving into the actual strategies they've deployed to give practitioners immediately actionable processes and techniques to keep costs controlled.

Check the slides here: https://docs.google.com/presentation/d/1SDONuIrAHbdDF0YyZ5krmAnibUTJbL9qosEeoDjFRPM/edit#slide=id.p

Coalesce 2023 is coming! Register for free at https://coalesce.getdbt.com/.