talk-data.com talk-data.com

T

Speaker

Thang Long Vu

1

talks

Software Engineer Databricks

Long is a Software Engineer at Databricks, based in the Amsterdam office. Long works in Delta, lately Long has been working on Dynamic Insert Overwrite. In the past, Long worked on performance optimizations projects, and also projects on the open-source Delta Lake repository such as Delta Connect, that came out in Delta 4.0.

Bio from: Data + AI Summit 2025

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →
Selectively Overwrite Data With Delta Lake’s Dynamic Insert Overwrite

Dynamic Insert Overwrite is an important Delta Lake feature that allows fine-grained updates by selectively overwriting specific rows, eliminating the need for full-table rewrites. For examples, this capability is essential for: DBT-Databricks' incremental models/workloads, enabling efficient data transformations by processing only new or updated records ETL Slowly Changing Dimension (SCD) Type 2 In this lightning talk, we will: Introduce Dynamic Insert Overwrite: Understand its functionality and how it works Explore key use cases: Learn how it optimizes performance and reduces costs Share best practices: Discover practical tips for leveraging this feature on Databricks, including on the cutting-edge Serverless SQL Warehouses