talk-data.com talk-data.com

D

Speaker

Dima Kamalov

1

talks

Software Engineer Asana

Dima has worked on data infrastructure at Asana for six years. Prior to this, they worked on data infrastructure at Thumbtack. Their most recent work involves data synchronization from graph-shaped transactional databases to a Databricks-powered data lake

Bio from: Data + AI Summit 2025

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →
Reducing Transaction Conflicts in Databricks—Fundamentals and Applications at Asana

When using ACID-guaranteed transactions on Databricks concurrently, we can run into transaction conflicts. This talk discusses the basics of concurrent transaction functionality in Databricks—what happens when various combinations of INSERT, UPDATE and MERGE INTO happen concurrently. We discuss how table isolation level, partitioning and deletion vectors affect this. We also mention how Asana used an intermediate blind append stage to support several hundred concurrent transaction updates into the same table.