Lakeflow Declarative Pipelines simplifies pipeline development and management — but how do you optimize for performance and cost? In this session, we’ll explore practical strategies for tuning Lakeflow Declarative Pipelines, including when and how to use autoscaling, Photon and different node types. We'll also cover how to monitor resource usage and decide when serverless is the right choice. You'll learn best practices drawn from real-world customer implementations, along with an overview of the latest performance enhancements available in serverless Lakeflow Declarative Pipelines.
talk-data.com
S
Speaker
Steven Yu
1
talks
Principal Solutions Architect
Databricks
Steven is a Principal Solutions Architect at Databricks with a background in Data Warehousing, Data Engineering, Streaming, and Performance Tuning with over 20+ years of industry experience.
Bio from: Data + AI Summit 2025
Filter by Event / Source
Talks & appearances
1 activities · Newest first