talk-data.com talk-data.com

S

Speaker

Steven Yu

1

talks

Principal Solutions Architect Databricks

Steven is a Principal Solutions Architect at Databricks with a background in Data Warehousing, Data Engineering, Streaming, and Performance Tuning with over 20+ years of industry experience.

Bio from: Data + AI Summit 2025

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →

Lakeflow Declarative Pipelines simplifies pipeline development and management — but how do you optimize for performance and cost? In this session, we’ll explore practical strategies for tuning Lakeflow Declarative Pipelines, including when and how to use autoscaling, Photon and different node types. We'll also cover how to monitor resource usage and decide when serverless is the right choice. You'll learn best practices drawn from real-world customer implementations, along with an overview of the latest performance enhancements available in serverless Lakeflow Declarative Pipelines.