talk-data.com talk-data.com

Justin Breese

Speaker

Justin Breese

1

talks

Staff Product Manager - serverless jedi Databricks

Justin is a Staff Product Manager at Databricks. He primarily focuses on their serverless products - versionless runtime, dependency management (environments), and containers. When not thinking about execution engines, you can find him staying busy with soccer, hiking, brewing beer, roasting coffee, and older cars. Justin lives in Topanga, CA with his wife, son, and daughter.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 2 activities

Search activities →
Breaking Up With Spark Versions: Client APIs, AI-Powered Automatic Updates, and Dependency Management for Databricks Serverless

This session explains how we've made our Apache Spark™ versionless for end users by introducing a stable client API, environment versioning and automatic remediation. These capabilities have enabled auto-upgrade of hundreds of millions of workloads with minimal disruption for Serverless Notebooks and Jobs. We'll also introduce a new approach to dependency management using environments. Admins will learn how to speed up package installation with Default Base Environments, and users will see how to manage custom environments for their own workloads.