Speaker

Daniel Tenedorio

Activities

1

talks

Sr. Staff Software Engineer Databricks

Daniel Tenedorio is a senior staff software engineer at Databricks, working on Spark Core and Spark SQL. He interacts with the Apache Spark™ open-source community to develop and review query processing features. Daniel has a breadth of experience in database systems development from building and launching features underpinning multiple major production services over time.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Data + AI Summit 2025 1 Databricks DATA + AI Summit 2023 1

Talks & appearances

Showing 1 of 2 activities

Search activities →

What’s New in Apache Spark™ 4.0?

2025-06-12 · Data + AI Summit 2025 Watch

talk

with Daniel Tenedorio (Databricks) , Wenchen Fan (Databricks)

AI/ML API Java Python Scala Spark

Join this session for a concise tour of Apache Spark™ 4.0’s most notable enhancements: SQL features: ANSI by default, scripting, SQL pipe syntax, SQL UDF, session variable, view schema evolution, etc. Data type: VARIANT type, string collation Python features: Python data source, plotting API, etc. Streaming improvements: State store data source, state store checkpoint v2, arbitrary state v2, etc. Spark Connect improvements: More API coverage, thin client, unified Scala interface, etc. Infrastructure: Better error message, structured logging, new Java/Scala version support, etc. Whether you’re a seasoned Spark user or new to the ecosystem, this talk will prepare you to leverage Spark 4.0’s latest innovations for modern data and AI pipelines.