talk-data.com talk-data.com

P

Speaker

Prashant Gupta

1

talks

Software Engineer Databricks

Prashant Gupta is a seasoned engineer with a track record of building high-scale systems across leading tech companies. He currently serves as a Senior Software Engineer at Databricks, where he leads third-party data ingestion within the Data Platform, focusing on scalable no-code SaaS integration with a strong emphasis on security and compliance. Previously at Google, Prashant led data platform in Google Cloud aimed at unifying data sources and enabling petabyte-scale, AI-driven insights. Prashant is passionate about creating resilient systems, streamlining developer experiences, and driving product innovation through data and infrastructure.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 1 activities

Search activities →
Chaos to Clarity: Secure, Scalable, and Governed SaaS Ingestion through Lakeflow Connect and more

Ingesting data from SaaS systems sounds straightforward—until you hit API limits, miss SLAs, or accidentally ingest PII. Sound familiar? In this talk, we’ll share how Databricks evolved from scrappy ingestion scripts to a unified, secure, and scalable ingestion platform. Along the way, we’ll highlight the hard lessons, the surprising pitfalls, and the tools that helped us level up. Whether you’re just starting to wrangle third-party data or looking to scale while handling governance and compliance, this session will help you think beyond pipelines and toward platform thinking.