talk-data.com talk-data.com

Topic

Databricks

big_data analytics spark

509

tagged

Activity Trend

515 peak/qtr
2020-Q1 2026-Q1

Activities

Showing filtered results

Filtering by: Data + AI Summit 2025 ×
Managing the Governed Cloud

As organizations increasingly adopt Databricks as a unified platform for analytics and AI, ensuring robust data governance becomes critical for compliance, security, and operational efficiency. This presentation will explore the end-to-end framework for governing the Databricks cloud, covering key use cases, foundational governance principles, and scalable automation strategies. We will discuss best practices for metadata, data access, catalog, classification, quality, and lineage, while leveraging automation to streamline enforcement. Attendees will gain insights into best practices and real-world approaches to building a governed data cloud that balances innovation with control.

Real-Time Mode Technical Deep Dive: How We Built Sub-300 Millisecond Streaming Into Apache Spark™

Real-time mode is a new low-latency execution mode for Apache Spark™ Structured Streaming. It can consistently provide p99 latencies less than 300 milliseconds for a broad set of stateless and stateful streaming queries. Our talk focuses on the technical aspects of making this possible in Spark. We’ll dive into the core architecture that enables these dramatic latency improvements, including a concurrent stage scheduler and a non-blocking shuffle. We’ll explore how we maintained Spark’s fault-tolerance guarantees, and we’ll also share specific optimizations we made to our streaming SQL operators. These architectural improvements have already enabled Databricks customers to build workloads with latencies up to 10x lower than before. Early adopters in our Private Preview have successfully implemented real-time enrichment pipelines and feature engineering for machine learning — use cases that were previously impossible at these latencies.

Revolutionizing Nuclear AI With HiVE and Bertha on Databricks Architecture

In this session we will explore the revolutionary advancements in nuclear AI capabilities with HiVE and Bertha on Databricks architecture. HiVE, developed by Westinghouse, leverages over a century of proprietary data to deliver unparalleled AI capabilities. At its core is Bertha, a generative AI model designed to tackle the unique challenges of the nuclear industry. This session will delve into the technical architecture of HiVE and Bertha, showcasing how Databricks' scalable environment enhances their performance. We will discuss the secure data infrastructure supporting HiVE, ensuring data integrity and compliance. Real-world applications and use cases will demonstrate the impact of HiVE and Bertha on improving efficiency, innovation and safety in nuclear operations. Discover how the fusion of HiVE and Bertha with Databricks architecture is transforming the nuclear AI landscape and driving the future of nuclear technology.

Serverless Compute for Notebooks, Jobs and Lakeflow Declarative Pipelines

Discover how Databricks serverless compute revolutionizes data workflows by eliminating infrastructure management, enabling rapid scaling and optimizing costs for Notebooks, Jobs and Lakeflow Declarative Pipelines. This session will delve into the serverless architecture, highlighting its ability to dynamically allocate resources, reduce idle costs and simplify development cycles. Learn about recent advancements, including cost savings and practical strategies for migration and optimization. Tailored for Data Engineers and Architects, this talk will also explore use cases, features, limitations and future roadmap, empowering you to make informed infrastructure decisions while unlocking the full potential of Databricks’ serverless capabilities.

Shifting Left — Setting up Your GenAI Ecosystem to Work for Business Analysts

At Data and AI in 2022, Databricks pioneered the term to shift left in how AI workloads would enable less data science driven people to create their own apps. In 2025, we take a look at how Experian is doing on that journey. This session highlights Databricks services that assist with the shift left paradigm for Generative AI, including how AI/BI Genie helps with Generative analytics, and how Agent Studio helps with synthetic generation of test cases to validate model performance.

Understanding customer engagement and retention isn’t optional—it’s mission-critical. Join us for a live demo to see how you can build a scalable, governed customer health scoring model by transforming raw signals into actionable insights. Discover how Coalesce’s low-code development platform works seamlessly with Databricks’ lakehouse architecture to unify and operationalize customer data at scale. With built-in governance, automation, and metadata intelligence, you’ll deliver trusted scores that support proactive decision-making across the business. Why Attend? Accelerate time-to-insight with automated, low-code transformations Build repeatable, enterprise-grade scoring models with full data lineage Ensure governance, transparency, and compliance at every step

Sponsored by: ThoughtSpot | How Chevron Fuels Cloud Data Modernization

Learn how Chevron transitioned their central finance and procurement analytics into the cloud using Databricks and ThoughtSpot’s Agentic Analytics Platform. Explore how Chevron leverages ThoughtSpot to unlock actionable insights, enhance their semantic layer with user-driven understanding, and ultimately drive more impactful strategies for customer engagement and business growth. In this session, Chevron explains the dos, don’ts, and best practices of migrating from outdated legacy business intelligence to real time, AI-powered insights.

Streaming Meets Governance: Building AI-Ready Tables With Confluent Tableflow and Unity Catalog

Learn how Databricks and Confluent are simplifying the path from real-time data to governed, analytics- and AI-ready tables. This session will cover how Confluent Tableflow automatically materializes Kafka topics into Delta tables and registers them with Unity Catalog — eliminating the need for custom streaming pipelines. We’ll walk through how this integration helps data engineers reduce ingestion complexity, enforce data governance and make real-time data immediately usable for analytics and AI.

Curious to know how Adidas is transforming customer experience and business impact with agentic workflows, powered by Databricks? By leveraging cutting-edge tools like MosaicML’s deployment capabilities, Mosaic AI Gateway, and MLflow, Adidas built a scalable GenAI agentic infrastructure that delivers actionable insights from growing 2 million product reviews annually. With remarkable results: 60% latency reduction (15.5 seconds to 6 seconds) 91.67% cost savings (transitioning to more efficient LLMs) 98.5% token efficiency, reducing input tokens from 200k to just 3k 20% increase in productivity (faster time to insight) Empowering over 500 decision-makers across 150+ countries, this infrastructure is set to optimize products and services for Adidas’ 500 million members by 2025 while supporting dozens of upcoming AI-driven solutions. Join us to explore how Adidas turned agentic workflows infra into a strategic advantage using Databricks and learn how you can do the same!

Unified Advanced Analytics: Integrating Power BI and Databricks Genie for Real-time Insights

In today’s data-driven landscape, business users expect seamless, interactive analytics without having to switch between different environments. This presentation explores our web application that unifies a Power BI dashboard with Databricks Genie, allowing users to query and visualize insights from the same dataset within a single, cohesive interface. We will compare two integration strategies: one that leverages a traditional webpage enhanced by an Azure bot to incorporate Genie’s capabilities, and another that utilizes Databricks Apps to deliver a smoother, native experience. We use the Genie API to build this solution. Attendees will learn the architecture behind these solutions, key design considerations and challenges encountered during implementation. Join us to see live demos of both approaches, and discover best practices for delivering an all-in-one, interactive analytics experience.

Data Intelligence for Cybersecurity Forum: Insights From SAP, Anvilogic, Capital One, and Wiz

Join cybersecurity leaders from SAP, Anvilogic, Capital One, Wiz, and Databricks to explore how modern data intelligence is transforming security operations. Discover how SAP adopted a modular, AI-powered detection engineering lifecycle using Anvilogic on Databricks. Learn how Capital One built a detection and correlation engine leveraging Delta Lake, Apache Spark Streaming, and Databricks to process millions of cybersecurity events per second. Finally, see how Wiz and Databricks’ partnership enhances cloud security with seamless threat visibility. Through expert insights and live demos, gain strategies to build scalable, efficient cybersecurity powered by data and AI.

Financial Services Industry Forum: Shifting to Financial Intelligence | Sponsored by: Deloitte and AWS

Overflow Available First come, first serve. No reservation required. Where: Moscone South, Level 3, Room 302 Join the 60-minute kickoff session at the Financial Services Forum to explore how data and AI transform finance. Featuring keynotes from top innovators in banking, capital markets, and insurance and exciting announcements from Databricks, this event offers invaluable insights. What to expect: Business imperatives: Learn how institutions drive growth, reduce risk and boost efficiency with data intelligence Transformative vision: See how Databricks enhances fraud prevention, automates processes and personalizes experiences Cutting-edge insights: Discover the latest trends in data-driven finance Customer success stories: Hear how global leaders leverage data and AI for a competitive edge Connect with C-suite executives and industry pioneers shaping financial services. Leave with actionable strategies to drive growth, ensure compliance and transform your organization through intelligence-driven decisions!

Games Industry Forum: The Games Executive Perspective on the Impact of Data and AI | Sponsored by: Sigma and AWS

Come hear from some of the biggest names in games about how Data and AI is helping them shape their future, build better games and create player-centric experiences. In this session you’ll hear, first, what Databricks is hearing from Games studios globally as their key priorities. We then shift to customers sharing their stories and perspectives. Dennis Ceccarelli from 2K Games sharing how his passion for building immersive, player-first experiences, has helped him shape the future of sports entertainment in the interactive space. You’ll leave invigorated on the impact Data and AI can have on games, and our global players and have new ideas on ways you can further your impact.

Healthcare and Life Sciences Industry Forum | Sponsored by: Accenture

Join us for an engaging 60-minute Healthcare and Life Sciences Industry Forum at the year’s premier Databricks event! You’ll hear directly from Databricks experts and industry leaders about how unifying data, governing AI models and empowering teams with data intelligence can drive meaningful change across the healthcare and life sciences continuum. Discover how data and AI are transforming the industry — helping streamline healthcare operations, personalize patient care and accelerate breakthroughs in research and development. Don’t miss this opportunity to learn about the future of data-driven healthcare.

Manufacturing and Transportation Industry Forum | Sponsored by: Deloitte and AWS
talk
by Victor Dsouza (Applied Materials) , Richard Masters (Virgin Atlantic Airways) , Andy Isenman (Heathrow) , Dr. Andrej Levin (Boston Consulting Group) , Shiv Trisal (Databricks) , Caitlin Gordon (Databricks)

Join us for an inspiring forum showcasing how manufacturers and transportation leaders are turning today's challenges into tomorrow's opportunities. From automotive giants revolutionizing product development with generative AI to logistics providers optimizing routes for both cost and sustainability, discover how industry pioneers are reshaping the future of industrial operations. Highlighting this session is an exciting collaboration between Heathrow Airport and Virgin Atlantic, demonstrating how partnership and innovation are transforming the air travel experience. Learn how these leaders and other companies are using Databricks to tackle their most pressing challenges — from smart factory transformations to autonomous systems development — proving that the path to profitability and sustainability runs through intelligent operations.

Media and Advertising Industry Forum | Sponsored by: Sigma and AWS
talk
by Kevin Hill (NBCU Data & Analytics) , Noah Levine (Databricks) , Bala Rajagopal (Integral Ad Science) , Philip Martin (Fox Corporation) , leah van zelm (NBCUniversal Media LLC) , Kate Sirkin (Epsilon) , Jen Faraci (Digitas) , Anthony LaVasseur (Databricks) , Kyle Hollaway (Acxiom)

Join us at the Media & Advertising Forum to explore how data and AI are transforming media and advertising from content to creative and identity to outcomes. Featuring innovators from leading agencies, platforms, streamers and ad tech — plus exciting announcements from Databricks — this session delivers must-have insights for industry leaders and change agents. What to expect: Business imperatives: Learn how media and advertising organizations navigate and grow through secular change leveraging Data + AI. Databricks leaders and customers will share how data intelligence is powering the next wave of innovation Future trends in Media & Advertising: Learn how data + AI will continue to shape the future of monetization, real-time personalization and intelligent storytelling Customer success stories: Discover how top media and advertising companies are using data intelligence to unlock new creative potential, increase agility and grow revenue

Public Sector Industry Forum | Sponsored by: Deloitte and AWS

Join the 60-minute kickoff session at the Public Sector Forum for an opportunity to to accelerate innovation into your enterprise through governance, compliance and GenAI. Featuring keynotes from data-driven agency leaders and providing a future-looking journey from Databricks, this event offers invaluable insights. Understand the outcomes of Data and AI powering transformation across common areas of government and beyond: Improving constituent experience Reducing cost and enhancing services Identifying fraud, waste and abuse Achieving scale and security You will not want to miss this exclusive opportunity to own your data and eliminate government silos. Discover the Data + AI Company with deep compliance experience and widespread adoption.

​​Retail & Consumer Goods Industry Forum: How AI is Transforming How Brands Connect With Consumers | Sponsored by: Accenture & AWS

Consumer industries are being transformed by AI as physical and digital experiences converge. In this flagship session for retail, travel, restaurants and consumer goods attendees at Data + AI Summit, Databricks and a panel of industry leaders will explore how real-time data and machine learning are enabling brands to gain deeper consumer insights, personalize interactions and move closer to true 1:1 marketing. From AI agents shopping on behalf of consumers to consumer-centric supply chains, discover how the most innovative companies will use AI to reshape customer relationships and drive growth in an increasingly connected world.

Telecommunications Industry Forum: The Intelligent Telecom: Efficiency, Revenue Growth, Impact | Sponsored by: Tredence

Introducing the First-Ever Telecom Industry Forum at DAIS 2025 For the first time ever, Data + AI Summit (DAIS) will feature a dedicated Telecom Industry Forum — your exclusive opportunity to connect with telecom peers, exchange ideas, and hear directly from visionary leaders who are redefining the future of communications with data and AI. This forum will showcase how telecom operators are using the Databricks Data Intelligence Platform to deliver measurable results — from optimizing operations and enhancing customer experience to enabling new revenue models — all while maintaining the interoperability and agility needed to thrive in an evolving landscape. Join us on Tuesday, June 10 at 4:00 PM for a compelling lineup of speakers: Matt Dugan, VP, Data Platforms, AT&T, will share how AT&T is reducing operational costs and improving productivity with a data-first strategy that continues to evolve. Jesse Ross, VP, Information Technology, Frontier Communications, will discuss how Frontier is unlocking new revenue and enhancing CX through a modern, AI-powered data platform. Dayle Stevens and Arnab Chakraborty will present the bold AI transformation journey of Telstra and Accenture, detailing how their joint venture is driving process reinvention and deploying agentic AI at scale. Guy Lupo, TM Forum, will outline a forward-looking blueprint for telco data and AI transformation — and share how TM Forum is collaborating with Databricks to future-proof the industry. This is a rare opportunity to hear from the leaders at the forefront of telecom innovation. Be inspired, connect with global industry peers, and take away actionable insights to lead your organization's next wave of transformation. The future of telecom is being built now — with Databricks and TM Forum at the center of it.

FinOps: Automated Unity Catalog Cost Observability, Data Isolation and Governance Framework

Westat, a leader in data-driven research for 60 years+, has implemented a centralized Databricks platform to support hundreds of research projects for government, foundations, and private clients. This initiative modernizes Westat’s technical infrastructure while maintaining rigorous statistical standards and streamlining data science. The platform enables isolated project environments with strict data boundaries, centralized oversight, and regulatory compliance. It allows project-specific customization of compute and analytics, and delivers scalable computing for complex analyses. Key features include config-driven Infrastructure as Code (IaC) with Terragrunt, custom tagging and AWS cost integration for ROI tracking, budget policies with alerts for proactive cost management, and a centralized dashboard with row-level security for self-service cost analytics. This unified approach provides full financial visibility and governance while empowering data teams to deliver value. Audio for this session is delivered in the conference mobile app, you must bring your own headphones to listen.