talk-data.com

Part 3 of a 4-part series

From Streaming Anxiety to Streaming Confidence: Hands-On with Spark Structured Streaming

Description: Working with real-time data is more accessible today than ever before, yet building your first streaming application can still feel daunting. In this session, Scott Haines will demystify streaming data and equip you with practical strategies to develop a streaming-first mindset. You'll learn how to:

* Architect robust streaming data applications from the ground up * Build and test applications using PySpark with confidence * Simplify debugging within the Databricks ecosystem * Deploy, manage, and maintain streaming applications effectively * Apply proven tips and tricks to accelerate your streaming journey

Walk away with the knowledge and tools to confidently tackle real-time data challenges and transform how you approach streaming applications.

Scott Hoyt joins the podcast to provide a look into the holiday retail season and to discuss the state of the U.S. consumer more broadly. The team reviews the downbeat data on consumer confidence, the labor market, inflation and housing, and contemplates the implications for consumer spending this Christmas. The team remembers to take a listener question on income inequality and the mood gets even darker. Happy Thanksgiving everyone! Hosts: Mark Zandi – Chief Economist, Moody’s Analytics, Cris deRitis – Deputy Chief Economist, Moody’s Analytics, and Marisa DiNatale – Senior Director - Head of Global Forecasting, Moody’s Analytics Follow Mark Zandi on 'X' and BlueSky @MarkZandi, Cris deRitis on LinkedIn, and Marisa DiNatale on LinkedIn

Questions or Comments, please email us at [email protected]. We would love to hear from you.    To stay informed and follow the insights of Moody's Analytics economists, visit Economic View.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

In this session, Scott Jehl will share how web components and other complementary standards can help us move beyond the performance bottlenecks of the last decade.

Microsoft speakers Scott, David, and Maddy present the latest .NET 10 features.

Overview of the latest features from the .NET 10 release, with emphasis on cloud-native development, streamlined deployments, and accelerated AI integration.

A talk about managing anxiety, burnout, and career decisions in tech. Kim Scott discusses emotional agility, thought models, and coaching that helped her align with her values, stay calm, and make bold career moves. The session includes a personal journey through data science and related roles, with practical tools to stay focused and authentic.

Overview of the latest features from the .NET 10 release, presented by Scott, David, Maddy and other Microsoft speakers.

Microsoft showcase of the latest features from the .NET 10 release.

Overview of .NET 10 focusing on cloud-native and intelligent app development, productivity enhancements, streamlined deployments, and accelerated AI integration, highlighting features from the release.

Session outlining how .NET 10 elevates cloud-native and intelligent app development, focusing on productivity enhancements, streamlined deployments, and accelerated AI integration, with Microsoft speakers showcasing the latest release features.

While Kafka excels at streaming data, the real challenge lies in making that data analytically useful without sacrificing consistency or performance. This talk explores why Apache Iceberg has emerged as the ideal streaming destination, offering ACID transactions, schema evolution, and time travel capabilities that traditional data lakes can't match. Learn about some foundational tools that enable streaming pipelines and why they all converge on this next-generation table format built for flexibility and scalability.

The next generation of streaming isn't about faster pipelines, but about smarter connections. DeltaJoin, a new operator in Apache Flink, reimagines stream joins by moving from brute-force state to change-driven computation. Paired with Fluss, Flink's purpose-built storage layer, it enables systems that are real-time, scalable, and cost-efficient. Anton will show how DeltaJoin and Fluss shift streaming architecture from ephemeral flows to durable, queryable state that bridges real-time processing with lakehouse patterns. Drawing on production experience, he'll demonstrate how these innovations reduce join costs, simplify architectures, and unlock new possibilities for real-time analytics. Attendees will leave with a vision of Flink 2.x as the backbone for event-driven systems and modern data platforms.

In this session, see how meshIQ, a comprehensive management and observability platform for messaging and event streaming technologies like Kafka, RabbitMQ and IBM MQ, can be used to track application message flows, help identify bottlenecks and locate "missing" messages.