First Steps: Open Lakehouse & Iceberg Files

Explores Microsoft’s Applied Skills credential program and the learning path for implementing a data science and ML solution with Microsoft Fabric, including setting up a Microsoft Learn profile, locating credential offerings, and following the guided scenario using Fabric’s Lakehouse, Notebooks, and MLflow integration. Linda Larkan will provide demonstrations highlighting the workflow from data ingestion to model training and prediction.

The next generation of streaming isn't about faster pipelines, but about smarter connections. DeltaJoin, a new operator in Apache Flink, reimagines stream joins by moving from brute-force state to change-driven computation. Paired with Fluss, Flink's purpose-built storage layer, it enables systems that are real-time, scalable, and cost-efficient. Anton will show how DeltaJoin and Fluss shift streaming architecture from ephemeral flows to durable, queryable state that bridges real-time processing with lakehouse patterns. Drawing on production experience, he'll demonstrate how these innovations reduce join costs, simplify architectures, and unlock new possibilities for real-time analytics. Attendees will leave with a vision of Flink 2.x as the backbone for event-driven systems and modern data platforms.

Fabric también es ideal para pequeñas empresas. En Casa Vicens Gaudí, Esbrina extrajo todas las reservas al Lakehouse y construyó un modelo semántico en modo importación. Como era la única carga de trabajo, se usó una logic app en Azure para activar y desactivar la capacidad, optimizando así los costes.

Live demo to use Data Factory in Microsoft Fabric to build a Power BI report, starting with a Dataflow Gen2 in a Lakehouse, orchestrating its refresh schedule with a Data Pipeline and using Tabular Editor to build the report. Date: 2024-04-24. Starts at 7 PM CET via MS Teams.

At Databricks, we see organizations looking to leverage the power of AI, not only to deliver intelligent solutions, but to also have intelligent user interfaces. Join us as we delve into how lakehouse architecture forms the backbone of intelligent data platforms, integrating AI to enhance user interaction and self-management. Discover how this evolution is democratizing data and AI access for all data workers in modern organizations, paving the way for the next generation of data and AI enabled solutions.