For our October meetup we are excited to welcome Francesco Pizzolon who will be presenting:

The Lakehouse and The Medallion Architecture

This session is focused on Data Engineering and the evolution of the different architecture paradigms over the course of the last decades. We’ll talk about:

• The evolution of the Data Warehouse to Data Lake and to Data Lakehouse.
• The Medallion Architecture.
• The most important Data Engineering principles to adopt in your Data Platform, e.g.:
• Data Validation
• Data Pipeline Dependencies
• Referential Integrity

About Francesco

Francesco is a gifted Solutions Architect with an extensive experience in liaising with C-level business executives in the energy, retail, transportation, banking, and public sector industry verticals. With a decade of experience in Data Engineering, Francesco is passionate about architecting, delivering, and supporting Data Platform projects that deliver true business value to his clients.

OPEN DATA CHALLENGE: Before our main session we are bringing back the Open Data Challenge. Your opportunity to showcase your talent to the audience. This month's challenge is Road Safety Data from Transport for London.

https://www.data.gov.uk/dataset/cb7ae6f0-4be6-4935-9277-47e5ce24a11f/road-safety-data

You'll have the opportunity to present a short (max 5 minute) presentation to show road report and and other aspects of Microsoft Fabric used in creating your solution.

VENUE: We will meet at the Nigel Frank Offices at 60 Great Tower Street. If you've not been there before, it's just a little further up the street from Brewdog. Google Maps link to help you find the building: https://goo.gl/maps/GRZWr5LfScZhApu6A

Data Mesh is an emerging architecture pattern that challenges the centralized data platform approach by empowering different engineering teams to own the data products in a specific business domain. One of the keys to the success of any Data Mesh initiative is selecting the right protocol for Data Sharing between different business data domains that could potentially be implemented through different technologies and cloud providers.

In this session you will learn about how the Delta Sharing protocol and the Delta table format have enabled the historically stuck-in-the-past energy and construction industry to be catapulted to the 21st century by way of a modern Data Mesh implementation based on Azure Databricks.

Talk by: Francesco Pizzolon

Here’s more to explore: A New Approach to Data Sharing: https://dbricks.co/44eUnT1

Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc