In the next five years, we are poised to witness a significant transformation towards modern data lake architecture across industries. This shift is driven by an urgent need for a unified, flexible, and scalable data management solution. Such a solution must address the challenges of siloed data environments and the increasing complexity of data sources while balancing the benefits of data mesh principles with centralized governance and semantic consistency.

In this talk, we will cover latest trends and benefits in this field, as well as usage of open formats like Iceberg, lower costs of data movement, & multiple engines to support different workloads that ultimately helps in getting into a single source of truth.

Snowplow has been a leader in developing first-class support for data lakes and modern day open table formats. In this talk, Jordan will discuss the most popular data lake formats, why they have grown in popularity in the last 12-18 months, and best practices when deciding to adopt open lake formats. 

Like many large businesses Maersk relies on a centrally managed Data Lake to deliver customer insights and business reports. But in today's fast-paced business environment, timely and accurate decision-making relies heavily on the ability to access and analyse data at will. Opening up your Data Lake and allowing business users the ability to query the data directly, could bring major benefits; but also brings with it technical and security challenges. 

Join Graham and Julian as they explore how Maersk has used Dremio software to deliver Self Service Analytics and their checklist of the essential ‘must have’ technical capabilities.