Session on building an open lakehouse using Apache Spark and Apache Iceberg.

There are a lot of amazing AI features being announced at Google Cloud Next. In order to take full advantage of these, you need to make sure your data is being managed in a secure, centralized way. In this talk, you’ll learn how to set up your lakehouse to get your data ready for downstream workloads. You’ll view a demo involving an architecture of Google Cloud products that includes managing permissions on your data, configuring metadata management, and performing transformations using open source frameworks.

This session will detail the process of architecting enterprise-grade big data pipelines, encompassing the orchestration of Ephemeral Dataproc clusters, customization through custom images and the strategic incorporation of GPU resources. Real-world use cases, best practices, challenges, and future trends in this domain will also be discussed, providing actionable insights for implementing cutting-edge big data solutions.

Click the blue “Learn more” button above to tap into special offers designed to help you implement what you are learning at Google Cloud Next 25.

There are a lot of amazing AI features being announced at Google Cloud Next. In order to take full advantage of these, you need to make sure your data is being managed in a secure, centralized way. In this talk, you’ll learn how to set up your lakehouse to get your data ready for downstream workloads. You’ll view a demo involving an architecture of Google Cloud products that includes managing permissions on your data, configuring metadata management, and performing transformations using open source frameworks.