talk-data.com talk-data.com

Google Cloud Next session 2025-04-11 at 19:30

Architectural approaches for RAG infrastructure

Event: Google Cloud Next '25

Speakers

Megan O'Keefe

Head of Cloud Platform Evaluations · Google Cloud

Kumar Dhanagopal

Cross-Product Solutions Developer · Google Cloud

Topics

AI/ML GenAI Kubernetes Cloud Computing GCP RAG

Description

Unlock the power of generative AI with retrieval augmented generation (RAG) on Google Cloud. In this session, we’ll navigate key architectural decisions to deploy and run RAG apps: from model and app hosting to data ingestion and vector store choice. We’ll cover reference architecture options – from an easy-to-deploy approach with Vertex AI RAG Engine, to a fully managed solution on Vertex AI, to a flexible DIY topology with Google Kubernetes Engine and open source tools – and compare trade-offs between operational simplicity and granular control.