talk-data.com talk-data.com

Google Cloud Next session 2025-04-11 at 18:00

Deploy AlloyDB Omni on Kubernetes next to local AI models

Description

There are cases when you can’t use Google Cloud services but still want to get all benefits of AlloyDB integration with AI and serve a local model directly to the database. In such cases, AlloyDB Omni deployed in a Kubernetes cluster can be great solution, serving for edge cases and keeping all communications between database and AI model local.