A generative AI gateway is a design pattern popular in enterprise settings which establishes a central gateway where developers can access foundation models from multiple providers. It includes features for access control, quota management, cost control, governance, and observability. This session will dive deep on a recommended architecture for building an AI gateway on AWS and provide a demo of the final result.