talk-data.com talk-data.com

Meetup talk 2025-07-24 at 16:00

Virtual Agentic AI session

Event: WEBINAR "Developing Agents using MCP Servers with Truefoundry"

Speakers

Abhishek Choudhary

Co-founder and CTO · TrueFoundry

Topics

ai gateways api abstraction in-memory processing asynchronous logging horizontal scaling centralized guardrails semantic caching multi-provider management model context protocol (mcp) integration

Description

Overview of the AI Gateway pattern as a central control plane for enterprise AI ecosystems, including API abstraction, failover, semantic caching, centralized guardrails, and cost controls. Discuss practical architectural patterns for high-availability gateways that handle thousands of concurrent requests with sub-millisecond in-memory decision-making, separation of control and data planes, asynchronous logging, horizontal scaling, and future MCP integration for tool ecosystems and natural language automation across enterprise software.