In this talk, I'll cover the challenges of productionizing RAG in big tech vs startup: Latency/Throughput; Achieving High-Precision; Responsible AI; Grounding; Inferencing Cost