talk-data.com talk-data.com

Event

Evaluating your RAG Chat App

2024-09-12 โ€“ 2024-09-12 Meetup Visit website โ†—

Activities tracked

0

RAG (Retrieval Augmented Generation) is the most popular approach used to get LLMs to answer user questions grounded in a domain. How can you be sure that the answers are accurate, clear, and well formatted? Evaluation! In this session, we'll show you how to use Azure AI Studio and the Promptflow SDK to generate synthetic data and run bulk evaluations on your RAG app. Learn about different GPT metrics like groundedness and fluency, and consider other ways you can measure the quality of your RAG app answers.

Presented by Nitya Narasimhan, AI Advocate, and Pamela Fox, Python Advocate

** Part of RAGHack, a free global hackathon to develop RAG applications. Join at https://aka.ms/raghack **

**๐Ÿ“Œ Check out the RAGHack 2024 series here! **

Pre-requisites: - Read the official rules and join the hack at https://aka.ms/raghack. No Purchase Necessary. Must be 18+ to enter. Contest ends 9/16/24.

Sessions & talks

Showing 1โ€“0 of 0 ยท Newest first

Search within this event →

No individual activities are attached to this event yet.