talk-data.com
Event
A Practical Framework for Measuring Success for Enterprise-Scale LLM Solutions
Activities tracked
0
❄️ DSF WinterFest 2025: Global Online Summit ❄️
Join the global data celebration!
Monday 24th to Friday 28th November 2025 Online \| 2-3 sessions per day \| Theme: Innovating with Data
DSF WinterFest is back, and this year, it’s going global! Join our 50,000-strong community for a week of world-class talks, tutorials, and panels exploring how data, AI, and analytics are reshaping the world. Expect inspiring content, expert insights, and the cosy, welcoming DSF atmosphere we are known for, all from the comfort of your own space!
Why join? 🌍 A global stage with speakers and attendees from every corner of the world 🎟️ One ticket for the full week. Register once and access every session 💻 Easy access from anywhere. Join live or catch replays in your own time ☕ Cosy community vibe. No travel, no stress, just data and connection
🎟️ Tickets:
Choose your experience and secure your spot today: Free Pass - Watch live and enjoy replays until 30 November 2025 Upgrade at Checkout - Get extended replay access until May 2026
Register on our website to receive your joining links, add sessions to your calendar, and tune in live from anywhere in the world.
Please note: Clicking “Attend” on Meetup does not register you for this summit. You must register via our website to receive your links.
🎁 Competition:
We’re spreading festive cheer! One lucky attendee will win a £300 Amazon gift voucher (or equivalent in your currency). Find out more here.
❄️❄️❄️
Session details:
💡 Beyond Benchmarks: A Practical Framework for Measuring Success for Enterprise-Scale LLM Solutions 🗓️ Thursday 27th November ⏰ 12:30 PM GMT 🗣️ Li Fu, Data & AI Scientist
Most organisations today can build a prototype with an LLM — but far fewer know how to measure whether it’s actually working. In enterprise settings, where reliability, safety, and business value matter as much as creativity, having the right evaluation framework is the difference between a successful GenAI rollout and an expensive experiment.
This session introduces a comprehensive performance and utility suite designed specifically for evaluating generative AI systems like Retrieval-Augmented Generation (RAG) pipelines and agentic workflows. We’ll walk through a four-dimension framework that goes beyond model accuracy:
RAG Metrics: Precision, recall, grounding, and relevance of retrieved information.
Summarisation Metrics: Faithfulness, coherence, and compression quality of generated summaries.
Prompt Metrics: Effectiveness, robustness, and generalisability of LLM instruction design.
Ethics Metrics: Fairness, safety, factual integrity, and risk-based compliance checks.
Attendees will also learn how to connect these technical metrics to real-world outcomes, including user trust, operational efficiency, regulatory readiness, and ROI. Drawing on lessons from deploying GenAI in highly regulated enterprise environments, we’ll explore how to build automated evaluation pipelines, integrate human-in-the-loop feedback, and continuously improve performance post-deployment. We'll also talk about how enterprises balance technical metrics with business KPIs when deciding if a GenAI system is production-ready.
By the end, you’ll walk away with an actionable evaluation playbook that transforms GenAI from a promising prototype into a measurable, trustworthy, and business-critical system.
❄️❄️❄️
🔗 How to join:
Once registered, you’ll receive your unique joining link by email, plus handy reminders one week, one day, and one hour before each session. Don't forget to add the sessions you are attending to your calendar. If you can’t make it live, don’t worry, your ticket includes replay access until 30 November 2025 (or May 2026 with the upgrade).
📘 Reminders:
Time zones: All sessions are listed in GMT - please check your local time when registering.
Recordings: Access replays until 30 November 2025 with a free pass, or until May 2026 with an upgraded ticket
Please note: Clicking “Attend” on Meetup does not register you for this summit. You must register via our website to receive your links.
Join the Celebration ❄️ Five days. Global speakers. Cutting-edge insights. Free to join live - replays included. Upgrade for extended access. Register now and be part of the global data community shaping the future. #DSFWinterFest
Sessions & talks
Showing 1–0 of 0 · Newest first
No individual activities are attached to this event yet.