talk-data.com
Event
Building Frameworks for Evaluation of LLM Output at Grammarly
Activities tracked
3
We are thrilled to host and launch this event in cooperation with the Roosh Circle community.💥 ✅ Registration: to attend the meetup, please RSVP on the Roosh Circle Meetup page ➡️ here ⬅️
💥 Agenda: 17:45 Doors open: Time for mingling and networking with fellows; snacks and drinks will be served 18:30 Opening notes 18:40 Talk "Building Frameworks for Evaluation of LLM Output at Grammarly" by Lena Nahorna, Analytical Linguist at Grammarly 19:10 Talk "Data Engineering Workflow Before, After, and For LLMs" by Halyna Oliinyk, Senior Data Engineer at Delivery Hero 19:40 Short break; drinks will be served 19:50 Talk "Cypher Query Building with Open-Source LLMs" by Djordje Benn-Maksimovic, Senior Data Scientist at Eviden 20:20 Time for mingling and networking with fellows; snacks and drinks will be served 21:30 Meetup ends
💥 Building Frameworks for Evaluation of LLM Output at Grammarly 🔈 Lena Nahorna—analytical linguist at Grammarly 🚀 LLMs have opened up new avenues in NLP with their possible applications, but evaluating their output introduces a new set of challenges. In this talk, we discuss how the evaluation of LLMs differs from the evaluation of classic ML-based solutions and how we tackle the challenges.
✅ Where: In-person, Grammarly Berlin hub ✅ When: Thursday, September 5 ✅ Language: English ✅ Registration: to attend the meetup, please RSVP on the Roosh Circle Meetup page ➡️ here ⬅️
Sessions & talks
Showing 1–3 of 3 · Newest first
Data Engineering Workflow Before, After, and For LLMs
Building Frameworks for Evaluation of LLM Output at Grammarly
LLMs have opened up new avenues in NLP with their possible applications, but evaluating their output introduces a new set of challenges. In this talk, we discuss how the evaluation of LLMs differs from the evaluation of classic ML-based solutions and how we tackle the challenges.