talk-data.com talk-data.com

Event

Building Frameworks for Evaluation of LLM Output at Grammarly

2024-09-05 – 2024-09-05 Meetup Visit website ↗

Activities tracked

3

We are thrilled to host and launch this event in cooperation with the Roosh Circle community.💥 ✅ Registration: to attend the meetup, please RSVP on the Roosh Circle Meetup page ➡️ here ⬅️

💥 Agenda: 17:45 Doors open: Time for mingling and networking with fellows; snacks and drinks will be served 18:30 Opening notes 18:40 Talk "Building Frameworks for Evaluation of LLM Output at Grammarly" by Lena Nahorna, Analytical Linguist at Grammarly 19:10 Talk "Data Engineering Workflow Before, After, and For LLMs" by Halyna Oliinyk, Senior Data Engineer at Delivery Hero 19:40 Short break; drinks will be served 19:50 Talk "Cypher Query Building with Open-Source LLMs" by Djordje Benn-Maksimovic, Senior Data Scientist at Eviden 20:20 Time for mingling and networking with fellows; snacks and drinks will be served 21:30 Meetup ends

💥 Building Frameworks for Evaluation of LLM Output at Grammarly 🔈 Lena Nahorna—analytical linguist at Grammarly 🚀 LLMs have opened up new avenues in NLP with their possible applications, but evaluating their output introduces a new set of challenges. In this talk, we discuss how the evaluation of LLMs differs from the evaluation of classic ML-based solutions and how we tackle the challenges.

✅ Where: In-person, Grammarly Berlin hub ✅ When: Thursday, September 5 ✅ Language: English ✅ Registration: to attend the meetup, please RSVP on the Roosh Circle Meetup page ➡️ here ⬅️

Sessions & talks

Showing 1–3 of 3 · Newest first

Search within this event →

Building Frameworks for Evaluation of LLM Output at Grammarly

2024-09-05
talk
Lena Nahorna (Grammarly)

LLMs have opened up new avenues in NLP with their possible applications, but evaluating their output introduces a new set of challenges. In this talk, we discuss how the evaluation of LLMs differs from the evaluation of classic ML-based solutions and how we tackle the challenges.