talk-data.com talk-data.com

Meetup talk 2025-10-01 at 22:00

Persona Based Evaluation of Search Systems

Event: NYC Python x PyData NYC: 🗲 Talk Night at Datadog! 🗲

Topics

LLM dynamic user modeling multi-modality testing automated test generation search evaluation

Description

Talk on a dynamic, automated approach to search evaluation using user-modeling inspired by the 'LLM as a judge' paradigm to generate realistic query-result pairs and evaluate multi-modality search.