talk-data.com talk-data.com

Event

The Non-Determinism of Small LLMs

2025-11-06 – 2025-11-06 Meetup Visit website ↗

Activities tracked

0

We don’t slow down after our October meetup - the next PyData Yerevan meetup is already on the way.

This time, we’ll host Claudio Pinhanez, Principal Research Scientist at IBM, who will discuss:

🔷 “The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks.”

The talk will dive into how small language models (2B–8B) perform when asked the same questions multiple times, exploring what their answer consistency reveals about accuracy and reliability.

📅 Date: Thursday, November 6 🕖 Time: 7:00 PM 📍 Venue: 213W, PAB, American University of Armenia 🔗 Register here: https://forms.gle/bCAxuD3XjQ98Rztc9

Don’t miss this chance to hear from an IBM researcher and discuss the latest findings on LLM behavior.

pydatayerevan #AI #machinelearning #LLMs #AUA #ASCE #datascience

Sessions & talks

Showing 1–0 of 0 · Newest first

Search within this event →

No individual activities are attached to this event yet.