talk-data.com talk-data.com

PyData talk 2025-06-07 at 10:05

AI agents testing: How to evaluate the unpredictable

Speakers

Description

AI agents and multi-step workflows are powerful, but testing them can be tricky. This talk explores practical ways to test these complex systems — like running multi-step simulations, checking tool calls, and using LLMs for evaluation. You'll also learn how to prioritize what to test and set up session-level evaluations with open-source tools.