An "eval," short for evaluation, is a set of structured tests or benchmarks used to systematically assess the performance and quality of an AI model or a program. Creating evals is a foundational practice when building solutions with AI. In this talk Amy Heineike will provide an introduction to evals: What are they? Why do you need them? And how do you get started?