talk-data.com talk-data.com

Databricks Summit talk 2025-06-10 at 16:10

Let the LLM Write the Prompts: An Intro to DSPy in Compound AI Pipelines

Description

Large Language Models (LLMs) excel at understanding messy, real-world data, but integrating them into production systems remains challenging. Prompts can be unruly to write, vary by model and can be difficult to manage in the large context of a pipeline. In this session, we'll demonstrate incorporating LLMs into a geospatial conflation pipeline, using DSPy. We'll discuss how DSPy works under the covers and highlight the benefits it provides pipeline creators and managers.