talk-data.com
Databricks Summit
talk
2025-06-10 at 16:10
Let the LLM Write the Prompts: An Intro to DSPy in Compound AI Pipelines
Event:
Data + AI Summit 2025
Description
Large Language Models (LLMs) excel at understanding messy, real-world data, but integrating them into production systems remains challenging. Prompts can be unruly to write, vary by model and can be difficult to manage in the large context of a pipeline. In this session, we'll demonstrate incorporating LLMs into a geospatial conflation pipeline, using DSPy. We'll discuss how DSPy works under the covers and highlight the benefits it provides pipeline creators and managers.