talk-data.com
Big Data LDN/Paris
Face To Face
2025-09-25 at 12:40
Data Lineage in the Era of AI: Solving One of Tech’s Biggest Challenges
Event:
Big Data LDN 2025
Topics
Description
Modern enterprises can’t manage data they don’t understand – uncovering the code-to-data relationship is the missing link. As data ecosystems grow more complex, traditional approaches to tracking data lineage can’t keep up. This talk explores how AI-driven code analysis can automatically build end-to-end lineage graphs, giving engineers clear visibility into hidden dependencies across large, legacy, and regulated systems. We’ll show how AI enhances data catalogues and introduce Gable - a tool that helps teams map, validate, and monitor data flows at scale. A live demo on a large energy data codebase will highlight how AI transforms lineage tracking from a manual headache into an automated, scalable solution.