talk-data.com talk-data.com

Big Data LDN/Paris Face To Face 2024-09-18 at 16:00

Built to Fail: Design Patterns for Resilient Data Pipelines

Topics

Description

Data is an open environment, and even the best code will break regularly due to upstream schema changes, flaky APIs, and poorly structured data. By embracing the reality of failure as a given, we can proactively architect our systems to minimize the impact of disruptions and ensure the continuity of our data operations. Attendees will learn practical techniques for anticipating specific failure modes and building resilient systems that can recover while minimizing the cost of problems.