talk-data.com talk-data.com

T

Speaker

Tim Bal

1

talks

Senior Consultant delaware

Tim has been a Senior Consultant in delaware's MS Data & AI Team since February 2020. He specializes in Data Engineering, Solutions Architecture, and Data Science, with a focus on building and optimizing efficient data solutions using Databricks. His work ranges from developing greenfield architectures to modernizing legacy systems for enhanced performance and scalability. Tim holds a master’s degree in Theoretical and Experimental Psychology, as well as a second master’s degree in Statistical Data Analysis, and is affiliated with the Royal Belgian Statistical Society. In recognition of his expertise, Tim was awarded Databricks Solutions Architect Champion in April 2023—the highest level of certification in the Databricks Partner Program.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 1 activities

Search activities →
Lakeflow Connect: The Game-Changer for Complex Event-Driven Architectures

In 2020, Delaware implemented a state-of-the-art, event-driven architecture for EFSA, enabling a highly decoupled system landscape, presented at the Data&AI Summit 2021. By centrally brokering events in near real-time, consumer applications react instantly to events from producer applications as they occur. Event producers are decoupled from consumers via a publisher/subscriber mechanism. Over the past years, we noticed some drawbacks. The processing of these custom events, primarily aimed for process integration weren’t covering all edge cases, the data quality was not always optimal due to missing events and we needed to create a complex logic for SCD2 tables. Lakeflow Connect allows us to extract the data directly from the source without the complex architecture in between, avoiding data loss and thus, data quality issues, and with some simple adjustments, an SCD2 table is created automatically. Lakeflow Connect allows us to create more efficient and intelligent data provisioning.