talk-data.com talk-data.com

G

Speaker

Giancarlo Costa

1

talks

Cloud Solutions Architect European Food Safety Authority

Giancarlo joined EFSA in 2006 where he is part of the Architecture & Solutions team. As Cloud Solutions Architect, he oversees the architectural evolution across multiple key projects. He recently had a leading role in the democratization of data and analytics at EFSA, contributing to the development of the EFSA Data Mesh Architecture and Decentralized Cloud Governance.

Bio from: Data + AI Summit 2025

Filtering by: Data + AI Summit 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 1 activities

Search activities →
Lakeflow Connect: The Game-Changer for Complex Event-Driven Architectures

In 2020, Delaware implemented a state-of-the-art, event-driven architecture for EFSA, enabling a highly decoupled system landscape, presented at the Data&AI Summit 2021. By centrally brokering events in near real-time, consumer applications react instantly to events from producer applications as they occur. Event producers are decoupled from consumers via a publisher/subscriber mechanism. Over the past years, we noticed some drawbacks. The processing of these custom events, primarily aimed for process integration weren’t covering all edge cases, the data quality was not always optimal due to missing events and we needed to create a complex logic for SCD2 tables. Lakeflow Connect allows us to extract the data directly from the source without the complex architecture in between, avoiding data loss and thus, data quality issues, and with some simple adjustments, an SCD2 table is created automatically. Lakeflow Connect allows us to create more efficient and intelligent data provisioning.