How to move data from thousands of SQL databases to data lake with no impact on OLTP? We'll explore the challenges we faced while migrated legacy batch data flows to event-based architecture. A key challenge for our data engineers was the multi-tenant architecture of our backend, meaning that we had to handle the same SQL schema on over 15k databases. We'll present the journey employing Debezium, Azure Event Hub, Delta Live tables and the extra tooling we had to put in place.
talk-data.com
Speaker
Andrea Romeo
1
talks
I'm a Platform Engineer at TeamSystem, where I focus on building and evolving the technical foundation that powers our data infrastructure. With a strong passion for backend and cloud technologies, I work closely with development and data teams to design scalable, resilient platforms that support data-driven products and services.
My role is deeply rooted in the tech side of the business—I thrive on solving complex engineering challenges, automating workflows, and enabling teams to deliver value faster and more reliably. In particular, I specialize in architecting and maintaining data platforms that ensure efficient data processing, storage, and access across the organization.
I’m continuously exploring new tools and best practices in DevOps, cloud-native development, and infrastructure as code to improve platform performance and developer experience. I value collaboration, clean architecture, and a mindset of continuous improvement.
Bio from: Big Data LDN 2025
Filter by Event / Source
Talks & appearances
1 activities · Newest first