talk-data.com talk-data.com

Topic

flink

2

tagged

Activity Trend

2 peak/qtr
2020-Q1 2026-Q1

Top Events

Tides of Change: Real-Time Flow with Postgres, Kafka & Flink 3 VIRTUAL: Apache Flink® Meetup 2 Apache Flink® for Apache Kafka® Developers 2 IN-PERSON: Apache Flink® Meetup 2 IN-PERSON: Apache Flink® Meetup 2 Apache Flink® for Apache Kafka® Developers 2 Message Tracking, Fluss in Apache Flink 2.x, & Kafka-to-Iceberg Transformation 1 IN PERSON: Tooling for running Apache Kafka in Production 1 Crypto Streams to AI Predictions: Apache Kafka®, Apache Flink® & Apache Iceberg® 1 Data Berlin Midsummer Meetup - Speeding up Analytics 1 IN-PERSON! Kafka Meetup Septembre: Aiven, Flink, KStreams, Kestra, Google Cloud 1 Apache Kafka® x Apache Flink® x Elastic 1

Top Speakers

Laurentiu Bita 2 Oded Nahum 2 Sven Erik Knop 2 David Moravek 2 Jan Svoboda 2 Anton Borisov 2 Gunnar Morling 2 Ashish Bagri 1 Peter A. High 1 Csanád Bakos 1 Raghav Nehru 1 Robert Metzger 1

Activities

Showing filtered results

All Video Podcast Book
Filtering by: Gunnar Morling ×

From Postgres to OpenSearch in No Time

2023-11-30 · Berlin Open Source Data Infrastructure Meetup - November 2023
talk
by Gunnar Morling (Decodable)
debezium opensearch

Abstract: You've been tasked with implementing a data streaming pipeline for propagating data changes from your operational Postgres database to a search index in OpenSearch. Data views in OS should be denormalized for fast querying, and of course there should be no noticeable impact on the production database. In this session we'll discuss how to build this data pipeline using two popular open-source projects: Debezium for log-based change data capture (CDC) and Apache Flink for stream processing. Join us for this talk and learn about: * Setting up change data streams with Debezium * Efficiently building nested data structures from 1:n joins * Deployment options: Kafka Connect vs. Flink CDC