talk-data.com talk-data.com

N

Speaker

Nicoleta Lazar

1

talks

Sr. Data Engineer Fresha
Filtering by: Tides of Change: Real-Time Flow with Postgres, Kafka & Flink ×

Filter by Event / Source

Talks & appearances

Showing 1 of 2 activities

Search activities →

At Fresha, we became the pioneers that put StarRocks to test in production for realtime analytical workloads. But one of the first challenges we faced was getting all the data there reliably and efficiently. We had to think about historical data, and realtime data and orchestrate all of that, such that we can move fast, without breaking too many things. Our tools of choice: Airflow, StarRocks Pipes, Apache Flink. In this talk, I’ll share how we built our data pipelines using Apache Flink and Airflow, what worked and what didn’t for us. Along the way, we’ll explore how Flink helps ensure data consistency, handles failures gracefully, and keeps our real-time workloads running strong.