In this talk, we will discuss how we implemented the Iceberg connector in Rust, replacing the original Java-wrapped version to address performance bottlenecks in serialization and memory usage. By following the Apache Iceberg specification, we built a native Rust connector that supports Iceberg’s advanced features, such as multi-catalog compatibility and streaming updates. We’ve contributed this new version to the apache/iceberg-rust repository, and will share insights into the architectural improvements and best practices for leveraging Iceberg in streaming environments.
talk-data.com
Y
Speaker
Yingjun Wu
1
talks
Speaker
RisingWave Labs
CEO, RisingWave
Bio from: The June Meetup
Filtering by:
Apache Iceberg Bay Area Community Meetup
×
Filter by Event / Source
Berlin Open Source Data Infrastructure Meetup - November 2023
1
Apache Iceberg Paris Community Meetup #2
1
Data Streaming Lakehouse Tour (Paris)
1
Apache Iceberg Bay Area Community Meetup
1
Data Streaming Lakehouse Tour (Paris)
1
The June Meetup
1
Data Builders’ Evening: Architecture, Engineering & Beyond
1
DATA MINER Big Data Europe Conference 2020
3
Data Engineering Podcast
1
Talks & appearances
Showing 1 of 11 activities