This talk discusses the recent improvements that Amazon S3 team has been doing in Iceberg FileIO and LocationProvider to improve Iceberg user experience on S3. This includes better retry and fault tolerant executions (#10433 & #11052), better hashing scheme to reduce throttling (#11112), and integration with S3 Data Acceleration Toolkit and AWS CRT client to improve read performance.
talk-data.com
R
Speaker
Roni Burd
1
talks
Dir of Product Engineering
AWS
Roni Burd is Dir of Product Engineering at AWS, and builds platform and developer tools. Roni brings 15+ years of experience working in the query engines, storage engines, and compute platform for database systems and ML processing.
Bio from: Apache Iceberg Bay Area Community Meetup
Filter by Event / Source
Talks & appearances
1 activities · Newest first