talk-data.com talk-data.com

Tom White

Speaker

Tom White

1

talks

author
Filtering by: SciPy 2025 ×

Filter by Event / Source

Talks & appearances

Showing 1 of 5 activities

Search activities →

Cubed is a framework for distributed processing of large arrays without a cluster. Designed to respect memory constraints at all times, Cubed can express any NumPy-like array operation as a series of embarrassingly-parallel, bounded-memory steps. By using Zarr as persistent storage between steps, Cubed can run in a serverless fashion on both a local machine and on a range of Cloud platforms. After explaining Cubed’s model, we will show how Cubed has been integrated with Xarray and demonstrate its performance on various large array geoscience workloads.