Published October 27, 2022
| Version v1
Presentation
Open
Xbitinfo: Compress datasets based on their information content
Creators
- 1. CICOES/University of Washington
- 2. Max Planck Institute for Meteorology
- 3. University of Oxford
Description
Abstract:
Xbitinfo provides additional compression capabilities to the Pangeo Python workflow. Building on top of the Julia package BitInformation.jl, Xbitinfo is able to compress xarray datasets based on their information content. With compression rates out-performing traditionally for compression used formats like GRIB, Xbitinfo allows to save datasets in cloud-ready formats like Zarr without sacrificing compression rates or performance.
Files
Schulz_2022-10-26.mp4
Files
(136.7 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:d15931318b37d779b46022f019b2898f
|
127.9 MB | Preview Download |
|
md5:b5266133580381cf527f38768e80e802
|
8.8 MB | Preview Download |