Scalable workflow for large-scale statistical studies of spacecraft data

By translating from CDF on disk to xarray in memory and then storing files in more performant data formats (zarr, HDF5, netCDF, etc), a researcher will be less burdened by computational and technical tasks. They are allowed to focus primarily on science tasks in their research progress. This proposed workflow is intended for large-scale statistical studies. The traditional workflow of exploratory nature with libraries such as spedas is most suitable for event studies where the details are more complicated. We have used this workflow for a recent JGR publication on four years of MMS magnetotail observations.