libyt: A Tool for In-Situ Parallel Analysis and its Scientific Applications

The size and scale of simulations have grown rapidly in order to solve larger physics problems and to render the data in a higher resolution. This resulted in bigger dataset in each step in simulations. Analytic tools have been developed to analyze and visualize these output datasets, but they suffer from having simulations to store the full datasets on disk first before further analyzing them. This may take up lots of disk space if we want to analyze the data in a high resolution time series. This also wastes lots of space storing unnecessary data, if we only need a small portion from them. We developed libyt to solve this problem. libyt is a C++ library for yt, that aims to make simulations able to use yt or other Python packages to analyze data arbitrarily in code runtime. We describe how libyt is built and demonstrate that it plays an important role in large simulations. We also show the advantage of using libyt and how it can be extended and connected to other analytic tools in the upcoming updates.