Porting Big Data technology across domains. WISE for MUSE

Due to the nature of MUSE data, each data-cube obtained as part of the GTO program is used by most of the consortium institutes which are spread across Europe. Since the effort required in reducing the data is significant, and to ensure uniformity in analysis, it is desirable to have a data management system that integrates data reduction, provenance tracking, quality control and data analysis. Such a system should support the distribution of storage and processing over the consortium institutes.

The MUSE-WISE system incorporates these aspects. It is built on the Astro-WISE system, originally designed to handle OmegaCAM imaging data, which has been extended to support 3D spectroscopic data. MUSE-WISE is now being used to process MUSE GTO data. It currently stores 95 TB consisting of 48k raw exposures and processed data used by 79 users spread over 7 nodes in Europe.