Published October 15, 2019 | Version 2
Poster Open

Let The Data Sing - A Scalable Architecture to Make Data Silos FAIR

  • 1. Leibniz Supercomputing Centre

Description

LTDS ("Let the Data Sing") is a lightweight, microservice-based Research Data Management (RDM) architecture which elevates isolated data stores ("data silos")  into FAIR research data repositories. The core components of LTDS include a metadata store and dissemination services such as a landing page generator and an OAI-PMH server. LTDS is developed at LRZ (Leibniz Supercomputing Centre, Garching, Germany), with the aim of allowing researchers to make massive amounts of data (e.g.HPC simulation results) on LRZ storage systems FAIR. Such data often can often, owing to their size, not easily be transferred into conventional repositories. As a result, they remain "hidden", while only e.g. final results are published -- a massive problem for reproducibility of simulation-based science.

Our poster summarises the LTDS architecture, which uses Open Source and standard components and is targeted at following best practices in FAIR data (and metadata) handling. In addition, we present our experience with first use cases, which are usually scientific projects with LRZ involvement (AlpEnDAC -- Alpine Environmental Data Analysis Centre, ClimEx project, ViWA project). Once in beta stage, LTDS will be documented and published under Open Source license for reuse. Code reusability shall also help to collect feedback and optimise our system in supporting the idea of FAIR RDM.

Files

Let the Data sing_v2.pdf

Files (39.8 kB)

Name Size Download all
md5:efbf79f6ad2d1fd2090b14c537a50010
39.8 kB Preview Download

Additional details

Subjects

004 Data processing & computer science
https://dewey.info/
020 Library & information sciences
https://dewey.info/