Let The Data Sing - A Scalable Architecture to Make Data Silos FAIR
Description
LTDS ("Let the Data Sing") is a lightweight, microservice-based Research Data Management (RDM) architecture which elevates isolated data stores ("data silos") into FAIR research data repositories. The core components of LTDS include a metadata store and dissemination services such as a landing page generator and an OAI-PMH server. LTDS is developed at LRZ (Leibniz Supercomputing Centre, Garching, Germany), with the aim of allowing researchers to make massive amounts of data (e.g.HPC simulation results) on LRZ storage systems FAIR. Such data often can often, owing to their size, not easily be transferred into conventional repositories. As a result, they remain "hidden", while only e.g. final results are published -- a massive problem for reproducibility of simulation-based science.
Our poster summarises the LTDS architecture, which uses Open Source and standard components and is targeted at following best practices in FAIR data (and metadata) handling. In addition, we present our experience with first use cases, which are usually scientific projects with LRZ involvement (AlpEnDAC -- Alpine Environmental Data Analysis Centre, ClimEx project, ViWA project). Once in beta stage, LTDS will be documented and published under Open Source license for reuse. Code reusability shall also help to collect feedback and optimise our system in supporting the idea of FAIR RDM.
Files
Let the Data sing.pdf
Files
(37.5 kB)
Name | Size | Download all |
---|---|---|
md5:9b22cdfd1e5d858e4a4aae627b72513f
|
37.5 kB | Preview Download |
Additional details
Subjects
- 004 Data processing & computer science
- https://dewey.info/
- 020 Library & information sciences
- https://dewey.info/