iHelp: Standardisation and Quality Assurance of Heterogenous Data I

This deliverable (titled “Standardisation and Quality Assurance of Heterogenous Data I”) describes the initial design and specifications of the iHelp Standardisation and Quality Assurance Mechanism. The Standardisation and Quality Assurance Mechanism will be a unified and integrated mechanism consisting of three (3) core sub-components, the Data Cleaner, the Data Qualifier, the Data Harmonizer, and two (2) integrated sub-components: the Primary Data Mapper and the Secondary Data Mapper, which will be responsible for providing the mapping operations between the raw data resources and the Holistic Health Records (HHRs) resources. This holistic mechanism is the core component that seeks to provide various cleaning, pre-processing and mapping functionalities and services on the incoming raw data. Specifically, it will provide to the wider research and innovation community a wide range of solutions for the cleaning, qualification, transformation, harmonization and mapping of raw healthcare-related data.
The current document aims to provide the initial design, the specifications and a concrete overview of how the proposed mechanism integrates with the overall architecture of the iHelp platform and other components in the Data Ingestion block, and specifically (i) how to retrieve the incoming data from the Data Gateways, (ii) how to interexchange data with the already identified project’s message bus and (iii) how to send the final processed, transformed and HHR aligned data to iHelp’s Data store solution.
To support the aforementioned functionalities, the iHelp Standardisation and Quality Assurance Mechanism specifications exemplify the respective sub-components, the overall data pipeline and workflow, the internal functionalities supported by each sub-component, the interaction points with different components as well as the technical details that will drive the implementation of this holistic mechanism. Finally, this document - in different subsections, e.g. in Section 5.1, - seeks to review the current state of the art in order to identify the baseline technologies and approaches for the realization of the implemented Standardisation and Quality Assurance Mechanism.