D.7.7: Collected and Aggregated Data

This document describes the data collection and aggregation methodology used in ICT4CART, together with a summary of the state of the art on tools needed for data acquisition, validation, transmission, database structure and storage. The developed methodology is impacted by the other tasks of WP7, where the test site requirements and deployments are specified, as well as the task T8.1 “Evaluation Methodology and Plan”. The test sites have provided their own data specifications of the collected data in each use case. The data collection and aggregation methodology is described in the Section 2, and defines a common process that should be used by all the test sites and for each use case to produce required data with the right quality for the evaluation tasks in WP8. This deliverable presents insights into collected data with focus on the WP8 requirements and specificities per test site. In addition, the document explains the data management methodology and procedures, and defines the features of the centralised data management in ICT4CART which enables the storage and sharing of collected data across the consortium partners. The current deliverable is a public document and provides a complete picture of the data management methodology developed the task T7.7 “Data Collection and Aggregation” in ICT4CART. In this task, the involved partners have developed a common methodology for data acquisition and centralised data management, which is tailored to the needs of collection of semi-structured data formats that may significantly vary from a test site to a test site. All collected data are stored in a centralised data management system. The design and architecture of such a system are explained in Section 5 of this document, which provides a deep understanding of the interfaces provided to the evaluators and to the test sites to collect data.