BigDataGrapes D7.2 - Experimental Report on Current Datasets

The deliverable D7.2 “Experimental Report on Current Datasets” consists of a report describing the outcomes of the experimentation performed on the datasets provided by each pilot, utilizing the Big Data Grapes stack.

This report starts by outlining the methodology and metrics we employ for our experimentation. We focus our experimentation on a pilot level, initially analysing the provided datasets and evaluating them against the Big Data Vs, as suggested and described in detail in D7.1.

We move on to identify and document the data flows each pilot adheres to throughout the Big Data Grapes stack, highlighting the frameworks and components involved in the process.
We experiment on each of the identified data flow steps by describing 3 usage scenario for each. During the execution of each scenario for each step, we monitor the chosen performance metrics, showing the respective diagrams and analysing the outcomes.

This deliverable also presents an end to end report for each of the pilot’s data flows, identifying bottlenecks and making suggestions to improve the performance where needed.