D5.8 Testing and validation methodologies final report with the final version of testing and validation suite

In this deliverable D5.8 the final version of the 5G EVE testing and validation platform is presented, focusing on the components of the platform which are related with the execution of the experiment, the analysis of the collected metrics, the validation of the generated KPIs and finally the generation of the final reports provided to the experimenters for the use case data analysis.

The key 5G EVE components which are related with the experiment execution, the analysis and validation of the results and the diagnostic functionalities and they were defined and developed in the project are the “Experiment Execution Manager”, the “Results Analysis and Validation” and the “Performance Diagnosis”. Together with these three components, also a “Tests Scripts Inventory” has been included to store the different scripts associated with different Test Cases. In this deliverable D5.8 the final versions of the aforementioned components are reported. In addition, the development updates and extensions are compared to the previous versions reported in previous deliverables (D5.2[2], D5.3[3], D5.5[4]).

Initially, in the document the overall final 5G EVE testing and validation platform is presented, as well as the relation of testing/validation/diagnosis components with the rest of the 5G EVE components. Then, the final versions of WP5 components are presented and the new features and extensions are presented.

• The Experiment Execution Manager (EEM) component is responsible to drive the execution of all the tests run on top of the 5G EVE infrastructure. Its activity starts after the experiment has been fully deployed, upon trigger from the Experiment Lifecycle Manager (ELM).

• The Results Analysis and Validation (RAV) component is responsible to realise the appropriate analysis on the collected metrics, to validate the generated KPIs and also to generate the experiments reports that will become available to the experimenters.

• The Performance Diagnosis (PD) component has the responsibilities to provide insights on the execution and validation of the tests, to provide additional information about the health status of the network and service elements and to execute diagnostics and root cause analysis mechanisms in case of performance degradations.

In the document, for each component, the internal architecture, the interactions, the related procedures and the implementation details are presented and explained in detail.