D6.2 Trials and experimentation (cycle 2)

This deliverable presents the second cycle of trials and experimentation activities executed over 5GENESIS facilities. The document is the continuation of deliverable D6.1, in the sense that it captures tests carried out over the evolved infrastructures hosting 5GENESIS facilities following the methodology defined in D6.1. In this document 8 main KPIs and 4 application specific validation trials achieved, under 123 experiments that performed in total. The tests focus more on i) the evolved 5G infrastructure deployments that includes radio and core elements in non-standalone (NSA) deployment configurations based on commercial and open implementations, and ii) the use of Open 5GENESIS Suite for the execution of the tests.

In this context the structure of this document is platform centric, hence it allows each platform to specify independently the group of executed tests and validations executed and the results presented and commented. However, all platforms agree on the following principles:

• Test and results discussed in this document should be accompanied by the detailed Test Case description according to 5GENESIS template specified in deliverable D2.3 [1].
• Throughput and Round-Trip-Time (RTT) Key Performance Indicators (KPIs) should be validated in all platforms although the results are not mandatory to be comparable.
• The test procedure should be carried out through the portal / Experiment Lifecycle Manager (ELCM) components of the Rel. A of Open 5GENESIS Suite.
• The result analysis should be carried out through the analytics tools provided by the Open 5GENESIS Suite analytics framework.

In most of the cases all the previous clauses were applied, however some specific tests either due to the complexity of the scenario, the advanced required functionality or the on-going status of the deployment, were executed manually.

In brief, five 5GENESIS facilities’ tests and results are discussed in this document:

• Málaga Facility - includes baseline tests for throughput and RTT KPIs, as well as MCPTT, RunEl 5G Radio Access Network (RAN) solution physical layer latency and content delivery streaming service.
• Athens Facility - includes baseline tests for throughput and RTT KPIs, Service Creation Time of a 5G connectivity service, one-way delay and RTT under different load scenarios.
• Limassol Facility - includes baseline tests for throughput and RTT KPIs as well as Service Creation Time of 5G component deployment.
• Surrey Facility - includes baseline tests for throughput and RTT KPIs, NB-IoT coverage, IoT application specific latency.
• Berlin Facility - include baseline tests for throughput and RTT KPIs, 360o live video streaming QoE, RAN coverage and UE density.

The main part of the document contains a basic presentation of the validated KPIs and measured metrics followed by commentary. The detailed test cases and result tables are available in the Annex of this document. It should be noted that the original Test Cases (the ones available in the annex of D6.1) have been refined and are delivered as a separate Testing and Validation companion document. This document includes all the test cases templated (i.e. the KPI measured, the System Under Test (SUT) definition, the measurement process and tools) that have been used throughout D6.2 and D6.1. In addition, in a separate section the common 5GENESIS measurement statistical analysis methodology is summarised.

Overall, deliverable D6.2 presents the progress of 5GENESIS for the last year (2nd cycle) and the results already reveal the benefits from the adoption of 5G technology. In some cases, included in this document, the previous statement is also verified for preliminary vertical applications implementation.