Deliverable D6.2 - Second report on validation and dissemination activities

This deliverable D6.2 "Second report on validation and dissemination" of TrialsNet outlines the key activities, progress, and findings related to the tasks of Work Package (WP) 6 which covers the technical and business validation, and dissemination of the project. This is the second public deliverable of WP6 and provides updates on the tasks started in the first and second years of the project. In particular, this document outlines the evaluation methodologies established for assessing Use Case (UC) trials across the three domains identified by the project, including Key Performance Indicators (KPIs) as well as the definition of the process for the Key Value Indicators (KVIs) assessment. It also provides a comprehensive overview of dissemination and standardization outcomes achieved as of the document's release date. Additionally, the report provides a progress update related to the exploitation task.

The TrialsNet project leverages the concept of Smart Cities to drive positive change in the face of rapid urbanization and the push for sustainable development. Recognizing the strong connection between technological innovation and societal progress, TrialsNet envisions Beyond 5G mobile network (B5G) and Sixth Generation of mobile communications (6G) technologies as key to addressing social, economic, and environmental challenges. Focused on mobile technology, TrialsNet aligns with broader societal goals through large-scale trials of cutting-edge 6G applications that are designed to meet critical needs in key domains across European urban ecosystems.

Framed in this context, one of the core objectives in WP6 is the evaluation of KPIs of the TrialsNet UCs, which include also sustainability metrics. This includes revisiting the initially defined KPIs and ensuring they are well-suited for the diverse trials, covering areas like throughput, latency, reliability, and energy efficiency. These KPIs are central in benchmarking the performance of the TrialsNet network across various environments and conditions, guiding the project's technological improvements and optimizations. Furthermore, this deliverable analyzes the preliminary measurements performed across the UCs, discussing which KPIs have been validated, i.e., where measurements have met the required performance levels.

In parallel, WP6 also goes into the business aspects of TrialsNet by assessing the KVIs. These indicators evaluate the social, economic and environmental value generated by TrialsNet innovations, particularly in the context of emerging 6G technologies. By linking technological performance with broader societal goals such as sustainability, the project aligns its work with modern business models that prioritize environmental, social and economic impact. The core of the TrialsNet methodology involves the creation of Key Values (KVs) and KVIs, which will identify potential sources of sustainable value and serve as a guiding framework for aligning the project’s activities and goals. These elements will be reinforced by a rigorous application of KPIs, viewed through a comprehensive lens that goes beyond the technical aspects of B5G and 6G to include a wide array of social, economic, and environmental factors. Through the development of robust assessment frameworks that integrate both qualitative and quantitative metrics, TrialsNet aims to emphasize the multifaceted impact of its 6G solutions on society and promote the early adoption and widespread acceptance of these technologies and related applications to drive positive change and contribute to the greater good. By considering more than just financial outcomes, organizations can focus on achieving a Quadruple Bottom Line (QBL) of Profit, Planet, People, and Purpose, fostering a more equitable and brighter future for all. This deliverable provides a strategic roadmap for the TrialsNet project by integrating insights from social, economic, environmental, and business perspectives. By exploring KVs relevant to the project's UCs, it seeks to establish a framework that enhances communication and collaboration among partners, ensuring alignment and shared understanding. It also directs readers to more in-depth resources for further exploration if needed. The first trial with end users, conducted under UC5 “Control Room in Metaverse” in October 2024, has already been completed. This deliverable includes the initial outcomes of the KVI analysis derived from this trial. The assessment of KVIs for other UCs is also analyzed whereby these UCs are used as practical examples to illustrate the applicability of KVI assessment throughout the project’s activities.

This deliverable also provides an analysis of the KPIs and KVIs addressed by each one of the Open Call sub-projects based on the KPI terminology and the KVIs framework defined by TrialsNet in D6.1. Given the large number of sub-projects, i.e. 24, the adopted KPI/KVI terminology and definition needs to be harmonized. To coordinate such a process, the KPI and KVI information has been collected through the submission of a template elaborated by the project to guarantee that the same definition of KPIs/KVIs was adopted, hence avoiding possible misunderstanding due to incoherent definitions, conventions or naming of the related metrics.

The importance of integrating stakeholder feedback into the design of UCs to ensure that the solutions created address real-world needs effectively is also considered in TrialsNet and this deliverable. A summary of Design Thinking+ (DT+) activities is presented, including the methodological results and research conducted within UC1 “Smart Crowd Monitoring”, UC5 “Control Room in Metaverse”, UC10 “Immersive Fan Engagement”, UC12 “City Parks in Metaverse”, and UC13 “Extended XR Museum Experience”. The next steps for DT+ implementation are also reported. Dissemination activities are another key focus of WP6 and the project in general and aim to maximize the project's impact by ensuring that results are shared widely with relevant stakeholders. These activities have included participation in conferences, publications, and social media outreach, as well as involvement in standardization efforts, particularly in the 3rd Generation Partnership Project (3GPP) standards. The project's dissemination efforts are on track, with KPIs for communication activities being met or even exceeded in some cases.

This includes substantial engagement in social media, blog posts, videos, and presentations (including demos) at industry events, highlighting TrialsNet's efforts to raise awareness and engage the broader community. In addition, TrialsNet has participated in Working Groups (WGs), Task Forces (TFs), and joint activities with 6G Smart Networks and Services Industry Association (6G-IA) and Smart Networks and Services Joint Undertaking (SNS JU), which details are reported in this deliverable. Additionally, this report discusses the exploitation strategies being updated by various project partners in response to evolving project developments. These strategies focus on ensuring that the innovations developed within the project lead to practical applications in the three different domains addressed by the project. For example, the development of AI (Artificial Intelligence) and Machine Learning (ML) applications in the TrialsNet UCs is seen as a key area of growth, with partners looking to leverage these technologies to enhance customer services and operational efficiency in their respective industries. In the second phase of the project lifetime, we will establish a joint exploitation plan to maximize the project's impact, support the commercialization of the proposed UCs, and foster ongoing collaboration among the involved partners.

Finally, this report outlines the ongoing work in the trials management, emphasizing the critical role of collaboration among key stakeholders (e.g., municipalities, end-users) and technical experts to ensure the success of the trials. Trials are technically demanding and involve the integration of complex technologies, related applications, platforms and network solution for showcasing the various UCs. The outcomes from these trials will provide valuable insights into how enhanced networks B5G (towards 6G) can support novel and demanding applications. To help capture these important outcomes, a proper process has been defined and reported in this deliverable addressing planning of the trials and including common templates for homogeneous collection of various information such as trial location, network infrastructure (e.g., commercial, private, experimental), network release (i.e. Rel-15, Rel-16, or Rel-17), coverage type (e.g., indoor or outdoor), coverage area, trial duration, and number of sessions-users-devices.