D5.1 - Evaluation Plan

Use cases are a joint effort involving all elements of the AI-SPRINT Consortium, i.e., end users, integrators, research partners, and the cloud provider. End users provide the actual use cases and related expertise, as well as experience in the evaluation of objectives; integrators bring their experience in implementing effective solutions; research partners provide high-level expertise and knowledge about AI-SPRINT technology; finally, the cloud provider offers the experimental infrastructure to support integration and validation activities and real-world implementation expertise.
This deliverable presents the evaluation plan of the AI-SPRINT software based solutions for its use cases. The evaluation plan is based on Basili's Goal Question Metric (GQM) method. The objective of the evaluation plan is to specify and schedule the activities that should be performed to evaluate the AI-SPRINT solution. For the evaluation itself we aim to assess the AI-SPRINT solutions with respect to the project's main objectives, the Key Performance Indicators, the elicited requirements provided by the use case providers and the objectives related to the specific technical work packages. The evaluation plan specifies what and how to evaluate as well as the overall schedule for the evaluation, applying a set of slightly revised GQM templates.
It is important to note that the main target of this evaluation is the software based AI-SPRINT solutions, thus, it is not a general evaluation of all activities and progress in the project as a whole. Moreover the focus is on the evaluation of the AI-SPRINT assets performed through the AI-SPRINT use cases and not the technical evaluation per se which is described on the deliverables related to the technical developments of AI-SPRINT assets.