Candidate LLs joining LL associations and networks (ENoLL, Forum LLSA...) undergo quality- assessment processes based on specific criteria and evaluation frameworks to guarantee members meet their LL standards. Currently, limited attention is paid on how such evaluation methods can contribute to future LL-performance. The need to deeper understand the architectural aspects of LLs and further study effective management-approaches has been raised by other authors. Schuurman (2015) proposed a macro–meso-micro-level approach for classifying LLs. Despite its potential value, this three-level analysis approach has not yet been fully recognized in existing LL evaluation frameworks. The adoption of a harmonized macro-meso-micro evaluation approach, with a clear focus on the macro-level could support the development of LL towards sustainability, impact and efficacy. This paper aims to define a set of harmonized weighted criteria for a comprehensive LL evaluation framework to be used for assessing LLs on all three levels based on multi-method research approaches.
", "funding": [ { "award": { "acronym": "VITALISE", "id": "00k4n6c32::101007990", "identifiers": [ { "identifier": "https://cordis.europa.eu/projects/101007990", "scheme": "url" } ], "number": "101007990", "program": "H2020-EU.1.4.", "title": { "en": "VIrtual healTh And weLlbeing Living Lab InftraStructurE" } }, "funder": { "id": "00k4n6c32", "name": "European Commission" } } ], "publication_date": "2022-06-08", "publisher": "Zenodo", "resource_type": { "id": "publication-conferencepaper", "title": { "de": "Konferenzbeitrag", "en": "Conference paper" } }, "rights": [ { "description": { "en": "The Creative Commons Attribution license allows re-distribution and re-use of a licensed work on the condition that the creator is appropriately credited." }, "icon": "cc-by-icon", "id": "cc-by-4.0", "props": { "scheme": "spdx", "url": "https://creativecommons.org/licenses/by/4.0/legalcode" }, "title": { "en": "Creative Commons Attribution 4.0 International" } } ], "title": "Harmonizing the evaluation of living labs: a standardized evaluation framework" }, "parent": { "access": { "owned_by": { "user": "221365" }, "settings": { "accept_conditions_text": null, "allow_guest_requests": false, "allow_user_requests": false, "secret_link_expiration": 0 } }, "communities": { "default": "c091556e-e421-4fc8-8e79-7974b244bd81", "entries": [ { "access": { "member_policy": "open", "members_visibility": "public", "record_submission_policy": "open", "review_policy": "open", "visibility": "public" }, "children": { "allow": false }, "created": "2023-05-16T10:39:29.669562+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "4c5af10d-57ad-4111-8d91-4bfb87659f9c", "links": {}, "metadata": { "curation_policy": "This community is curated by ENoLL office.
\r\n", "page": "", "title": "ENoLL - European Network of Living Labs" }, "revision_id": 0, "slug": "enoll", "updated": "2023-05-16T10:41:09.427895+00:00" }, { "access": { "member_policy": "open", "members_visibility": "public", "record_submission_policy": "open", "review_policy": "open", "visibility": "public" }, "children": { "allow": false }, "created": "2021-05-14T07:55:03.538953+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "c091556e-e421-4fc8-8e79-7974b244bd81", "links": {}, "metadata": { "curation_policy": "Aligned to Article 29 Open access to scientific publications, of the Grant Agreement:
\r\n\r\nEach beneficiary must ensure open access (free of charge online access for any user) to all peer-reviewed scientific publications relating to its results.
\r\nIn particular, it must:
\r\n(a) as soon as possible and at the latest on publication, deposit a machine-readable electronic copy of the published version or final peer-reviewed manuscript accepted for publication in a repository for scientific publications;
\r\nMoreover, the beneficiary must aim to deposit at the same time the research data needed to validate the results presented in the deposited scientific publications.
\r\n(b) ensure open access to the deposited publication — via the repository — at the latest:
\r\n(i) on publication, if an electronic version is available for free via the publisher, or
\r\n(ii) within six months of publication (twelve months for publications in the social sciences and humanities) in any other case.
\r\n(c) ensure open access — via the repository — to the bibliographic metadata that identify the deposited publication.
This is a scientific community about living labs in the health & wellbeing domain, lead by the VITALISE project.
\r\n\r\nThe project is funded by the EU Horizon 2020 Framework Programme and aims to harmonize Living Lab procedures and open Living Lab Infrastructures as a means to facilitate and promote research activities in the Health and Wellbeing domain in Europe and beyond. Transnational access to 17 Living Lab research infrastructures and remote digital access to datasets (Virtual Access) is offered to external researchers from all disciplines through three open calls starting from 2022. External researchers will have the opportunity to conduct part of their study in rehabilitation, transitional care and everyday life activities or any other domain by visiting the VITALISE living labs. VITALISE designs and develops ICT tools for shared access of similar devices and applications used across Living Labs, as well as for collecting, storing and sharing datasets. VITALISE also invests in the development of Training methods towards the wider understanding and valorisation of Living Lab methodologies in the research community.
\r\n\r\nRead more about the project here: https://vitalise-project.eu/
\r\n\r\nThe project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No 101007990.
", "title": "VITALISE Project: Virtual Health and Wellbeing Living Lab Inftrastructure" }, "revision_id": 0, "slug": "vitaliseproject", "updated": "2021-05-14T07:59:11.462230+00:00" }, { "access": { "member_policy": "open", "members_visibility": "restricted", "record_submission_policy": "open", "review_policy": "closed", "visibility": "public" }, "children": { "allow": true }, "created": "2022-11-23T15:53:29.436323+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "f0a8b890-f97a-4eb2-9eac-8b8a712d3a6c", "links": {}, "metadata": { "curation_policy": "The EU Open Research Repository serves as a repository for research outputs (data, software, posters, presentations, publications, etc) which have been funded under an EU research funding programme such as Horizon Europe, Euratom or earlier Framework Programmes.
\nThe community is managed by CERN on behalf of the European Commission.
\nZenodo’s general policies and Terms of Use apply to all content.
\nThe EU Open Research Repository accepts all digital research objects which is a research output stemming from one of EU’s research and innovation funding programmes. The funding programmes currently include:
\nHorizon Europe (including ERC, MSCA), earlier Framework Programmes (eg Horizon 2020) as well as Euratom.
\nIn line with the principle as open as possible, as closed as necessary both public and restricted content is accepted. See note on how Zenodo handles restricted content.
\nEU programme beneficiaries are eligible to submit content to the community. The community supports three types of content submissions:
\nSubmission via an EU Project Community (through user interface or programmatic APIs).
\nSubmission directly to the EU Open Research Repository.
\nAutomated harvesting from existing Zenodo content.
\nA representative of an EU project may request an EU Project Community and invite other project participants as members of the community. The project community is linked to one or more European Commission grants. All records in the project community are automatically integrated into the EU Open Research Repository immediately upon acceptance into the project community.
\nAny user may submit a record directly to the EU Open Research Repository. The submission will be moderated by Zenodo staff for compliance with the minimal required metadata requirements and its correctness.
\nRecords found among Zenodo’s existing content will on a regular basis automatically be integrated if they are found to comply with the requirements. The submissions through this method are integrated into the EU Open Research Repository with delay in a fully automated way.
\nRecords in the EU Open Research Repository are required to comply with the following minimal metadata requirements:
\nVisibility: Both public and restricted (with or without embargo and/or access request)
\nResource types: All resource types.
\nLicenses: Public and embargoed records MUST specify a license. The chosen license SHOULD be compliant with the Horizon Europe open science requirements (see Open Science in Horizon Europe)
\nFunding information: Records MUST specify at least one grant from the European Commission.
\nCreators: Creators SHOULD be identified with a persistent identifier (e.g. ORCID, GND, …), and affiliations SHOULD be identified with a persistent identifier (e.g. ROR, ISNI, …)
\nSubjects: Records SHOULD specify one or more fields of science from the European Science Vocabulary.
\nThese metadata requirements comes from the related open science requirements in Horizon Europe which are detailed in each project's grant agreement.
\nAll submissions undergo automated curation checks for compliance with the policy. Submissions through project communities are in addition reviewed by the project community. Submission directly to the EU Open Research Repository is in addiotn reviewed by Zenodo staff.
\nCommunity curators may at any point edit metadata of the records in the community without notice through human or automated processing. The curators may at their sole discretion remove records from the community that are deemed not to comply with the content and curation policy or which are deemed of insufficient quality.
\nThe content and curation policy is subject to change by the community owner at any time and without notice, other than through updating this page.
", "description": "Open repository for EU-funded research outputs from Horizon Europe, Euratom, and earlier Framework Programmes.", "funding": [ { "funder": { "id": "00k4n6c32" } } ], "organizations": [ { "id": "00k4n6c32" } ], "page": "The EU Open Research Repository is a Zenodo-community dedicated to fostering open science and enhancing the visibility and accessibility of research outputs funded by the European Union. The community is managed by CERN on behalf of the European Commission.
\nThe mission of the repository is to support the implementation of the EU's open science policy, providing a trusted and comprehensive space for researchers to share their research outputs such as data, software, reports, presentations, posters and more. The EU Open Research Repository simplifies the process of complying with open science requirements, ensuring that research outputs from Horizon Europe, Euratom, and earlier Framework Programmes are freely accessible, thereby accelerating scientific discovery and innovation.
\nThe EU Open Research Repository serves as a complementary platform to the Open Research Europe (ORE) publishing platform. Open Research Europe focuses on providing a publishing venue for peer-reviewed articles, ensuring that research meets rigorous academic standards. The EU Open Research Repository provides a space for all the other research outputs including data sets, software, posters, and presentations that are out of scope for ORE. This holistic approach enables researchers to not only publish their findings but also share the underlying data and materials that support their work, fostering transparency and reproducibility in the scientific process.
\nThe EU Open Research Repository is funded by the European Union under grant agreement no. 101256740 (HORIZON-ZEN Plus). For more information about the project see https://about.zenodo.org/projects/horizon-zen/.
", "title": "EU Open Research Repository", "type": { "id": "organization" }, "website": "https://research-and-innovation.ec.europa.eu" }, "revision_id": 24, "slug": "eu", "theme": { "brand": "horizon", "enabled": true, "style": { "font": { "family": "Arial, sans-serif", "size": "16px", "weight": 600 }, "mainHeaderBackgroundColor": "#FFFFFF", "primaryColor": "#004494", "primaryTextColor": "#FFFFFF", "secondaryColor": "#FFD617", "secondaryTextColor": "#000000", "tertiaryColor": "#e3eefd", "tertiaryTextColor": "#1c5694" } }, "updated": "2026-03-31T12:29:43.596724+00:00" } ], "ids": [ "4c5af10d-57ad-4111-8d91-4bfb87659f9c", "c091556e-e421-4fc8-8e79-7974b244bd81", "f0a8b890-f97a-4eb2-9eac-8b8a712d3a6c" ] }, "id": "7434405", "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.7434405", "provider": "datacite" } } }, "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.7434406", "provider": "datacite" }, "oai": { "identifier": "oai:zenodo.org:7434406", "provider": "oai" } }, "revision_id": 6, "stats": { "all_versions": { "data_volume": 417329130.0, "downloads": 466, "unique_downloads": 412, "unique_views": 559, "views": 622 }, "this_version": { "data_volume": 412841720.0, "downloads": 461, "unique_downloads": 408, "unique_views": 550, "views": 613 } }, "status": "published", "swh": {}, "updated": "2024-07-15T14:23:35.638430+00:00", "versions": { "index": 1, "is_latest": true } }