This archive contains the part 1 of Shift Benchmark on Multiple Sclerosis lesion segmentation data. This dataset is provided by the Shifts Project to enable assessment of the robustness of models to distributional shift and the quality of their uncertainty estimates. This part is the MSSEG data collected in the digital repository of the OFSEP Cohort provided in the context of the MICCAI 2016 and 2021 challenges. A full description of the benchmark is available in https://arxiv.org/pdf/2206.15407. Part 2 of the data is available here. To find out more about the Shifts Project, please visit https://shifts.ai .
", "funding": [ { "award": { "acronym": "AI4Media", "id": "00k4n6c32::951911", "identifiers": [ { "identifier": "https://cordis.europa.eu/projects/951911", "scheme": "url" } ], "number": "951911", "program": "H2020-EU.2.1.1.", "title": { "en": "A European Excellence Centre for Media, Society and Democracy" } }, "funder": { "id": "00k4n6c32", "name": "European Commission" } } ], "publication_date": "2022-09-05", "publisher": "Zenodo", "references": [ { "reference": "Malinin, Andrey et al. (2022). \u00a0Shifts 2.0: Extending The Dataset of Real Distributional Shifts, arXiv:2206.15407" } ], "resource_type": { "id": "dataset", "title": { "de": "Datensatz", "en": "Dataset" } }, "subjects": [ { "subject": "Robustness" }, { "subject": "Distributional Shift" }, { "subject": "Uncertainty Estimation" }, { "subject": "Semantic Segmentation" }, { "subject": "MRI data" }, { "subject": "Neuroimaging" } ], "title": "Shifts Multiple Sclerosis Lesion Segmentation Dataset Part 1", "version": "1.0" }, "parent": { "access": { "owned_by": { "user": "400767" }, "settings": { "accept_conditions_text": "To use this data you must, you must:
\n\n1. Provide your full name, institutional address and purpose of use;
\n2. Accept the OFSEP DUA detailed below.
\n3. Agree on your personal information to be stored in a secure location and the sharing of this personal information with OFSEP. Specifically, this data will contain your full name, institutional email address, date when you applied for access, date when you received access.
\n\n
------------------------------- DATA USAGE AGREEMENT ---------------------------------------
\n\nAccess to OFSEP MRI used for the
\nMSSEG-I MICCAI 2016 and MSSEG-II MICCAI 2021 challenges
I request access to the data collected in the digital repository of the OFSEP Cohort provided in the context of the MICCAI 2016 and 2021 challenges.
\n\nBy accepting this agreement, I become the data controller (as defined under the European GDPR) of the data that I have access to, and I am responsible that I access these data under the GDPR obligations and the specific following terms:
\n\n1. I will comply with all relevant rules and regulations imposed by my institution and my government. This agreement never has prevalence over existing general data protection regulations that are applicable in my country.
\n\n2. I will not attempt to establish or retrieve the identity of the study participants. I will not link these data to any other database in a way that could provide identifying information. I shall not request the pseudonymisation key that would link these data to an individual's personal information, nor will I accept any additional information about individual participants under this Data Use Agreement.
\n\n3. I will not redistribute these data or share access to these data with others, unless they have independently applied and been granted access to these data, i.e., signed this Data Use Agreement. This includes individuals in my institution.
\n\n4. When sharing secondary or derivative data (e.g. group statistical maps, learnt models or templates), I will only do so if they are on a group level, and information from individual participants cannot be deduced.
\n\n5. I will reference the specific source of the accessed data when publicly presenting any results or algorithms that benefited from their use: (a) Papers, book chapters, books, posters, oral presentations, and all other presentations of results derived from the data should acknowledge the origin of the data as indicated in the Terms of use below (b) Authors of publications or presentations using the data should cite relevant publications describing the methods developed and used as described in the Terms of use below (c) Neither the [Research centre/University Department] or [University] or [Institution], nor the researchers that provide this data will be liable for any results and/or derived data.
\n\n6. I will register my [Research centre/University Department] or [University] or [Institution] in the agreement form and I accept that it is cited on the OFSEP website; I will register using my professional email address.
\n\n7. I will have the right to use this dataset for a period of 3 years starting from the date when access to the dataset will be granted. If I need to use this data for more time, I will have to ask for an extension on this website: https://shanoir.irisa.fr. Otherwise, I will have to delete them from my disk after this period of three years.
\n\n8. I will not use this data or a derivative product of it for a commercial use – if looking for a commercial use of the dataset or unsure, please contact OFSEP (projects@ofsep.org).
\n\n9. I will inform OFSEP of the publication of my article with its references via the email address publications@ofsep.org.
\n\n10. I agree to be contacted from time to time by OFSEP staff in charge of projects and publications in order to follow the progress of my work.
\n\n11. Failure to abide by these guidelines will result in termination of my privileges to access these data.
\n\n\n\n
Terms of use
\n\nWhen using part or all of this data, please adhere to the following guidelines:
\n\n1. Indicate in Methods
\n\nData were generated by participating neurologists in the framework of Observatoire Français de la Sclérose en Plaques (OFSEP), the French MS registry (Vukusic et al. 2020). They collect clinical data prospectively in the European Database for Multiple Sclerosis (EDMUS) software (Confavreux et al. 1992). MRI of patients were provided as part of a care protocol. Nominative data are deleted from MRI before transfer and storage on the Shanoir platform (Sharing NeurOImagingResources, shanoir.org).
\n\nVukusic S, Casey R, Rollot F, Brochet B, Pelletier J, Laplaud D-A, et al. Observatoire Français de la Sclérose en Plaques (OFSEP): A unique multimodal nationwide MS registry in France. Mult Scler. 2020;26(1):118–22.
\n\nConfavreux C, Compston DAS, Hommes OR, McDonald WI, Thompson AJ. EDMUS, a European database for multiple sclerosis. J Neurol Neurosurg Psychiatry 1992; 55: 671-676.
\n\nAndrey Malinin, Andreas Athanasopoulos, Muhamed Barakovic, Meritxell Bach Cuadra, Mark JF Gales, Cristina Granziera, Mara Graziani, Nikolay Kartashev, Konstantinos Kyriakopoulos, Po-Jui Lu, Nataliia Molchanova, Antonis Nikitakis, Vatsal Raina, Francesco La Rosa, Eli Sivena, Vasileios Tsarsitalidis, Efi Tsompopoulou, Elena Volf. Shifts 2.0: Extending The Dataset of Real Distributional Shifts, arxiv preprint https://arxiv.org/abs/2206.15407
\n\nPlease cite the challenge dataset description article in any publication using a part or all of the dataset images, when they will become available (see challenge website for updates).
\n\n2. Add to Acknowledgments
\n\nThis work was carried out in collaboration with The Observatoire Français de la Sclérose en Plaques (OFSEP), who is supported by a grant provided by the French State and handled by the“Agence Nationale de la Recherche,” within the framework of the “Investments for the Future” program, under the reference ANR-10-COHO-002, by the Eugène Devic EDMUS Foundation against multiple sclerosis and by the ARSEP Foundation.
\n\n------------------------------- DATA USAGE AGREEMENT ---------------------------------------
\n\n\n\n
Please, clearly state your full name, institution, institutional email address and purpose of use to accept the DUA.
", "allow_guest_requests": true, "allow_user_requests": true, "secret_link_expiration": 30 } }, "communities": { "entries": [ { "access": { "member_policy": "open", "members_visibility": "public", "record_submission_policy": "open", "review_policy": "open", "visibility": "public" }, "children": { "allow": false }, "created": "2020-10-22T12:35:38.515614+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "8538384b-cd84-4cc6-a77c-c259e9568dfd", "links": {}, "metadata": { "curation_policy": "This community will accept all uploads that have been generated by partners of the AI4Media consortium that received funding from the project.
", "description": "Horizon H2020 EC-funded project AI4Media: A European Excellence Centre for Media, Society and Democracy", "funding": [ { "award": { "id": "00k4n6c32::951911" }, "funder": { "id": "00k4n6c32" } } ], "page": "Motivated by the challenges, risks and opportunities that the widespread use of artificial intelligence (AI) has brought to the media, society and politics, the EU-funded AI4Media project aspires to establish a centre of excellence and a wide network of researchers across Europe and beyond. Its focus will be on delivering the next generation of core AI advances to serve the key sector of media, making sure that European values surrounding ethical and trustworthy AI are embedded in future AI deployments. The project will be supplemented by a funding framework, a PhD programme and a set of use cases to demonstrate the impact of the actions taken on the media sector.
", "title": "AI4Media H2020 Project" }, "parent": { "access": { "member_policy": "open", "members_visibility": "restricted", "record_submission_policy": "open", "review_policy": "closed", "visibility": "public" }, "children": { "allow": true }, "created": "2022-11-23T15:53:29.436323+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "f0a8b890-f97a-4eb2-9eac-8b8a712d3a6c", "links": {}, "metadata": { "curation_policy": "The EU Open Research Repository serves as a repository for research outputs (data, software, posters, presentations, publications, etc) which have been funded under an EU research funding programme such as Horizon Europe, Euratom or earlier Framework Programmes.
\nThe community is managed by CERN on behalf of the European Commission.
\nZenodo’s general policies and Terms of Use apply to all content.
\nThe EU Open Research Repository accepts all digital research objects which is a research output stemming from one of EU’s research and innovation funding programmes. The funding programmes currently include:
\nHorizon Europe (including ERC, MSCA), earlier Framework Programmes (eg Horizon 2020) as well as Euratom.
\nIn line with the principle as open as possible, as closed as necessary both public and restricted content is accepted. See note on how Zenodo handles restricted content.
\nEU programme beneficiaries are eligible to submit content to the community. The community supports three types of content submissions:
\nSubmission via an EU Project Community (through user interface or programmatic APIs).
\nSubmission directly to the EU Open Research Repository.
\nAutomated harvesting from existing Zenodo content.
\nA representative of an EU project may request an EU Project Community and invite other project participants as members of the community. The project community is linked to one or more European Commission grants. All records in the project community are automatically integrated into the EU Open Research Repository immediately upon acceptance into the project community.
\nAny user may submit a record directly to the EU Open Research Repository. The submission will be moderated by Zenodo staff for compliance with the minimal required metadata requirements and its correctness.
\nRecords found among Zenodo’s existing content will on a regular basis automatically be integrated if they are found to comply with the requirements. The submissions through this method are integrated into the EU Open Research Repository with delay in a fully automated way.
\nRecords in the EU Open Research Repository are required to comply with the following minimal metadata requirements:
\nVisibility: Both public and restricted (with or without embargo and/or access request)
\nResource types: All resource types.
\nLicenses: Public and embargoed records MUST specify a license. The chosen license SHOULD be compliant with the Horizon Europe open science requirements (see Open Science in Horizon Europe)
\nFunding information: Records MUST specify at least one grant from the European Commission.
\nCreators: Creators SHOULD be identified with a persistent identifier (e.g. ORCID, GND, …), and affiliations SHOULD be identified with a persistent identifier (e.g. ROR, ISNI, …)
\nSubjects: Records SHOULD specify one or more fields of science from the European Science Vocabulary.
\nThese metadata requirements comes from the related open science requirements in Horizon Europe which are detailed in each project's grant agreement.
\nAll submissions undergo automated curation checks for compliance with the policy. Submissions through project communities are in addition reviewed by the project community. Submission directly to the EU Open Research Repository is in addiotn reviewed by Zenodo staff.
\nCommunity curators may at any point edit metadata of the records in the community without notice through human or automated processing. The curators may at their sole discretion remove records from the community that are deemed not to comply with the content and curation policy or which are deemed of insufficient quality.
\nThe content and curation policy is subject to change by the community owner at any time and without notice, other than through updating this page.
", "description": "Open repository for EU-funded research outputs from Horizon Europe, Euratom, and earlier Framework Programmes.", "funding": [ { "funder": { "id": "00k4n6c32" } } ], "organizations": [ { "id": "00k4n6c32" } ], "page": "The EU Open Research Repository is a Zenodo-community dedicated to fostering open science and enhancing the visibility and accessibility of research outputs funded by the European Union. The community is managed by CERN on behalf of the European Commission.
\nThe mission of the repository is to support the implementation of the EU's open science policy, providing a trusted and comprehensive space for researchers to share their research outputs such as data, software, reports, presentations, posters and more. The EU Open Research Repository simplifies the process of complying with open science requirements, ensuring that research outputs from Horizon Europe, Euratom, and earlier Framework Programmes are freely accessible, thereby accelerating scientific discovery and innovation.
\nThe EU Open Research Repository serves as a complementary platform to the Open Research Europe (ORE) publishing platform. Open Research Europe focuses on providing a publishing venue for peer-reviewed articles, ensuring that research meets rigorous academic standards. The EU Open Research Repository provides a space for all the other research outputs including data sets, software, posters, and presentations that are out of scope for ORE. This holistic approach enables researchers to not only publish their findings but also share the underlying data and materials that support their work, fostering transparency and reproducibility in the scientific process.
\nThe EU Open Research Repository is funded by the European Union under grant agreement no. 101256740 (HORIZON-ZEN Plus). For more information about the project see https://about.zenodo.org/projects/horizon-zen/.
", "title": "EU Open Research Repository", "type": { "id": "organization" }, "website": "https://research-and-innovation.ec.europa.eu" }, "revision_id": 24, "slug": "eu", "theme": { "brand": "horizon", "enabled": true, "style": { "font": { "family": "Arial, sans-serif", "size": "16px", "weight": 600 }, "mainHeaderBackgroundColor": "#FFFFFF", "primaryColor": "#004494", "primaryTextColor": "#FFFFFF", "secondaryColor": "#FFD617", "secondaryTextColor": "#000000", "tertiaryColor": "#e3eefd", "tertiaryTextColor": "#1c5694" } }, "updated": "2026-03-31T12:29:43.596724+00:00" }, "revision_id": 2, "slug": "ai4media", "updated": "2024-12-18T12:27:16.405455+00:00" }, { "access": { "member_policy": "open", "members_visibility": "public", "record_submission_policy": "open", "review_policy": "open", "visibility": "public" }, "children": { "allow": false }, "created": "2016-02-24T11:45:04+00:00", "custom_fields": { "subjects": [ { "id": "mesh:D000090963" }, { "id": "mesh:D015510" }, { "id": "mesh:D001695" }, { "id": "gemet:concept/4805" } ] }, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "ac1da43f-69ad-46f3-891e-9b4b263be265", "links": {}, "metadata": { "curation_policy": "The researcher shall deposit their published articles on Zenodo following the legal aspects on self-archiving and Open Access on repositories. FBM/CHUV researchers who would like to deposit and give free Open Access to their data underlying their publications can contact the FBM publication management unit Cecile.lebrand@chuv.ch. We will help you with metadata standards for datasets, file formats for long term datasets storage and re-use, data copyright, licenses and self-archiving rules.
", "description": "This community brings together the Faculty of Biology and Medicine's research output at UNIL and CHUV as open-access datasets, usually linked to publications, covering life and biomedical sciences as well as de-identified clinical data.", "organizations": [ { "id": "019whta54" }, { "id": "05a353079" } ], "page": "http://www.bium.ch/en/publication-open-access/data-management/
", "title": "Faculty of Biology and Medicine at University of Lausanne and Lausanne University Hospital", "type": { "id": "organization" }, "website": "https://www.unil.ch/fbm/en/home.html" }, "revision_id": 3, "slug": "fbm_chuv", "updated": "2026-02-11T15:48:30.265744+00:00" }, { "access": { "member_policy": "open", "members_visibility": "public", "record_submission_policy": "open", "review_policy": "open", "visibility": "public" }, "children": { "allow": false }, "created": "2015-01-15T16:50:11+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "eee0697c-6156-4fc8-8e88-179ada901056", "links": {}, "metadata": { "curation_policy": "", "page": "The University of Cambridge is committed to disseminating its research and scholarship as widely as possible. In keeping with this commitment, it supports the principle that the results of its research that have been publicly funded should be freely accessible, and therefore supports its staff in making their research available.
\r\n\r\nThe University of Cambridge Zenodo Community policy framework
\r\n\r\nLast updated: July 2015
\r\n\r\nGeneral principles on research data deposition into the University of Cambridge Zenodo Community
\r\n\r\nThe University of Cambridge is committed to disseminating its research and scholarship as widely as possible. In keeping with this commitment, it supports the principle that the results of its research that have been publicly funded should be freely accessible, and therefore supports its staff in making their research available.
\r\n\r\nThe University affirms respect for disciplinary and sub-disciplinary norms and for each individual's intellectual investment, recognising that data underpinning research varies from the creation of new data through experimentation or survey through to the extraction of information from sources where the copyright is externally held, such as from published and unpublished texts, archives, works of art, musical manuscripts etc. The University of Cambridge expects its members (staff, researchers and research students, hereafter referred to as ‘researchers’) submitting their data to the University of Cambridge Zenodo Community to respect all of the above, and also to abide by the University of Cambridge Research Data Policy Framework.
\r\n\r\nThe University of Cambridge Zenodo Community is managed and curated by the Community Manager (a member of the University of Cambridge Open Data team: http://www.data.cam.ac.uk/data-team).
\r\n\r\nBackground:
\r\n\r\n\r\n\r\n
Responsibilities of the University researchers submitting their data to the University of Cambridge Zenodo Community:
\r\n\r\nDisclaimer:
\r\n\r\nThe University of Cambridge is not responsible for the content of research data submitted to the University of Cambridge Zenodo Community. Data submitters are solely responsible for the quality and content of the submitted data files.
", "title": "University of Cambridge Zenodo Community" }, "revision_id": 0, "slug": "cambridge", "updated": "2017-04-27T12:10:01.824718+00:00" }, { "access": { "member_policy": "open", "members_visibility": "restricted", "record_submission_policy": "open", "review_policy": "closed", "visibility": "public" }, "children": { "allow": true }, "created": "2022-11-23T15:53:29.436323+00:00", "custom_fields": {}, "deletion_status": { "is_deleted": false, "status": "P" }, "id": "f0a8b890-f97a-4eb2-9eac-8b8a712d3a6c", "links": {}, "metadata": { "curation_policy": "The EU Open Research Repository serves as a repository for research outputs (data, software, posters, presentations, publications, etc) which have been funded under an EU research funding programme such as Horizon Europe, Euratom or earlier Framework Programmes.
\nThe community is managed by CERN on behalf of the European Commission.
\nZenodo’s general policies and Terms of Use apply to all content.
\nThe EU Open Research Repository accepts all digital research objects which is a research output stemming from one of EU’s research and innovation funding programmes. The funding programmes currently include:
\nHorizon Europe (including ERC, MSCA), earlier Framework Programmes (eg Horizon 2020) as well as Euratom.
\nIn line with the principle as open as possible, as closed as necessary both public and restricted content is accepted. See note on how Zenodo handles restricted content.
\nEU programme beneficiaries are eligible to submit content to the community. The community supports three types of content submissions:
\nSubmission via an EU Project Community (through user interface or programmatic APIs).
\nSubmission directly to the EU Open Research Repository.
\nAutomated harvesting from existing Zenodo content.
\nA representative of an EU project may request an EU Project Community and invite other project participants as members of the community. The project community is linked to one or more European Commission grants. All records in the project community are automatically integrated into the EU Open Research Repository immediately upon acceptance into the project community.
\nAny user may submit a record directly to the EU Open Research Repository. The submission will be moderated by Zenodo staff for compliance with the minimal required metadata requirements and its correctness.
\nRecords found among Zenodo’s existing content will on a regular basis automatically be integrated if they are found to comply with the requirements. The submissions through this method are integrated into the EU Open Research Repository with delay in a fully automated way.
\nRecords in the EU Open Research Repository are required to comply with the following minimal metadata requirements:
\nVisibility: Both public and restricted (with or without embargo and/or access request)
\nResource types: All resource types.
\nLicenses: Public and embargoed records MUST specify a license. The chosen license SHOULD be compliant with the Horizon Europe open science requirements (see Open Science in Horizon Europe)
\nFunding information: Records MUST specify at least one grant from the European Commission.
\nCreators: Creators SHOULD be identified with a persistent identifier (e.g. ORCID, GND, …), and affiliations SHOULD be identified with a persistent identifier (e.g. ROR, ISNI, …)
\nSubjects: Records SHOULD specify one or more fields of science from the European Science Vocabulary.
\nThese metadata requirements comes from the related open science requirements in Horizon Europe which are detailed in each project's grant agreement.
\nAll submissions undergo automated curation checks for compliance with the policy. Submissions through project communities are in addition reviewed by the project community. Submission directly to the EU Open Research Repository is in addiotn reviewed by Zenodo staff.
\nCommunity curators may at any point edit metadata of the records in the community without notice through human or automated processing. The curators may at their sole discretion remove records from the community that are deemed not to comply with the content and curation policy or which are deemed of insufficient quality.
\nThe content and curation policy is subject to change by the community owner at any time and without notice, other than through updating this page.
", "description": "Open repository for EU-funded research outputs from Horizon Europe, Euratom, and earlier Framework Programmes.", "funding": [ { "funder": { "id": "00k4n6c32" } } ], "organizations": [ { "id": "00k4n6c32" } ], "page": "The EU Open Research Repository is a Zenodo-community dedicated to fostering open science and enhancing the visibility and accessibility of research outputs funded by the European Union. The community is managed by CERN on behalf of the European Commission.
\nThe mission of the repository is to support the implementation of the EU's open science policy, providing a trusted and comprehensive space for researchers to share their research outputs such as data, software, reports, presentations, posters and more. The EU Open Research Repository simplifies the process of complying with open science requirements, ensuring that research outputs from Horizon Europe, Euratom, and earlier Framework Programmes are freely accessible, thereby accelerating scientific discovery and innovation.
\nThe EU Open Research Repository serves as a complementary platform to the Open Research Europe (ORE) publishing platform. Open Research Europe focuses on providing a publishing venue for peer-reviewed articles, ensuring that research meets rigorous academic standards. The EU Open Research Repository provides a space for all the other research outputs including data sets, software, posters, and presentations that are out of scope for ORE. This holistic approach enables researchers to not only publish their findings but also share the underlying data and materials that support their work, fostering transparency and reproducibility in the scientific process.
\nThe EU Open Research Repository is funded by the European Union under grant agreement no. 101256740 (HORIZON-ZEN Plus). For more information about the project see https://about.zenodo.org/projects/horizon-zen/.
", "title": "EU Open Research Repository", "type": { "id": "organization" }, "website": "https://research-and-innovation.ec.europa.eu" }, "revision_id": 24, "slug": "eu", "theme": { "brand": "horizon", "enabled": true, "style": { "font": { "family": "Arial, sans-serif", "size": "16px", "weight": 600 }, "mainHeaderBackgroundColor": "#FFFFFF", "primaryColor": "#004494", "primaryTextColor": "#FFFFFF", "secondaryColor": "#FFD617", "secondaryTextColor": "#000000", "tertiaryColor": "#e3eefd", "tertiaryTextColor": "#1c5694" } }, "updated": "2026-03-31T12:29:43.596724+00:00" } ], "ids": [ "8538384b-cd84-4cc6-a77c-c259e9568dfd", "ac1da43f-69ad-46f3-891e-9b4b263be265", "eee0697c-6156-4fc8-8e88-179ada901056", "f0a8b890-f97a-4eb2-9eac-8b8a712d3a6c" ] }, "id": "7051657", "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.7051657", "provider": "datacite" } } }, "pids": { "doi": { "client": "datacite", "identifier": "10.5281/zenodo.7051658", "provider": "datacite" }, "oai": { "identifier": "oai:zenodo.org:7051658", "provider": "oai" } }, "revision_id": 7, "stats": { "all_versions": { "data_volume": 2114190267230.0, "downloads": 365, "unique_downloads": 255, "unique_views": 5841, "views": 7770 }, "this_version": { "data_volume": 2114190267230.0, "downloads": 365, "unique_downloads": 255, "unique_views": 5807, "views": 7726 } }, "status": "published", "swh": {}, "updated": "2022-11-29T09:49:48.613681+00:00", "versions": { "index": 1, "is_latest": true } }