Dataset Open Access

MESINESP: Medical Semantic Indexing in Spanish - Development dataset

Martin Krallinger; Aitor Gonzalez-Agirre; Alejandro Asensio


Citation Style Language JSON Export

{
  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.3746596", 
  "language": "spa", 
  "title": "MESINESP: Medical Semantic Indexing in Spanish - Development dataset", 
  "issued": {
    "date-parts": [
      [
        2020, 
        4, 
        9
      ]
    ]
  }, 
  "abstract": "<p><strong>Introduction</strong></p>\n\n<p>The Mesinesp (Spanish BioASQ track, see https://temu.bsc.es/mesinesp) development set has a total of 750 records indexed manually by seven experienced medical literature indexers. Indexing is done using <em>DeCS codes, a sort of Spanish equivalent to MeSH terms</em>. Records were distributed in a way that each article was annotated, at least, by two different human indexers.</p>\n\n<p>The data annotation process consisted in two steps:</p>\n\n<ol>\n\t<li>Manual indexing step. DeCS codes were manually assigned to each record following the DeCS manual indexing guidelines.</li>\n\t<li>Manual validation and consensus. The joined set of manually indexed DeCS codes generated by both indexers were manually revised and corrections were done.</li>\n</ol>\n\n<p>These annotations were analyzed, resulting in an agreement using the Jaccard index.</p>\n\n<p>Records consisted basically in medical literature abstracts and titles from the IBECS and LILACS databases.</p>\n\n<p><strong>Zip structure</strong><br>\nThe zip file contains two different development sets:</p>\n\n<ul>\n\t<li><em>Official development set</em>, which has the union of the annotations, with an agreement of macro = 0.6568 and micro = 0.6819. This set is composed by all the different (unique) DeCS codes that have been added by any annotator for each document; and</li>\n\t<li><em>Core-descriptors development set</em>, which has the intersection of the annotations, with an agreement of macro = 1.0 and micro = 1.0. This set is composed of the common DeCS codes that have been added by two or more annotators for each document.</li>\n</ul>\n\n<p><strong>Corpus format</strong></p>\n\n<p>Each dataset is a JSON object with one single key named &quot;articles&quot;, which contains a list of documents. So, the raw format of the file is one line per document plus two additional lines (the first and the last) to enclose that list of documents and the expected type of data is as follows:</p>\n\n<pre><code class=\"language-json\">{\"articles\":[\n{\"abstractText\":str,\"db\":str,\"decsCodes\":list,\"id\":str,\"journal\":str,\"title\":str,\"year\":int},\n...\n]}</code></pre>\n\n<p>To clarify, the order of appearance of the fields in each document is as follows (note that this example it is pretty printed for readability purposes):</p>\n\n<pre><code class=\"language-json\">{\n  \"articles\": [\n    {\n      \"abstractText\": \"Content of the abstract\",\n      \"db\": \"Name of the source database\",\n      \"decsCodes\": [\n        \"code1\",\n        \"code2\",\n        \"code3\"\n      ],\n      \"id\": \"Id of the document\",\n      \"journal\": \"Name of the journal\",\n      \"title\": \"Title of the document\",\n      \"year\": 2019\n    }\n  ]\n}</code></pre>\n\n<p>Note: The fields &quot;db&quot;, &quot;journal&quot; and &quot;year&quot; might&nbsp;be null.</p>", 
  "author": [
    {
      "family": "Martin Krallinger"
    }, 
    {
      "family": "Aitor Gonzalez-Agirre"
    }, 
    {
      "family": "Alejandro Asensio"
    }
  ], 
  "note": "Funded by the Plan de Impulso de las Tecnolog\u00edas del Lenguaje (Plan TL).", 
  "version": "1.0.0", 
  "type": "dataset", 
  "id": "3746596"
}
281
47
views
downloads
All versions This version
Views 281281
Downloads 4747
Data volume 48.3 MB48.3 MB
Unique views 242242
Unique downloads 4444

Share

Cite as