Dataset Open Access

MESINESP: Medical Semantic Indexing in Spanish - Development dataset

Martin Krallinger; Aitor Gonzalez-Agirre; Alejandro Asensio

MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="">
  <datafield tag="999" ind1="C" ind2="5">
    <subfield code="x">Krallinger M, Krithara A, Nentidis A, Paliouras G, Villegas M. BioASQ at CLEF2020: Large-Scale Biomedical Semantic Indexing and Question Answering. InEuropean Conference on Information Retrieval 2020 Apr 14 (pp. 550-556). Springer, Cham.</subfield>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">spa</subfield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">indexing</subfield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">decs</subfield>
  <controlfield tag="005">20221105071903.0</controlfield>
  <datafield tag="500" ind1=" " ind2=" ">
    <subfield code="a">Funded by the Plan de Impulso de las Tecnologías del Lenguaje (Plan TL).</subfield>
  <controlfield tag="001">3746596</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Barcelona Supercomputing Center</subfield>
    <subfield code="a">Aitor Gonzalez-Agirre</subfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Barcelona Supercomputing Center</subfield>
    <subfield code="a">Alejandro Asensio</subfield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1027643</subfield>
    <subfield code="z">md5:58da931670a51b078cc5e193aa9d91e1</subfield>
    <subfield code="u"></subfield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2020-04-09</subfield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">user-medicalnlp</subfield>
    <subfield code="o"></subfield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Barcelona Supercomputing Center</subfield>
    <subfield code="0">(orcid)0000-0002-2646-8782</subfield>
    <subfield code="a">Martin Krallinger</subfield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">MESINESP: Medical Semantic Indexing in Spanish - Development dataset</subfield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-medicalnlp</subfield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u"></subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2"></subfield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;&lt;em&gt;&lt;strong&gt;Please use the &lt;a href=""&gt;MESINESP2 corpus (the second edition of the shared-task)&lt;/a&gt; since it has a higher level of curation, quality and is organized by document type (scientific articles, patents and clinical trials).&lt;/strong&gt;&lt;/em&gt;&lt;/p&gt;




&lt;p&gt;The Mesinesp (Spanish BioASQ track, see development set has a total of 750 records indexed manually by seven experienced medical literature indexers. Indexing is done using &lt;em&gt;DeCS codes, a sort of Spanish equivalent to MeSH terms&lt;/em&gt;. Records were distributed in a way that each article was annotated, at least, by two different human indexers.&lt;/p&gt;

&lt;p&gt;The data annotation process consisted in two steps:&lt;/p&gt;

	&lt;li&gt;Manual indexing step. DeCS codes were manually assigned to each record following the DeCS manual indexing guidelines.&lt;/li&gt;
	&lt;li&gt;Manual validation and consensus. The joined set of manually indexed DeCS codes generated by both indexers were manually revised and corrections were done.&lt;/li&gt;

&lt;p&gt;These annotations were analyzed, resulting in an agreement using the Jaccard index.&lt;/p&gt;

&lt;p&gt;Records consisted basically in medical literature abstracts and titles from the IBECS and LILACS databases.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Zip structure&lt;/strong&gt;&lt;br&gt;
The zip file contains two different development sets:&lt;/p&gt;

	&lt;li&gt;&lt;em&gt;Official development set&lt;/em&gt;, which has the union of the annotations, with an agreement of macro = 0.6568 and micro = 0.6819. This set is composed by all the different (unique) DeCS codes that have been added by any annotator for each document; and&lt;/li&gt;
	&lt;li&gt;&lt;em&gt;Core-descriptors development set&lt;/em&gt;, which has the intersection of the annotations, with an agreement of macro = 1.0 and micro = 1.0. This set is composed of the common DeCS codes that have been added by two or more annotators for each document.&lt;/li&gt;

&lt;p&gt;&lt;strong&gt;Corpus format&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Each dataset is a JSON object with one single key named &amp;quot;articles&amp;quot;, which contains a list of documents. So, the raw format of the file is one line per document plus two additional lines (the first and the last) to enclose that list of documents and the expected type of data is as follows:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-json"&gt;{"articles":[

&lt;p&gt;To clarify, the order of appearance of the fields in each document is as follows (note that this example it is pretty printed for readability purposes):&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-json"&gt;{
  "articles": [
      "abstractText": "Content of the abstract",
      "db": "Name of the source database",
      "decsCodes": [
      "id": "Id of the document",
      "journal": "Name of the journal",
      "title": "Title of the document",
      "year": 2019

&lt;p&gt;Note: The fields &amp;quot;db&amp;quot;, &amp;quot;journal&amp;quot; and &amp;quot;year&amp;quot; might&amp;nbsp;be null.&lt;/p&gt;

&lt;p&gt;Copyright (c) 2020 Secretar&amp;iacute;a de Estado de Digitalizaci&amp;oacute;n e Inteligencia Artificial&lt;/p&gt;</subfield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.3746595</subfield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.3746596</subfield>
    <subfield code="2">doi</subfield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
All versions This version
Views 736736
Downloads 111111
Data volume 114.1 MB114.1 MB
Unique views 647647
Unique downloads 101101


Cite as