Planned intervention: On Wednesday April 3rd 05:30 UTC Zenodo will be unavailable for up to 2-10 minutes to perform a storage cluster upgrade.

There is a newer version of the record available.

Published March 22, 2022 | Version v2.0
Dataset Open

HIPE-2022 Shared Task Named Entity Datasets

  • 1. EPFL
  • 2. University of Lausanne
  • 3. University of La Rochelle
  • 4. University of Zurich

Description

HIPE-2022 datasets used for the HIPE 2022 shared task on named entity recognition and classification (NERC) and entity linking (EL) in multilingual historical documents

HIPE-2022 datasets are based on six primary datasets assembled and prepared for the shared task. Primary datasets are composed of historical newspapers and classic commentaries covering ca. 200 years, feature several languages and different entity tag sets and annotation schemes. They originate from several European cultural heritage projects, from HIPE organizers’ previous research project, and from the previous HIPE-2020 campaign. Some are already published, others are released for the first time for HIPE-2022.

The HIPE-2022 shared task assembles and prepares these primary datasets in HIPE-2022 release(s), which correspond to a single package composed of neatly structured and homogeneously formatted files.

Primary datasets undergo the following preparation steps:

  • conversion to the HIPE format (with correction of data inconsistencies and metadata consolidation);
  • rearrangement or composition of train and dev splits.

Please also refer to:

Here is an overview of the primary datasets:

Dataset alias

Readme

Document type

Languages

Suitable for

Project

hipe2020

link

historical newspapers

de, fr, en

NERC-Coarse, NERC-Fine, EL

CLEF-HIPE-2020

newseye

link

historical newspapers

de, fi, fr, sv

NERC-Coarse, NERC-Fine, EL

NewsEye

sonar

link

historical newspapers

de

NERC-Coarse, EL

SoNAR

letemps

link

historical newspapers

fr

NERC-Coarse, NERC-Fine

LeTemps

topres19th

link

historical newspapers

en

NERC-Coarse, EL

Living with Machines

ajmc

link

classical commentaries

de, fr, en

NERC-Coarse, NERC-Fine, EL

AjMC

 

The HIPE-2022 team expresses her greatest appreciation to the partnering projects, namely AJMC, impresso, HIPE-2020, Living with Machines, NewsEye, and SoNAR, for contributing their NE-annotated datasets (and hiding a part thereof for the time of the evaluation campaign).

Notes

New releases are planned. Check the HIPE-2022 website for updates.

Files

HIPE-2022-data-2.0.zip

Files (13.6 MB)

Name Size Download all
md5:4f5b56caf15d09b6956b59f6d939ffc5
13.6 MB Preview Download

Additional details

Related works

Is derived from
Dataset: 10.5281/zenodo.6046853 (DOI)
Dataset: 10.5281/zenodo.4573313 (DOI)
Dataset: https://zenodo.org/record/6046853 (URL)
Dataset: 10.23636/b1c4-py78 (DOI)
Is documented by
Technical note: 10.5281/zenodo.6045662 (DOI)