NER models from "A Benchmark of Named Entity Recognition Approaches in Historical Documents Application to 19th Century French Directories", DAS22 workshop on document analysis systems.
Authors/Creators
- 1. IGN
- 2. EPITA
- 3. EHESS
Description
About
NER models created for the evaluation of Optical Character Recognition (OCR) and Named Entity Recognition (NER) on 19th century French documents, presented in
Abadie, N., Carlinet, E., Chazalon, J., Duménieu, B. (2022). A Benchmark of Named Entity Recognition Approaches in Historical Documents Application to 19𝑡ℎ Century French Directories. In: Uchida, S., Barney, E., Eglin, V. (eds) Document Analysis Systems. DAS 2022. Lecture Notes in Computer Science, vol 13237. Springer, Cham. https://doi.org/10.1007/978-3-031-06555-2_30
All models can be replicated using the notebooks available on the GitHub repository https://github.com/soduco/paper-ner-bench-das22.
NER models
All models follow the same naming scheme `das22-{step}-{name}` where:
- {step} designate the step in the NER evaluation pipeline where this model has been trained, correspoding to a notebook in `src/ner`.
- {name} is the name of the model. All CamemBERT models are also available on [the HuggingFace hub](https://huggingface.co/HueyNemud).
Note that not all models used in the paper are published here. Specifically, this deposit does not store the models trained on subsets of the gold dataset for the experiment #1 but they can be trained using the notebooks available in `src/ner`.
- **das22-10-camembert_pretrained**: an [off-the-shelf CamemBERT model](https://huggingface.co/Jean-Baptiste/camembert-ner) available on the HuggingFace hub, pre-trained on 845k raw directory entries using a masked language modeling task. This model is intended for further training for NER on the gold (reference and OCR) annotated data. This model can be trained in `10-camembert_pretraining.ipynb`.
- **das22-20-spacy_best_6373**: a SpaCy NER pipeline trained on the full gold dataset for experiment #1 containing 6373 entries. This model can be trained in `20-experiment_1.ipynb`.
- **das22-22-camembert_6373**: an [off-the-shelf CamemBERT model](https://huggingface.co/Jean-Baptiste/camembert-ner) fine-tuned for NER on our gold dataset.
- **das22-22-camembert_pretrained_6373**: the pretrained model `das22-10-camembert_pretrained`, fine-tuned for NER on our gold dataset.
- **das22-4\*-camembert-\***: CamemBERT pretrained or "simple" fine-tuned on the reference gold dataset or on the noisy OCR gold with projected annotations.
Files
22-camembert_finetuned_6373.zip
Files
(7.8 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:7acf9b1259006308c5c8dcc8447b495c
|
1.1 GB | Preview Download |
|
md5:9990a62365fc93f460a2f4e206bffc1e
|
1.1 GB | Preview Download |
|
md5:21225746cb5711d22be9c1d2c0382658
|
823.4 MB | Preview Download |
|
md5:fa94d59ea72b4a652bb8a205616dd084
|
550.1 MB | Preview Download |
|
md5:c1597914c9c08215e5a336977b89c1ff
|
1.1 GB | Preview Download |
|
md5:222913158190e7d5a6548be98ac642bb
|
1.1 GB | Preview Download |
|
md5:06254ee636500c8cc7bb9b957996fd80
|
1.1 GB | Preview Download |
|
md5:f0ef7fbce20fea6f3545b40814c7d89c
|
1.1 GB | Preview Download |
|
md5:938aba15afdc84f91906b6181bf28030
|
2.3 kB | Preview Download |
Additional details
Funding
- Agence Nationale de la Recherche
- SoDUCo - Social Dynamics in Urban Context: open tools, models, and data -- Paris and its suburbs, 1789-1950 ANR-18-CE38-0013