Dataset for Steps Towards Mining Manuscript Images for Untranscribed Texts: A Case Study From the Syriac Collection at the Vatican Library
Authors/Creators
- 1. École Pratique des Hautes Études
-
2.
Archéologie et Philologie d'Orient et d'Occident
-
3.
Beth Mardutho
-
4.
Princeton University
Description
This repository contains data for the article "Steps Towards Mining Manuscript Images for Untranscribed Texts: A Case Study From the Syriac Collection at the Vatican Library" CHR 2024: Computational Humanities Research Conference, December 4–6, 2024, Aarhus, Denmark.
Digital libraries and databases of texts are invaluable resources for researchers, yet their reliance on printed editions can lead to significant gaps and potentially exclude works without printed reproductions. The Simtho database of Syriac serves as a pertinent example: it is derived primarily from OCR of scholarly editions, but how representative are these of the language's extensive literary tradition, transmitted and preserved in manuscript form for centuries? Taking the Simtho database and a selection of the Vatican Library's Syriac manuscript collection as a case study, we propose a pipeline that aligns a corpus of e-texts with a set of digitised manuscript images, in order to ascertain the presence or absence of texts between the e-text and manuscript corpora and thus contribute to their enrichment. We delve into the complexities of this task, evaluating both effective tools for alignment and approaches to detect factors that can contribute to alignment failures. This case study is intended as a first step towards foundational methodologies applicable to larger-scale manuscript processing efforts.
Technical info (English)
"list_of_images.txt" contains the links to the images of Syriac manuscripts on the IIIF server of the Vatican library.
"automatic_transcriptions.zip" contains alto 4.2 XML files with the segmentation and automatic transcription of these images.
"Overall_results_n7_lev_0.7.tsv" contains a list of all 5660 alignments between the altos resulting from automatic transcription and the textual ground truth from Simtho with 7 columns: id (of the alignment), filename (of the alto), GT_id (of the Simtho part), ocr_lines_in_part, total_aligned_lines (between this alto and this txt), aligned_lines_ratio (proportion of previous), max_aligned_clusters_size (number of lines of longest continuous aligned cluster on this page).