CLLG Segmentation
Description
Layout and reading-order ground truth for printed Greek (and related Latin, Italian, French, English) editions, in one normalised ALTO v4 format with one vocabulary, for region, baseline and reading-order models (kraken 7 / dfine_kraken).
355 pages, 87 documents, 15554 lines, 3956 regions.
Rights and access (read first)
Only the annotations are released under CC BY 4.0. That means everything we produced: baselines, polygon masks, region boxes and types, reading order, the train/val/test split, manifest.tsv, works.tsv, vocab.* and TYPES.md. The XML files are CC BY 4.0 except the transcription in String CONTENT of the bd pages (see below).
The material underneath the annotations keeps its own rights:
| subset | pages | page images (data/*.png) |
text in the ALTO (CONTENT) |
|---|---|---|---|
bd |
183 | rendered from copyrighted editions: all rights reserved | read from the PDF text layer of copyrighted editions: all rights reserved |
sc, qw |
172 | scans of copyrighted editions: all rights reserved | none |
So the CC BY licence does not cover the bd, sc and qw images nor the bd text. Do not redistribute them. Consequences for Zenodo:
- publish the whole record with Restricted access (or Embargoed), the licence field being CC BY 4.0 for the annotations only; or
- publish openly only the annotations (ALTO XML without the
bdCONTENT, manifest, splits, vocabulary) and keep every image out of the public files.
htr-united.yml states the same split.
Citation
See CITATION.cff and htr-united.yml. DOI: 10.5281/zenodo.TODO.
Provenance and method
bd pages: geometry read from the PDF text layer (pdf2seg.py). sc, qw pages: kraken + cllg-segmentation model, then corrected by reviewers. The former greek-ds pages are not part of this dataset (their corrections were applied to greek-ds itself). Production software: kraken 7.1.1, dfine_kraken 0.4.4. Scripts (not in this archive) live in the cllg-closed-segmentation working repository.
Contents
data/<id>.xml + <id>.png one page = ALTO + image side by side (fileName in the XML = <id>.png)
splits/{train,val,test}.lst XML paths relative to this folder (document-level split, see below)
manifest.tsv id, source, doc, page, width, height, regions, lines, has_text, title, split
stats.json counts per type and split
vocab.yml / vocab.json the vocabulary, line type per region type, tag ids
TYPES.md definition of every type and how it was decided
works.tsv one row per document: author, title, collection, year, pages, lines, characters, split
Works
87 documents. Src is the subset (see below); characters are counted only where the ALTO carries a transcription (bd). Author, collection and year are recovered from the source file names and book metadata, — when unknown. Same table in works.tsv.
| Author / editor | Title | Collection | Year | Directory (doc) |
Src | Pages | Lines | Characters | Split |
|---|---|---|---|---|---|---|---|---|---|
| Aristoteles; Hermann Weidemann | Aristotle, De Interpretatione | Teubner | 2014 | aristotle_deint |
bd | 9 | 376 | 20,541 | train |
| Athenaeus Naucratites; S Douglas Olson | Athenaeus, Deipnosophistae IIA | Teubner | 2021 | athenaeus |
bd | 10 | 444 | 19,787 | train |
| Most, Glenn W.; Torres, José B. | Cornutus, Theologiae Graecae Compendium | Teubner | 2018 | cornutus |
bd | 9 | 386 | 21,611 | train |
| Epictetus, Gerard Boter | Epictetus, Encheiridion | Teubner | 2007 | epictetus |
bd | 8 | 316 | 18,335 | train |
| Hermias Alexandrinus, Carlo M Lucarini, Claudio Moreschini | Hermias, Scholia in Phaedrum | Teubner | 2012 | hermias_phaedrum |
bd | 10 | 425 | 23,511 | test |
| Homer; Martin L. West | Homer, Odyssea | Teubner | 2017 | homer_odyssea |
bd | 10 | 441 | 19,830 | train |
| Nesselrath, Heinz-Günther | Julian, Opera | Teubner | 2015 | julian |
bd | 9 | 392 | 20,794 | train |
| Rudolf Kassel, Stephan Schröder | Menander, Dyscolus | De Gruyter | 2022 | menander |
bd | 10 | 368 | 11,951 | train |
| Theodorus Ioannis Metochites Polemis | Metochites, Orationes | Teubner | 2018 | metochites |
bd | 10 | 419 | 21,635 | train |
| Ioannes Philoponus | Philoponus, De usu astrolabii | Teubner | 2014 | philoponus_astrolabe |
bd | 9 | 345 | 17,700 | val |
| Gerard Boter, Flavius Philostratus | Philostratus, Vita Apollonii | Teubner | 2022 | philostratus |
bd | 10 | 421 | 25,626 | train |
| Phlegon Trallianus, Antonio Stramaglia | Phlegon, Opuscula | Teubner | 2010 | phlegon |
bd | 10 | 361 | 19,139 | test |
| Massimo Porphyrius Raffa | Porphyry, Commentary on Ptolemy's Harmonica | Teubner | 2016 | porphyry_harmonica |
bd | 9 | 390 | 18,247 | train |
| Cavarzeran, Jacopo | Scholia in Andromacham | De Gruyter | 2022 | scholia_andromache |
bd | 10 | 343 | 20,996 | train |
| Jacopo Cavarzeran | Scholia in Hippolytum | De Gruyter | 2016 | scholia_hippolytum |
bd | 10 | 383 | 22,902 | val |
| Georgios A. Xenis | Scholia vetera in Antigonam | De Gruyter | 2021 | scholia_antigone |
bd | 10 | 297 | 16,365 | train |
| Georgios A. Xenis | Scholia vetera in Oedipum Coloneum | De Gruyter | 2018 | scholia_oc |
bd | 10 | 334 | 19,843 | train |
| Georgios A. Xenis | Scholia vetera in Oedipum Tyrannum | De Gruyter | 2024 | scholia_ot |
bd | 10 | 328 | 18,928 | train |
| Stefano Valente | The Antiatticist | De Gruyter | 2015 | antiatticist |
bd | 10 | 419 | 26,043 | train |
| ANDRÉ WILMART, O. S. B. | ANALECTA REGINENSIA | STUDI E TESTI 59 | 1933 | qw_41ecf7f9 |
qw | 2 | 113 | — | train |
| FABIO ACERBI | BYZANTINE EASTER COMPUTI | STUDI E TESTI 562 | 2024 | qw_278992d2 |
qw | 2 | 80 | — | train |
| Fevronia Nousia | BYZANTINE TEXTBOOKS OF THE PALAEOLOGAN PERIOD | STUDI E TESTI 505 | 2016 | qw_e693522b |
qw | 2 | 17 | — | train |
| CERIANI-MERCATI | CARTEGGIO CERIANI-MERCATI 1893-1907 | — | 1893-1907 | qw_e42208d5 |
qw | 2 | 76 | — | val |
| Carolus Orestes ZURETTI | Catalogus Codicum Astrologorum Graecorum - Codices Hispanienses | Catalogus Codicum Astrologorum Graecorum, Tomi XI, Pars I | 1932 | qw_2e6208a9 |
qw | 2 | 96 | — | test |
| ARMANDUS DELATTE | CATALOGUS CODICUM ASTROLOGORUM GRAECORUM CODICES ATHENIENSES | CATALOGUS CODICUM ASTROLOGORUM GRAECORUM, TOMUS X. | 1924 | qw_cfd7f109 |
qw | 2 | 186 | — | train |
| Carolus Aemilius Ruelle, Iosepho Heeg | Catalogus Codicum Astrologorum Graecorum Codicum Parisinorum Partem Secundam Accedunt Hermetica | Tomi VIII Pars II | 1911 | qw_9e84f3c7 |
qw | 2 | 101 | — | test |
| Petrus Boudreaux | Catalogus Codicum Astrologorum Graecorum Codicum Parisinorum Partem Tertiam | Catalogus Codicum Astrologorum Graecorum, Tomi VIII Pars III | 1912 | qw_d5f6b63a |
qw | 2 | 192 | — | train |
| Hagiographi Bollandiani | Catalogus Codicum Hagiographicorum Latinorum Antiquiorum Saeculo XVI Qui Asservantur in Bibliotheca Nationali Parisiensi | Subsidia hagiographica n° 2 | 1893 | qw_773278ba |
qw | 2 | 99 | — | train |
| GUILHELMUS KROLL | CODICES VINDOBONENSES | VI | 1903 | qw_de0c6c8b |
qw | 2 | 96 | — | train |
| FRANCISCUS CUMONT ET FRANCISCUS BOLL | CODICUM ROMANORUM | — | 1904 | qw_7e121ac6 |
qw | 2 | 169 | — | train |
| A. ROME | COMMENTAIRES DE PAPPUS ET DE THÉON D'ALEXANDRIE SUR L'ALMAGESTE | STUDI E TESTI 106 | 1943 | qw_db55cc4d |
qw | 2 | 75 | — | train |
| Stefania FILOSINI | Epitalamio per Kuricio e Iberia | STUDI E TESTI TARDOANTICHI / PROFANE AND CHRISTIAN CULTURE IN LATE ANTIQUITY | — | qw_037840c4 |
qw | 2 | 52 | — | test |
| A D. IOANNE BONA E MONTE REGALI, Mons. Dott. MARCO VATTASSO | HORTUS CAELESTIUM DELICIARUM | STUDI E TESTI. 32. | 1918 | qw_afcaece5 |
qw | 2 | 87 | — | train |
| SANTAMAURA | I MANOSCRITTI GRAMMATICALI GRECI DEL CARD. GUGLIELMO SIRLETO (1514-1585) | — | — | qw_8be98be9 |
qw | 1 | 40 | — | train |
| Mario Naldini | Il Cristianesimo in Egitto | — | 1968 | qw_67f74366 |
qw | 2 | 125 | — | train |
| Vitalien Laurent, A. A. | LA VITA RETRACTATA ET LES MIRACLES POSTHUMES DE SAINT PIERRE D'ATROA | SUBSIDIA HAGIOGRAPHICA, n° 31 | 1958 | qw_7494c198 |
qw | 2 | 62 | — | train |
| D. FRANCESCO ANDREU, C. R. | LE LETTERE DI SAN GAETANO DA THIENE | STUDI E TESTI 177 | 1954 | qw_4828eb96 |
qw | 2 | 79 | — | train |
| RAYMOND TONNEAU, O. P. EN COLLABORATION AVEC ROBERT DEVREESE | LES HOMÉLIES CATÉCHÉTIQUES DE THÉODORE DE MOPSUESTE | STUDI E TESTI 145 | 1949 | qw_8db54fef |
qw | 2 | 68 | — | train |
| GARY B. BLUMENSHINE | LIBER ALCVINI CONTRA HAERESIM FELICIS | STUDI E TESTI 285 | 1980 | qw_c93798f8 |
qw | 2 | 107 | — | val |
| Franciscus DOELGER | M. KPITOU TOY ΠΑΤΖΗ ΤΙΠΟΥΚΕΙΤΟΣ LIBRORUM LX BASILICORUM SVMMARIVM LIBROS XIII-XXIII | STUDI E TESTI 51 | 1929 | qw_e546615d |
qw | 2 | 85 | — | train |
| PIO FRANCHI DE' CAVALIERI | NOTE AGIOGRAFICHE | STUDI E TESTI. 33. | 1920 | qw_9d8810e6 |
qw | 2 | 47 | — | train |
| PIO FRANCHI DE' CAVALIERI | NOTE AGIOGRAFICHE | STUDI E TESTI 175 | 1953 | qw_c00ae8b5 |
qw | 2 | 89 | — | train |
| ADRIANO VAN HECK | PII II COMMENTARII RERVM MEMORABILIVM QVE TEMPORIBVS SVIS CONTIGERVNT | STUDI E TESTI 312 | 1984 | qw_06f3dacd |
qw | 2 | 100 | — | val |
| W. CAVINI, M. C. DONNINI MACCIÒ, M. S. FUNGHI, D. MANETTI | STUDI SU PAPIRI GRECI DI LOGICA E MEDICINA | «STUDI» LXXIV | MCMLXXXV | qw_01b98bfc |
qw | 2 | 91 | — | train |
| Libanio | Sulla vendetta di Giuliano | — | — | qw_ee7ea0cb |
qw | 2 | 28 | — | train |
| Theokritos Kouremenos, George M. Parassoglou, Kyriakos Tsantsanoglou | THE DERVENI PAPYRUS | STUDI E TESTI PER IL CORPUS DEI PAPRI FILOSOFICI GRECI E LATINI 13 | MMVI | qw_fa32cc40 |
qw | 2 | 69 | — | train |
| EMMANUEL CANDAL, S. I. | TRACTATUS IOANNIS LEI O. P. « DE VISIONE BEATA » | STUDI E TESTI 228 | 1963 | qw_f5adc602 |
qw | 2 | 88 | — | train |
| W. W. HEIST | VITAE SANCTORUM HIBERNIAE | SUBSIDIA HAGIOGRAPHICA, No 28 | 1965 | qw_888f490b |
qw | 2 | 86 | — | train |
| W. W. HEIST | VITAE SANCTORUM HIBERNIAE | SUBSIDIA HAGIOGRAPHICA, No 28 | 1965 | qw_b284fc6b |
qw | 2 | 183 | — | train |
| Robert Aubreton | Anthologie grecque Tome XIII Anthologie de Planude | Belles Lettres (Budé) | 2002 | bude_143044125 |
sc | 3 | 108 | — | val |
| Anubio, Dirk Obbink | Anubio Carmen Astrologicum Elegiacum | Teubner | 2006 | teubner_138295843 |
sc | 3 | 137 | — | train |
| Iohan Ludvig Heiberg | Apollonii Pergaei quae Graece exstant cum commentariis antiquis Vol I | Teubner | 1974 | teubner_142971897 |
sc | 3 | 120 | — | train |
| Appianus; Paul Goukowsky | Appien Histoire romaine Tome VI Livre XI Le Livre Syriaque | Belles Lettres (Budé) | 2007 | bude_138893406 |
sc | 3 | 115 | — | train |
| Archimedes; Johan Ludvig Heiberg, Evangelos S. Stamatis | Archimedis opera omnia cum commentariis Eutocii Volumen I | Teubner | 1972 | teubner_137082896 |
sc | 3 | 100 | — | train |
| Archimedes; Johan Ludvig Heiberg, Evangelos S. Stamatis | Archimedis opera omnia cum commentariis Eutocii Volumen II | Teubner | 1972 | teubner_137082891 |
sc | 3 | 89 | — | train |
| Jean-René Vieillefond, Aristaenetus | Aristnte Lettres damour | Belles Lettres (Budé) | 1992 | bude_148666020 |
sc | 3 | 115 | — | test |
| Ptolemy (Claudius Ptolemaeus), Wolfgang Hübner | Claudii Ptolemaei Opera quae exstant omnia Apotelesmatika Volumen III 1 | Teubner | 1998 | teubner_136420966 |
sc | 3 | 228 | — | train |
| Michel Patillon; Aphthonius; Hermogenes | Corpus Rhetoricum tome I Anonyme Prambule la rhtorique Aphtonios Progymnasmata PseudoHerm | Belles Lettres (Budé) | 2008 | bude_140511936 |
sc | 3 | 230 | — | val |
| Iohannes Scottus Eriugena | De divina praedestinatione liber | cs | 1978 | cs_147065840 |
sc | 3 | 355 | — | test |
| — | Die Briefe 329 Des Ostsyrischen Patriarchen Timotheos I | — | — | cs |
sc | 2 | 98 | — | train |
| Konstanze Linke, Walter Haas, Susanne Neitzel | Die Fragmente des Grammatikers Dionysios Thrax Die Fragmente der Grammatiker Tyrannion und | De Gruyter | 1977 | degruyter_142968678 |
sc | 3 | 113 | — | train |
| Dionysius Halicarnaseus, Karl Jacoby | Dionysii Halicarnasei antiquitatum Romanarum quae supersunt Vol I Libri IIII | Teubner | 1995 | teubner_142973512 |
sc | 3 | 130 | — | test |
| Andrew R. Dyck | Epimerismi Homerici Pars 1 Epimerismos continens qui ad Iliadis librum A pertinent | De Gruyter | 1983 | degruyter_137060606 |
sc | 3 | 158 | — | val |
| John Tzetzes; Pietro Luigi Leone | Epistulae | Teubner | 1972 | teubner_138611525 |
sc | 3 | 237 | — | train |
| François Jouan, Herman Van Looy, Euripides | Euripide Tragdies Tome VIII 2e partie Fragments de Bellrophon Protsilas | Belles Lettres (Budé) | 2002 | bude_143028536 |
sc | 3 | 90 | — | train |
| I.L. Heiberg | Evcilidis elementa Vol IV Libri XIXIII cum appendicibus | Teubner | 1973 | teubner_142971814 |
sc | 3 | 106 | — | train |
| I.L. Heiberg | Evcilidis elementa Vol V Pars 2 Scholia in Libros VIXIII cum appendicibus | Teubner | 1977 | teubner_142971816 |
sc | 3 | 131 | — | train |
| Armelle Debru, Ivan Garofalo | Galien uvres Tome VIII LAnatomie des nerfs LAnatomie des veines et des artres | Belles Lettres (Budé) | 2008 | bude_138308238 |
sc | 3 | 79 | — | train |
| Maltese, Enrico V. | Georgii Gemisti Plethonis Opuscula de historia Graeca | Teubner | 1989 | teubner_138190182 |
sc | 3 | 170 | — | train |
| Lucarini, Carlo Martino | Herodianus Regnum post Marcum | Teubner | 2005 | teubner_138083289 |
sc | 3 | 185 | — | train |
| Ian C. Cunningham | Hesychii Alexandrini Lexicon Volumen V Indices | De Gruyter | 2022 | degruyter_142785291 |
sc | 3 | 226 | — | train |
| E. Brémond, Georges Mathieu; Isocrates | Isocrate Discours Tome II Pangyrique Plataque Nicocls Nicocls Evagoras Archidamos | Belles Lettres (Budé) | 1961 | bude_141527486 |
sc | 3 | 116 | — | train |
| James Willis | Martianus Capella | Teubner | 1983 | teubner_142974103 |
sc | 3 | 170 | — | train |
| Maximus Confessor; Janssens, Bart | Maximi Confessoris Ambigua ad Thomam una cum Epistula secunda ad eundem | cs | 2002 | cs_137945179 |
sc | 3 | 136 | — | train |
| Rudolf Kassel, Colin Austin | Menecrates Xenophon Volumen VII | De Gruyter | 1989 | degruyter_142962558 |
sc | 3 | 88 | — | train |
| Michael Psellus; George T. Dennis | Michaelis Pselli Orationes panegyricae | Teubner | 1994 | teubner_138842486 |
sc | 3 | 122 | — | train |
| J A Munitiz, Nicephorus Blemmydes | Nicephori Blemmydae Autobiographia sive curriculum vitae necnon epistula universalior | cs | 1984 | cs_146716930 |
sc | 3 | 217 | — | train |
| Hugo de Sancto Victore | Opera I De archa Noe Libellus de formatione arche | cs | 2001 | cs_148662013 |
sc | 3 | 144 | — | train |
| Lucas Tudensis | Opera omnia 2 De altera vita | cs | 2009 | cs_148395940 |
sc | 3 | 151 | — | train |
| Arnobius Iunior | Opera omnia Pars I Commentarii in Psalmos | cs | 1990 | cs_146583430 |
sc | 3 | 155 | — | test |
| Michael Psellus; Antony Robert Littlewood | Oratoria minora | Teubner | 2011 | teubner_138857253 |
sc | 3 | 144 | — | train |
| Philodemus; Daniel Delattre | Philodme de Gadara Sur la musique livre IV | Belles Lettres (Budé) | 2007 | bude_140628869 |
sc | 3 | 123 | — | train |
| R. Kassel, C. Austin | Poetae Comici Graeci Vol 1 Comoedia Dorica Mimi Phlyaces 1 | De Gruyter | 2001 | degruyter_138285538 |
sc | 3 | 255 | — | train |
| paus Gregorius I Magnus; Marc Adriaen | S Gregorii Magni Moralia in Job 3 | cs | — | cs_138346971 |
sc | 3 | 142 | — | train |
| Rudolf Westphal | Scriptores metrici graeci Vol 1 Hephaestionis De metris enchiridion et De poemate libellu | Teubner | 1866 | teubner_136653913 |
sc | 3 | 91 | — | train |
| Richardus Foerster | Scriptores physiognomonici Volume I Physiognomonica Pseudaristotelis Graece et Latine Adam | Teubner | 1994 | teubner_142973376 |
sc | 3 | 117 | — | train |
| Severus Sophista Alexandrinus, Eugenio Amato | Severus Sophista Alexandrinus Progymnasmata quae exstant omnia | Teubner | 2009 | teubner_142973363 |
sc | 3 | 89 | — | val |
Sources (source in the manifest, prefix of the id)
| source | pages | what |
|---|---|---|
bd |
183 | born-digital PDFs of Teubner / De Gruyter editions: baselines, regions and text read from the PDF text layer, masks computed by kraken; checked page by page |
sc |
113 | random pages of scanned editions (Budé, Sources Chrétiennes, Teubner, De Gruyter; also older and Byzantine / astronomical editions): kraken + cllg-segmentation, then corrected by reviewers (types, grouping, missing lines, reading order). No text |
qw |
59 | pages that an LLM flagged as starting a new work/section in books it judged to be editions; same correction as sc. No text |
Annotation (identical for every page)
- Lines:
BASELINEleft to right +Shape/Polygonmask (+String CONTENT, empty except forbdpages). - Regions: rectangles around their lines, one
TAGREFStype each. Regions are paragraph-level: every paragraph, scholion, bibliography entry, apparatus note group, margin-number column is its own region. - Types (same
<Tags>block, same ids, in every file): regionsMainZone-P, MainZone-Continued, MainZone-Head, MainZone-Lg, MainZone-Quote, NumberingZone, RunningTitleZone, MarginTextZone, ApparatusZone, TableZone, GraphicZone, DropCapitalZone; linesDefaultLine, DefaultLine-Margin, HeadingLine, ApparatusLine. The line type is derived from the region type (ApparatusZone→ApparatusLine,MarginTextZone→DefaultLine-Margin,MainZone-Head→HeadingLine, everything elseDefaultLine), so the two levels never contradict. - Reading order: explicit
<ReadingOrder><OrderedGroup ID="ro_0">over all lines (line ids l0001.. follow it). It interleaves regions (a margin number region is read between two lines of a text region), so it is NOT the document order: usero_0, never the implicit order. Region order (region_implicit) is the order of each region's first line. Convention: running head and page number first, then top to bottom; same row left to right (a left-hand margin number before its line, a right-hand one after); apparatus/footnotes after the text above them (in scholia: each scholion followed by its apparatus); columns left then right; tables row by row; double-page spreads: whole left page, then whole right page; Arabic rows right to left.
Split
Document level (a held-out book never appears in train), stratified by source (bd / sc / qw), seed 13: train 280 / val 37 / test 38 pages. Rare classes: MainZone-Quote (5 regions), TableZone (6), GraphicZone (2), DropCapitalZone (0), DefaultLine-Margin (89 lines); TableZone, GraphicZone and DropCapitalZone may have no validation/test example.
Known limitations
- Scanned pages carry no transcription. Born-digital pages are all single-column or scholia/apparatus layouts of recent Teubner / De Gruyter editions.
- Diagram letters were deleted on figure pages and figures are not boxed (only 2
GraphicZone). Concordance tables and dense indices are incomplete (the model missed many small cells); the hand edits did not add them. - Spreads are read left page then right page. Arabic pages read right to left within a row.
- A few region boxes on skewed scans are loose (regions are rectangles around the line polygons).
Files
Additional details
Funding
- Agence Nationale de la Recherche
- Programme Inria Quadrant ANR-24-RRII-0002