Kurrent Pages Benchmark v1.0
Authors/Creators
Description
The Kurrent Pages Benchmark is a held-out benchmark for end-to-end transcription of German historical pages: Kurrent, Sütterlin, degraded Fraktur, early-modern hands, registers, and marginalia from 1565 to 1948. An engine gets a raw page image and returns the page text. The 53 scored pages are scored offline against a private, double-keyed transcription; only aggregates are published.
Version 1.0 is ground truth v1.0, harness tag v1.0.0, and the preregistered protocol with its amendment log (§10) up to 2026-11-06. Scores compare only within v1.0.
Links
- Code, protocol, and documentation: github.com/13fragments/kurrent-pages
- Leaderboard: LEADERBOARD.md
- Page images (gated, evaluation only): huggingface.co/datasets/13fragments/kurrent-pages-v1
- How to submit results: SUBMITTING.md
Ground-truth provenance
- 36 Kurrent and Sütterlin pages: two independent external keys; the author adjudicated every disagreement against the scan.
- 2 Kurrent trial pages: the primary keyer's key.
- 7 degraded Fraktur and Latin cursive pages: one external key, adjudicated against the scan.
- 8 early-modern pages: a specialist's key, adjudicated against the scan.
Persons, places, and dates are annotated on every scored page. The ground truth, the entity annotations, and all engine outputs on the benchmark pages stay private, so the pages stay held out.
Contents of this archive
The protocol, the evaluation harness (Apache-2.0), the page manifest with source links and SHA-256 hashes, the leaderboard, and the documentation (CC BY 4.0). The page images are not in this archive; each keeps the licence of its source record (CC0, Public Domain Mark, or CC BY 4.0).
Known limits
- Five strata have 2 or 3 pages; their medians are indicative.
- VLM rows are single greedy runs; a change of serving state moved medians by about 0.02.
- Fabrication is not yet adjudicated for any engine; the leaderboard shows an automatic proxy only.
Files
13fragments/kurrent-pages-v1.0.0.zip
Additional details
Related works
- Is supplement to
- Software: https://github.com/13fragments/kurrent-pages/tree/v1.0.0 (URL)
Software
- Repository URL
- https://github.com/13fragments/kurrent-pages