Dataset Open Access

OCR fulltexts of the Digital Collections of the Berlin State Library (DC-SBB)

Labusch, Kai; Zellhöfer, David


Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Labusch, Kai</dc:creator>
  <dc:creator>Zellhöfer, David</dc:creator>
  <dc:date>2019-06-26</dc:date>
  <dc:description>The digital collections of the SBB contain 153,942 digitized works from the time period of 1470 to 1945.

At the time of publication, 28,909 works have been OCR-processed resulting in 4,988,099 full-text pages.
For each page with OCR text, the language has been determined by langid (Lui/Baldwin 2012).

corpus-entropy.pkl      entropy rate per document page

corpus-language.pkl   language per document page

corpus.zip                    fulltext corpus (extracts to .txt format)

de_corpus.zip              German sub-corpus (extracts to .txt format)

selection_de.pkl          Selection list of German documents

xml2csv_alto.csv         fulltext corpus per document page (incl.OCR word confidences)

 

Sources

Marco Lui and Timothy Baldwin. 2012. Langid.py:

An off-the-shelf language identification tool. In Proceedings of the ACL 2012 System Demonstrations,

ACL ’12, pages 25–30, Stroudsburg, PA, USA. Association for Computational Linguistics</dc:description>
  <dc:identifier>https://zenodo.org/record/3257041</dc:identifier>
  <dc:identifier>10.5281/zenodo.3257041</dc:identifier>
  <dc:identifier>oai:zenodo.org:3257041</dc:identifier>
  <dc:relation>doi:10.5281/zenodo.3257040</dc:relation>
  <dc:relation>url:https://zenodo.org/communities/stabi</dc:relation>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>https://creativecommons.org/licenses/by/4.0/legalcode</dc:rights>
  <dc:subject>OCR fulltext</dc:subject>
  <dc:subject>historic texts</dc:subject>
  <dc:title>OCR fulltexts of the Digital Collections of the Berlin State Library (DC-SBB)</dc:title>
  <dc:type>info:eu-repo/semantics/other</dc:type>
  <dc:type>dataset</dc:type>
</oai_dc:dc>
458
305
views
downloads
All versions This version
Views 458458
Downloads 305305
Data volume 3.0 TB3.0 TB
Unique views 423423
Unique downloads 150150

Share

Cite as