Subject indexing data of K10plus library union catalog

This dataset contains a an extract of K10plus library union catalog with its subject indexing data:

• kxp-subjects-sample_2021-06-30.dat: a random sample fo 10.000 records
• kxp-subjects_2021-06-30_0{1,2,3,4,5,6,7,8,9}of09.dat : the full data (41.786.820 record) split in files of up to 5.000.000 records each

K10plus is a union catalog of German libraries, run by library service centers BSZ and VZG since 2019. The catalog contains bibliographic data of the majority of academic libraries in Germany. The core data of K10plus is made available as OpenData via APIs and in form of database dumps. More information can be found here:

• K10plus homepage (in German)
• K10plus Open Data page (in German)
• Traditional search interface (OPAC)

The data is provided in its raw internal format called PICA+ to not loose information during conversion. In particular the data is given in PICA Normalized Format with one record per line. Each record consists of a list of fields and each field consists of a list of subfields.

The data can best be processed with command line tools pica-rs or picadata. A detailled description of PICA format and its processing is given in the German textbook Einführung in die Verarbeitung von PICA-Daten.

For visual inspection PICA Normalized Format is best converted into PICA Plain Format (pica-rs command pica print). The following example record contains seven fields:

003@ $0010003231
044K $9106080474$VTsv1$7gnd/4077343-7$3209204761$aSekte
044N $aReligionsgemeinschaft
045E $a12
045F $a291
045Q/01 $9181570408$VTkv$a11.97$jNeue religiöse Bewegungen$jSekten
045R $91270641751$VTkv$7rvk/11410:$3200641751$aBG 9600$jAllgemeines$kTheologie und Religionswissenschaften$kFundamentaltheologie$kKirche und Kirchen$kFreikirchen und Sekten

Each K10plus record is uniquely identified by its record identifier PPN, given in field 003@ subfield $0. The PPN can be used:

• to link into K10plus catalog, e.g. https://opac.k10plus.de/DB=2.299/PPNSET?PPN=010003231
• to retrieve the record in other formats via API, e.g. https://unapi.k10plus.de/?id=opac-de-627:ppn:010003231&format=marcxml (MARC/XML format) and https://ws.gbv.de/suggest/csl/?query=pica.ppn=010003231&citationstyle=ieee&language=de (Citation Format)

The data is limited to records having a least one holding by a library participating in K10plus. Records are provided with “offline expansion” (some subfield have been added automatically to facilitate re-use of the data) and limited to the following fields:

• 003@ with internal record identifier “PPN” in subfield $0
• 041A keywords
• 044. all subject indexing fields starting with 044
• 045. all subject indexing fields starting with 045
• 144Z local library keywords
• 145S local library classification
• 145Z local library classification

Documentation of the fields can be found at https://format.k10plus.de/k10plushelp.pl?cmd=pplist&katalog=Standard#titel

The current dump contains 41.786.820 record with subject indexing out of 71.429.482 K10plus records in total.

For reference, the dump has been created from a full dump of K10plus with this chain of commands:

pica filter 003@? --reduce 003@.0,044.,045.,144Z,145S,145Z kxp-catalog-full_2022-06-30_*.dat | grep -Pv '^003@..0[0-9X]+.$' > kxp-subjects_2021-06-30.dat

The file was then split into chunks of 5.000.000 records each:

split -l 5000000 --numeric-suffixes=01 kxp-subjects_2021-06-30.dat kxp-subjects_2021-06-30_

Processing examples

Extract CSV file of PPN and RVK-Notation:

pica filter '045R?' kxp-subjects_2021-06-30.dat | pica select '003@$0,045Ra'

Get a list of PPN of records having RVK but not BK:

pica filter '045R? & !045Q/01' kxp-subjects_2021-06-30.dat | pica select '003@$0'

License

https://creativecommons.org/publicdomain/zero/1.0/