Dataset Open Access

Hathi Trust Library Vectorized features

Benjamin M. Schmidt

A smaller-resolution (and therefore more portable) version of the Stable Random Projection Hathi Trust features described in my forthcoming article. The Northeastern repository is many individual files with 1280 random dimensions; this is just 640 random dimensions. The numbers are also experimentally encoded as half-precision floats, which cuts the file size by half at the cost of only being supported by my Python module. The net result is a file 1/4 the size of the full resolution ones for the paper that has, probably, something like 60-80% of the information content.

The full file is 'ht-640d-complete-half-precision.bin'. You can also download 11 smaller files organized by language.

Code to read these files is at https://github.com/bmschmidt/pySRP. 

Files (35.4 GB)
Name Size
chi.bin
md5:9d42e87889548753c87a0789b2974eb7
672.5 MB Download
eng_1922_or_before.bin
md5:3f568d8da7a8ea91cce543c97c2c6548
3.1 GB Download
eng_1923-1979.bin
md5:1c0cf6c2f28a460f06819d70972f9158
3.4 GB Download
eng_1980_or_after.bin
md5:e2e6849025ed6ed9bcf4a1a66fefb6d4
3.0 GB Download
fre.bin
md5:9ffcd0bc224808f4eb26a1405ad7ef6c
1.3 GB Download
ger.bin
md5:901a65063a63db2d61c72ccfec9817fc
1.7 GB Download
ht-640d-complete-half-precision.bin
md5:e3752fd49b778674a321fc619c9f81a2
17.7 GB Download
ita.bin
md5:efadff54374de2e5fab31457ace0d8fc
418.0 MB Download
jpn.bin
md5:d1b710006321ae4b99fd7227be4f0bcf
632.0 MB Download
Other.bin
md5:fc0b487e8633f95f38bb93ffb229e7bf
2.4 GB Download
rus.bin
md5:1466aa25e5440176d41f3e23870bf84b
530.6 MB Download
spa.bin
md5:11997b2761a6fb8ea3a409e92d8678c8
650.2 MB Download
76
27
views
downloads
All versions This version
Views 7676
Downloads 2727
Data volume 109.7 GB109.7 GB
Unique views 7171
Unique downloads 66

Share

Cite as