Dataset Open Access

Hathi Trust Library Vectorized features

Benjamin M. Schmidt

Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="" xmlns:oai_dc="" xmlns:xsi="" xsi:schemaLocation="">
  <dc:creator>Benjamin M. Schmidt</dc:creator>
  <dc:description>A smaller-resolution (and therefore more portable) version of the Stable Random Projection Hathi Trust features described in my forthcoming article. The Northeastern repository is many individual files with 1280 random dimensions; this is just 640 random dimensions. The numbers are also experimentally encoded as half-precision floats, which cuts the file size by half at the cost of only being supported by my Python module. The net result is a file 1/4 the size of the full resolution ones for the paper that has, probably, something like 60-80% of the information content.

The full file is 'ht-640d-complete-half-precision.bin'. You can also download 11 smaller files organized by language.

Code to read these files is at </dc:description>
  <dc:subject>Dimensionality reduction</dc:subject>
  <dc:subject>Digital Libraries</dc:subject>
  <dc:subject>Digital humanities</dc:subject>
  <dc:title>Hathi Trust Library Vectorized features</dc:title>
All versions This version
Views 217219
Downloads 5858
Data volume 393.7 GB393.7 GB
Unique views 206208
Unique downloads 1212


Cite as