Published September 15, 2022 | Version 1.0.0
Dataset Open

Hash data files for "Hashes are not suitable to verify fixity of the public archived web"

  • 1. Columbia College
  • 2. Old Dominion University

Description

This work investigates the fixity of a set of archived webpages, or mementos. We conducted a study on 16,627 mementos from 17 public web archives. We replayed and downloaded the mementos 39 times using a headless browser  over a period of 442 days and generated a hash for each memento after each download,  resulting in 39 hashes per memento. The hashes were generated by creating Merkle trees to represent hashes at each level of the memento. A hash was generated for each resource used to construct the full webpage and then the hashes were combined to generate an overall hash for the composite memento.

There are 39 data files, one for each download. 

The mementos downloaded come from the dataset at https://github.com/oduwsdl/mementos-fixity/

Files

README.md

Files (9.8 GB)

Name Size Download all
md5:fd3028504f74bee4041c81bcb6b136e4
257.8 MB Download
md5:7a1e16d929db102a024c9aa7ba63a8ac
261.4 MB Download
md5:7c7d1f3dd7ea9e1000c942d6b9d45c7b
261.0 MB Download
md5:df01dd29076bf0f5527375bdf0cd9648
263.1 MB Download
md5:64a972b4941aacfd1c89b1b937c9a661
261.7 MB Download
md5:48fd80ed6d480ac4a9df8100a95fe98d
262.6 MB Download
md5:73b5c2de9019178b76e394a93fbf5403
262.6 MB Download
md5:ff14f1668d3f38a8378ac332547a309c
262.3 MB Download
md5:c0e8bb934109bd3cb676de30248dcae3
262.8 MB Download
md5:49a1e6ba36716c1ef031f669d48fab94
263.4 MB Download
md5:c39ab2bc8ca61f2d27cf9e739231f885
262.3 MB Download
md5:3201c263095e1e00a66bfd4e555603eb
261.4 MB Download
md5:3b1501b50b9eaf27c21e0a4853de3a8e
263.5 MB Download
md5:2c41fbaa6328530a4e6842b3076f33c6
233.1 MB Download
md5:31075447b1174e5e112d3181863dcf03
245.3 MB Download
md5:437564c73b9e2b79bc682c6c56ab46da
253.2 MB Download
md5:862f2b94a7f4b666a50121b325fce9a1
256.6 MB Download
md5:041da9d67fedb7a288c2389f1c77edd9
257.9 MB Download
md5:a9c529e4de7eba3c8eacab6c66660202
261.7 MB Download
md5:950c77b298de8a0dce0dc45d29ac0c71
260.3 MB Download
md5:9d81e182d4c1bae8306558093ef7f92d
232.9 MB Download
md5:005f0a5324af711fac6c2fc1e5117cb8
234.6 MB Download
md5:5b52b98f6c8018c4334e70f5b5c9f1af
236.5 MB Download
md5:9d6c7dbda20443af01d9191401d4ee1e
255.8 MB Download
md5:84b3eb814689701f7812871a2e648c64
251.7 MB Download
md5:e38f8fff58eded2de5ebede7db82022d
253.9 MB Download
md5:5b17a27ef2c957ccf1a2f15a7c8138ab
253.6 MB Download
md5:65db7a139a139b96a5cee983605be835
259.5 MB Download
md5:8449f1814a00a4da308940d90c37baca
257.5 MB Download
md5:b8743e895eee12b3194a7b1dd615de8a
257.6 MB Download
md5:a3745532da70efac72e19196ed27a245
241.8 MB Download
md5:5de1a086dd518eb96b838b6fd701e411
241.4 MB Download
md5:088684e4d4eb695065b854bc3e0f8de9
241.2 MB Download
md5:e5110b0b5eb5b2bf12eb8eee3e2a241b
214.7 MB Download
md5:2a4cc707fddf36496597138bee2a4dea
221.8 MB Download
md5:c8e3e6a58d700b6b8652c04d4e77b747
237.5 MB Download
md5:48df130ebb089489c54d8960a1ac312a
239.5 MB Download
md5:35e284a69b987e4163f5574f71174f62
243.5 MB Download
md5:83999c0f5580bcf96e3a5aafb58c4d27
269.9 MB Download
md5:c72c6cf2ec0f18a9b9c077499f977814
5.2 kB Preview Download