Published February 27, 2017
| Version v1
Dataset
Open
Webis-Simple-Sentences-17 Corpus
Description
A corpus of 471,085,690 English sentences extracted from the ClueWeb12 Web Crawl. The sentences were sampled from a larger corpus to achieve a level of sentence complexity similar to the one of sentences that humans make up as a memory aid for remembering passwords. Sentence complexity was determined by syllables per word.
The corpus is split in training and test set as it is used in the associated publication. The test set is extracted from part 00 of the ClueWeb12, while the training set is extracted from the other parts.
More information on the corpus can be found on the corpus web page at our university (listed under documented by).
Files
Files
(12.7 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:06099a2ec0e941080c37c8cf12bd7f75
|
1.1 GB | Download |
|
md5:7b3047871ad00bb2a83a5402f8237445
|
11.6 GB | Download |
Additional details
Related works
- Is compiled by
- 10.14722/ndss.2017.23077 (DOI)
- Is documented by
- http://www.uni-weimar.de/en/media/chairs/webis/corpora/corpus-webis-sentences-17/ (URL)
- Is supplemented by
- 10.5281/zenodo.398838 (DOI)
- 10.5281/zenodo.398837 (DOI)
References
- Johannes Kiesel, Benno Stein, and Stefan Lucks (2017). A Large-scale Analysis of the Mnemonic Password Advice. In Proceedings of the 24th Annual Network and Distributed System Security Symposium (NDSS 17).