Dataset Open Access

Wikitext-103 and OpenWebText Models

Davis, Forrest

This repository contains 25 Wikitext-103 LSTM models and 25 LSTM models trained on a 100 million token subset of the OpenWebTextCorpus. Training/validation/test data is included with the Web models. By-epoch validation perplexity is given in the logs (within the directory for the models). Please write to me if you have any questions :) 

Files (4.4 GB)
Name Size
openwebtextcorpus-25-models.tar.gz
md5:21616173d195a6c1f19fd447fad41c65 		2.3 GB Download
wikitext103-25-models.tar.gz
md5:189990cac92603769d9d2c4531e5aa9b 		2.1 GB Download
100
25
views
downloads
All versions This version
Views 100100
Downloads 2525
Data volume 54.7 GB54.7 GB
Unique views 9090
Unique downloads 1616
More info on how stats are collected.
Indexed in
Publication date:
September 27, 2020
DOI:
10.5281/zenodo.4053572

Zenodo DOI Badge

DOI 

10.5281/zenodo.4053572

Markdown 

[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.4053572.svg)](https://doi.org/10.5281/zenodo.4053572)

reStructedText 

.. image:: https://zenodo.org/badge/DOI/10.5281/zenodo.4053572.svg
   :target: https://doi.org/10.5281/zenodo.4053572

HTML 

<a href="https://doi.org/10.5281/zenodo.4053572"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.4053572.svg" alt="DOI"></a>

Image URL 

https://zenodo.org/badge/DOI/10.5281/zenodo.4053572.svg

Target URL 

https://doi.org/10.5281/zenodo.4053572

Keyword(s):
language models, LSTMs
License (for files):
Creative Commons Attribution 4.0 International

Versions

Version 1 10.5281/zenodo.4053572 Sep 27, 2020
Cite all versions? You can cite all versions by using the DOI 10.5281/zenodo.4053571. This DOI represents all versions, and will always resolve to the latest one. Read more.

Share

Cite as

Export