Published August 13, 2021
| Version 1.0.0
Software
Open
RWKV-LM
Authors/Creators
Description
Attached model : ctx1024-layer6-emb512 on enwik8 with 1.65 dev perplexity (0.72 BPC)
Notes
If you use this software, please cite it as below.
Files
BlinkDL/RWKV-LM-2.00.zip
Files
(539.4 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:aa2a82ad56fc0f898b25e3b205a705de
|
539.4 kB | Preview Download |
Additional details
Related works
- Is supplement to
- https://github.com/BlinkDL/RWKV-LM/tree/2.00 (URL)