Data from: High-performance brain-to-text communication via handwriting
- 1. Stanford University
- 2. Providence VA Medical Center
Description
Brain-computer interfaces (BCIs) can restore communication to people who have lost the ability to move or speak. In this study, we demonstrated an intracortical BCI that decodes attempted handwriting movements from neural activity in motor cortex and translates it to text in real-time, using a recurrent neural network decoding approach. With this BCI, our study participant, whose hand was paralyzed from spinal cord injury, achieved typing speeds that exceed those of any other BCI yet reported: 90 characters per minute at 94.1% raw accuracy online, and >99% accuracy offline with a general-purpose autocorrect.
This dataset contains all of the neural activity recorded during these experiments, consisting of 1,000 sentences (43,501 characters) over 10.7 hours. The neural activity was recorded with two microleectrode arrays implanted in hand area of motor cortex (96 electrodes each). The dataset also contains all of the real-time outputs of the handwriting BCI.
Notes
See the readme.pdf for a description of the data format (and this code for an example of how to train RNNs on this data).
Funding provided by: U.S. Department of Veterans Affairs
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100000738
Award Number: A2295R, N2864C
Funding provided by: NIH: National Institute of Neurological Disorders and Stroke and BRAIN Initiative*
Crossref Funder Registry ID:
Award Number: UH2NS095548, U01-NS098968
Funding provided by: National Institute on Deafness and Other Communication Disorders
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100000055
Award Number: R01DC009899, U01DC017844, R01-DC014034
Funding provided by: Howard Hughes Medical Institute
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100000011
Award Number:
Funding provided by: Simons Foundation Collaboration on the Global Brain*
Crossref Funder Registry ID:
Award Number: 543045
Funding provided by: Larry and Pamela Garlick*
Crossref Funder Registry ID:
Award Number:
Funding provided by: Samuel and Betsy Reeves*
Crossref Funder Registry ID:
Award Number:
Funding provided by: Wu Tsai Neurosciences Institute at Stanford*
Crossref Funder Registry ID:
Award Number:
Funding provided by: Simons Foundation Collaboration on the Global Brain
Crossref Funder Registry ID:
Award Number: 543045
Funding provided by: Larry and Pamela Garlick
Crossref Funder Registry ID:
Funding provided by: Samuel and Betsy Reeves
Crossref Funder Registry ID:
Funding provided by: Wu Tsai Neurosciences Institute at Stanford
Crossref Funder Registry ID:
Files
readme.pdf
Files
(1.4 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:38b804d8bd271bd5981c7fda7f925eb8
|
1.4 GB | Download |
|
md5:aac8b5c6114b2382d63744c52c6d0709
|
288.2 kB | Preview Download |
Additional details
Related works
- Is derived from
- https://github.com/fwillett/handwritingBCI (URL)