Low-complexity Reinforcement Learning Decoders for Autonomous, Scalable, Neuromorphic intra-cortical Brain Machine Interfaces
Creators
- 1. University of Illinois, Urbana-Champaign
- 2. Nanyang Technological University, Singapore
- 3. National University of Singapore, Singapore
- 4. Agency for Science Technology and Research, Singapore
- 5. City University of Hong Kong
- 6. The University of Hong Kong
Description
General Description. This dataset consists of data from four BMI experiments performed on two adult macaques. Three of the experiments were joystick controlled tasks, and one of them was center-out reaching task. The macaques were able to use a wireless integrated system to control a robotic platform, over which they were sitting, to achieve independent mobility using the
neuronal activity in their motor cortices. The activity of populations of single neurons was recorded using multiple electrode arrays implanted in the arm region of primary motor cortex. A general description is provided below:
- A titanium head post (Crist Instruments, MD, USA) was affixed prior to implantation of microelectrode arrays in both NHPs. In NHP-A, 4 microelectrode arrays containing 16 electrodes each, and in NHP-B, 1 microelectrode array containing 100 electrodes were implanted in the hand/arm region of the left primary motor cortex respectively.
- Spike signals were acquired using an in-house 100-channel wireless neural recording system, which is sampled at 13 KHz. The wide-band signals were then band-pass filtered between 300 to 3000 Hz to remove low-frequency components.
- The threshold for spike deterction was found using the formula: (Thr = 5σ; σ = median(|x|/0.6745), where x is the filtered signal, and σ is an estimate of the standard deviation of the background noise.
The behavorial task was to make a robotic wheelchair bound control its motion through a three-directional spring-loaded joystick (Experiment 1, 2, and 3). The experiment comprised of four tasks - a) turning 90° right, b) moving forward by 2m, c) turning 90° left, and d) staying still for 5 seconds (stop task). Successful task completion varied from experiment to experiment. Experiment 4 also involved joystick control but the primate was trained to perform classical center-out task.
Data for Experiment 1 and 3 are already publicly available at: https://osf.io/dce96/. However, a detailed description is also provided here. The data are grouped in form of folders containing data for NHP-1/2-Set 1/2. For the folder, NHP 1 Set 1, experiment 1 data consists of sessions 1,2,3; expt 3: 5,6,7,8. Similarly for Set 2: expt-1: 3,4,5,10,11; expt 3: 8,9. For the folder, NHP 2 Set 1, expt 1 consists of sessions 10,11,12,13,18,19,20,21; expt 3: 15,16,17,24. For the folder. Similarly for Set 2: expt-1: 1,2,3,10,11,12,13; expt 3: 6,7,8,9.
Possible use cases. These data are ideal for designing, training, and testing iBMI decoders. We expect that the dataset will be valuable for researchers who wish to design improved models of sensorimotor cortical spiking or provide an equal footing for comparing different iBMI decoders. We also hope to inspire more work along neuromorphic lines and use of online Reinforcement Learning algorithms for iBMI decoders.
Variable names. Each file from Experiment 1 and 3 contains data in the following format.
1. joystick_adfreq: The frequency of operation of the joystick.
2. X_Voltage: The voltage reading corresponding to the x-coordinate (while joystick operation).
3. Y_Voltage: The voltage reading corresponding to the y-coordinate (while joystick operation).
4. Spike_data(Channel Number): The Channel Number corresponding to which the neuronal data is recorded.
5. Spike_data(Cluster): Descripting the cluster on which the channels are placed.
6. Spike_data(Spike Times): The timestamp corresponding to the detection of a spike.
7. Spike_data(Spike Number): The total number of spikes calculated for a particular trial from a particular channel.
8. Spike_data(Mean Spike Waveform): The mean neuronal data (for that trial from a particular channel) describing a spike.
9. Spike_data(Spike Amplitude): The mean spike amplitude of that particular channel.
10. IMETrainingData(SentSignals): The truth labels corresponding to a particular trial.
11. IMETrainingData(Timestamps): Time stamps corresponding to each sent signal (data).
12. IMETrainingData(ReasonFail): String data; Reason if the trial failed.
13. IMETrainingData(TrialOutcomes): Trial results corresponding to successful or unsuccessful!
14. IMETrainingData(StartTime): corresponding to the beginning of each trial.
15. IMETrainingData(EndTime): corresponding to the end of each trial.
For files in Experiment 2 and 4,
1. targetTest_Acc: Corresponding direction of the joystick recorded for each trial. (decoded using the decoder)
2. targetTrain: Ground truth label, corresponding to the actual direction of the joystick (for each trial)
3. testingSet_Acc: Number of spike counts from each channel (used for testing corresponding to all the sessions)
4. trainingSet: Number of spike counts from each channel (used for calibration, mostly)
Contact Information. We would be delighted to hear from you if you find this dataset valuable, especially if it leads to publication. Corresponding author: A. Ghosh <aghosh14@illinois.edu>; A. Basu <arinbasu@cityu.edu.hk>.
Citation. A. Ghosh, S. Shaikh, P. S. V. Sun, C. Libedinsky, R. So, N. Lin, H. Chen, Z. Wang, A. Basu, "Low-complexity Reinforcement Learning Decoders for Autonomous, Scalable, Neuromorphic intra-cortical Brain Machine Interfaces," IEEE Transaction on Neural Networks and Learning Systems (Under review)
Files
Files
(3.1 MB)
Name | Size | Download all |
---|---|---|
md5:7038962dc3ba1ae293e1b160a30dd8be
|
579 Bytes | Download |
md5:22f1f5d2cd862d437ed8ba38a13590e8
|
543 Bytes | Download |
md5:d1924548575f1d9a602562be0f859282
|
578 Bytes | Download |
md5:b10098018a617848deca79d73fe7bfe2
|
526 Bytes | Download |
md5:1a231d28a64939b78b834ca3075be248
|
539 Bytes | Download |
md5:ba50b48f8b3b293b71921babe6a716f4
|
541 Bytes | Download |
md5:75d2161d1f696e7eb5042eadb7b69e98
|
513 Bytes | Download |
md5:72ff9635618bf9c52da83b3e8411fdfc
|
528 Bytes | Download |
md5:177ad18d8152d718a05fd645d7865ee4
|
235 Bytes | Download |
md5:9997860bc9ad05c106b6e3a47c4538e7
|
267 Bytes | Download |
md5:e766c0b4eba199bc7c664b13c497b459
|
270 Bytes | Download |
md5:b473a3acd89f3e486b90a41956a1f4cd
|
230 Bytes | Download |
md5:b27c823c04111ca1062ad020f0b8e837
|
387 Bytes | Download |
md5:38032a57c02c58b250f880b1cf778808
|
386 Bytes | Download |
md5:67a82e3d96550884698ce02e3d67559f
|
391 Bytes | Download |
md5:fa0c7c495247385c9b5bd6b8f0648fdd
|
369 Bytes | Download |
md5:367216a6b898a69690d6ea86eb917894
|
406 Bytes | Download |
md5:4ce3efc844166039c955aee45e78a3cb
|
391 Bytes | Download |
md5:aaf8c6deb6972d0c2243f4cbeba26d09
|
367 Bytes | Download |
md5:efe8e0be168f7eb806d236cdb75c3983
|
318 Bytes | Download |
md5:9d961b533ea27cbc81c02817fe66a090
|
252 Bytes | Download |
md5:58b9ae7e9d57221b031dc51ae7f8885c
|
260 Bytes | Download |
md5:ab62319526f060a90422a8139d3e3eea
|
249 Bytes | Download |
md5:bdf165d7621049b0bfa912a7b151568e
|
247 Bytes | Download |
md5:46ebf515ee509776a95e191844f72668
|
298.9 kB | Download |
md5:52ccc767e9bdf6d38293323901673968
|
286.9 kB | Download |
md5:18b2b18816e6a50f4c64058226a85aeb
|
273.6 kB | Download |
md5:1a0b044bf6a61012f158319a90ed4985
|
251.7 kB | Download |
md5:5c6ee6c1c325663635de61bcf23184ec
|
152.1 kB | Download |
md5:b51fc15d922b01938a5b72349eee3277
|
187.9 kB | Download |
md5:dfa94e7942c3e5dbc802f0436717da89
|
228.0 kB | Download |
md5:59b5b5c6869fe7b216d33ae6a01e0cae
|
248.7 kB | Download |
md5:c5ad72efcdc951407b12d573cb81b6e2
|
19.8 kB | Download |
md5:e57c94c28a3410b207e83d3f46ab0bd1
|
32.8 kB | Download |
md5:6645cfcff539f62dd6856c2bf4959448
|
30.0 kB | Download |
md5:604faf4d3bed074c52ff987b88c6d0f6
|
24.3 kB | Download |
md5:65b9c7d3aa52dafd8e7e05ece3fd94af
|
128.3 kB | Download |
md5:4b2f70379c9d31d054987fcd8186806b
|
132.9 kB | Download |
md5:21aa60b2fd6acd2970f950210f1fa9f6
|
119.3 kB | Download |
md5:ee117589789acc5c65199e15eea574fd
|
106.5 kB | Download |
md5:acfe6c78cb99dafb7a2142aaabc47471
|
129.6 kB | Download |
md5:f4b7bb98472286d53b90281305ccbd1c
|
99.2 kB | Download |
md5:96a18f593d70e29df201324e75f9e470
|
121.8 kB | Download |
md5:d525526e951ae10a0aa1e95b96bf16cd
|
79.9 kB | Download |
md5:774cad385993b649be0dcc1af6ffb7e5
|
20.2 kB | Download |
md5:f7ab6dc88012d2769a2145bc4e6444d0
|
31.0 kB | Download |
md5:c407087b938fdaea6663e3228e299c86
|
28.6 kB | Download |
md5:f33304f83758e7a1d329ae9255d3e823
|
23.7 kB | Download |
Additional details
Related works
- Is documented by
- Journal article: 10.1371/journal.pone.0165773 (DOI)
- Is referenced by
- Journal article: 10.1109/TNSRE.2019.2962708 (DOI)