There is a newer version of the record available.

Published September 23, 2023 | Version 1.0.0
Dataset Open

Low-complexity Reinforcement Learning Decoders for Autonomous, Scalable, Neuromorphic intra-cortical Brain Machine Interfaces

  • 1. University of Illinois, Urbana-Champaign
  • 2. Nanyang Technological University, Singapore
  • 3. National University of Singapore, Singapore
  • 4. Agency for Science Technology and Research, Singapore
  • 5. City University of Hong Kong
  • 6. The University of Hong Kong

Description

General Description. This dataset consists of data from four BMI experiments performed on two adult macaques. Three of the experiments were joystick controlled tasks, and one of them was center-out reaching task. The macaques were able to use a wireless integrated system to control  a robotic platform, over which they were sitting, to achieve independent mobility using the 
neuronal activity in their motor cortices. The activity of populations of single neurons was recorded using multiple electrode arrays implanted in the arm region of primary motor cortex. A general description is provided below:

  1. A titanium head post (Crist Instruments, MD, USA) was affixed prior to implantation of microelectrode arrays in both NHPs. In  NHP-A, 4 microelectrode arrays containing 16 electrodes each, and in NHP-B, 1 microelectrode array containing 100 electrodes were implanted in the hand/arm region of the left primary motor cortex respectively.
  2. Spike signals were acquired using an in-house 100-channel wireless neural recording system, which is sampled at 13 KHz. The wide-band signals were then band-pass filtered between 300 to 3000 Hz to remove low-frequency components. 
  3. The threshold for spike deterction was found using the formula: (Thr = 5σ; σ = median(|x|/0.6745), where x is the filtered signal, and σ is an estimate of the standard deviation of the background noise.

The behavorial task was to make a robotic wheelchair bound control its motion through a three-directional spring-loaded joystick (Experiment 1, 2, and 3). The experiment comprised of four tasks - a) turning 90° right, b) moving forward by 2m, c) turning 90° left, and d) staying still for 5 seconds (stop task). Successful task completion varied from experiment to experiment. Experiment 4 also involved joystick control but the primate was trained to perform classical center-out task.  

Data for Experiment 1 and 3 are already publicly available at: https://osf.io/dce96/. However, a detailed description is also provided here. The data are grouped in form of folders containing data for NHP-1/2-Set 1/2. For the folder, NHP 1 Set 1, experiment 1 data consists of sessions 1,2,3; expt 3: 5,6,7,8. Similarly for Set 2: expt-1: 3,4,5,10,11; expt 3: 8,9. For the folder, NHP 2 Set 1, expt 1 consists of sessions 10,11,12,13,18,19,20,21; expt 3: 15,16,17,24. For the folder. Similarly for Set 2: expt-1: 1,2,3,10,11,12,13; expt 3: 6,7,8,9. 

Possible use cases. These data are ideal for designing, training, and testing iBMI decoders. We expect that the dataset will be valuable for researchers who wish to design improved models of sensorimotor cortical spiking or provide an equal footing for comparing different iBMI decoders. We also hope to inspire more work along neuromorphic lines and use of online Reinforcement Learning algorithms for iBMI decoders.  

Variable names. Each file from Experiment 1 and 3 contains data in the following format. 
1. joystick_adfreq: The frequency of operation of the joystick.
2. X_Voltage: The voltage reading corresponding to the x-coordinate (while joystick operation).
3. Y_Voltage: The voltage reading corresponding to the y-coordinate (while joystick operation).
4. Spike_data(Channel Number): The Channel Number corresponding to which the neuronal data is recorded.
5. Spike_data(Cluster): Descripting the cluster on which the channels are placed.
6. Spike_data(Spike Times): The timestamp corresponding to the detection of a spike.
7. Spike_data(Spike Number): The total number of spikes calculated for a particular trial from a particular channel.
8. Spike_data(Mean Spike Waveform): The mean neuronal data (for that trial from a particular channel) describing a spike. 
9. Spike_data(Spike Amplitude): The mean spike amplitude of that particular channel.
10. IMETrainingData(SentSignals): The truth labels corresponding to a particular trial.
11. IMETrainingData(Timestamps): Time stamps corresponding to each sent signal (data).
12. IMETrainingData(ReasonFail): String data; Reason if the trial failed.
13. IMETrainingData(TrialOutcomes): Trial results corresponding to successful or unsuccessful!
14. IMETrainingData(StartTime): corresponding to the beginning of each trial.
15. IMETrainingData(EndTime): corresponding to the end of each trial.

For files in Experiment 2 and 4,
1. targetTest_Acc: Corresponding direction of the joystick recorded for each trial. (decoded using the decoder)
2. targetTrain: Ground truth label, corresponding to the actual direction of the joystick (for each trial)
3. testingSet_Acc: Number of spike counts from each channel (used for testing corresponding to all the sessions)
4. trainingSet: Number of spike counts from each channel (used for calibration, mostly)     

Contact Information. We would be delighted to hear from you if you find this dataset valuable, especially if it leads to publication. Corresponding author: A. Ghosh <aghosh14@illinois.edu>; A. Basu <arinbasu@cityu.edu.hk>.

Citation. A. Ghosh, S. Shaikh, P. S. V. Sun, C. Libedinsky, R. So, N. Lin, H. Chen, Z. Wang, A. Basu, "Low-complexity Reinforcement Learning Decoders for Autonomous, Scalable, Neuromorphic intra-cortical Brain Machine Interfaces," IEEE Transaction on Neural Networks and Learning Systems (Under review)

Files

Files (3.1 MB)

Name Size Download all
md5:7038962dc3ba1ae293e1b160a30dd8be
579 Bytes Download
md5:22f1f5d2cd862d437ed8ba38a13590e8
543 Bytes Download
md5:d1924548575f1d9a602562be0f859282
578 Bytes Download
md5:b10098018a617848deca79d73fe7bfe2
526 Bytes Download
md5:1a231d28a64939b78b834ca3075be248
539 Bytes Download
md5:ba50b48f8b3b293b71921babe6a716f4
541 Bytes Download
md5:75d2161d1f696e7eb5042eadb7b69e98
513 Bytes Download
md5:72ff9635618bf9c52da83b3e8411fdfc
528 Bytes Download
md5:177ad18d8152d718a05fd645d7865ee4
235 Bytes Download
md5:9997860bc9ad05c106b6e3a47c4538e7
267 Bytes Download
md5:e766c0b4eba199bc7c664b13c497b459
270 Bytes Download
md5:b473a3acd89f3e486b90a41956a1f4cd
230 Bytes Download
md5:b27c823c04111ca1062ad020f0b8e837
387 Bytes Download
md5:38032a57c02c58b250f880b1cf778808
386 Bytes Download
md5:67a82e3d96550884698ce02e3d67559f
391 Bytes Download
md5:fa0c7c495247385c9b5bd6b8f0648fdd
369 Bytes Download
md5:367216a6b898a69690d6ea86eb917894
406 Bytes Download
md5:4ce3efc844166039c955aee45e78a3cb
391 Bytes Download
md5:aaf8c6deb6972d0c2243f4cbeba26d09
367 Bytes Download
md5:efe8e0be168f7eb806d236cdb75c3983
318 Bytes Download
md5:9d961b533ea27cbc81c02817fe66a090
252 Bytes Download
md5:58b9ae7e9d57221b031dc51ae7f8885c
260 Bytes Download
md5:ab62319526f060a90422a8139d3e3eea
249 Bytes Download
md5:bdf165d7621049b0bfa912a7b151568e
247 Bytes Download
md5:46ebf515ee509776a95e191844f72668
298.9 kB Download
md5:52ccc767e9bdf6d38293323901673968
286.9 kB Download
md5:18b2b18816e6a50f4c64058226a85aeb
273.6 kB Download
md5:1a0b044bf6a61012f158319a90ed4985
251.7 kB Download
md5:5c6ee6c1c325663635de61bcf23184ec
152.1 kB Download
md5:b51fc15d922b01938a5b72349eee3277
187.9 kB Download
md5:dfa94e7942c3e5dbc802f0436717da89
228.0 kB Download
md5:59b5b5c6869fe7b216d33ae6a01e0cae
248.7 kB Download
md5:c5ad72efcdc951407b12d573cb81b6e2
19.8 kB Download
md5:e57c94c28a3410b207e83d3f46ab0bd1
32.8 kB Download
md5:6645cfcff539f62dd6856c2bf4959448
30.0 kB Download
md5:604faf4d3bed074c52ff987b88c6d0f6
24.3 kB Download
md5:65b9c7d3aa52dafd8e7e05ece3fd94af
128.3 kB Download
md5:4b2f70379c9d31d054987fcd8186806b
132.9 kB Download
md5:21aa60b2fd6acd2970f950210f1fa9f6
119.3 kB Download
md5:ee117589789acc5c65199e15eea574fd
106.5 kB Download
md5:acfe6c78cb99dafb7a2142aaabc47471
129.6 kB Download
md5:f4b7bb98472286d53b90281305ccbd1c
99.2 kB Download
md5:96a18f593d70e29df201324e75f9e470
121.8 kB Download
md5:d525526e951ae10a0aa1e95b96bf16cd
79.9 kB Download
md5:774cad385993b649be0dcc1af6ffb7e5
20.2 kB Download
md5:f7ab6dc88012d2769a2145bc4e6444d0
31.0 kB Download
md5:c407087b938fdaea6663e3228e299c86
28.6 kB Download
md5:f33304f83758e7a1d329ae9255d3e823
23.7 kB Download

Additional details

Related works

Is documented by
Journal article: 10.1371/journal.pone.0165773 (DOI)
Is referenced by
Journal article: 10.1109/TNSRE.2019.2962708 (DOI)