EMG and Video Dataset for sensor fusion based hand gestures recognition
- 1. Institute of Neuroinformatics, UZH/ETH Zurich
Description
This dataset contains data for hand gesture recognition recorded with 3 different sensors.
sEMG: recorded via the Myo armband that is composed of 8 equally spaced non-invasive sEMG sensors that can be placed approximately around the middle of the forearm. The sampling frequency of Myo is 200 Hz. The output of the Myo is a.u
DVS: Dynamic Video Sensor which is a very low power event-based camera with 128x128 resolution
DAVIS: Dynamic Video Sensor which is a very low power event-based camera with 240x180 resolution that also acquires APS frames.
The dataset contains recordings of 21 subjects. Each subject performed 3 sessions, where each of the 5 hand gesture was recorded 5 times, each lasting for 2s. Between the gestures a relaxing phase of 1s is present where the muscles could go to the rest position, removing any residual muscular activation.
Note: All the information for the DVS sensor has been extracted and can be found in the *.npy files. In case the raw data (.aedat) was needed please contact
enea.ceolini@ini.uzh.ch
elisa@ini.uzh.ch
==== README ====
DATASET STRUCTURE:
EMG, DVS and APS recordings
21 subjects
3 sessions for each subject
5 gestures in each session ('pinky', 'elle', 'yo', 'index', 'thumb')
SINGLE DATASETS:
- relax21_raw_emg.zip: contains raw sEMG and annotations (ground truth of gestures) in the format `subjectXX_sessionYY_ZZZ` with `XX` subject ID (01 to 21), `YY` session ID (01-03) and `ZZZ` that can be ‘emg’ or ‘ann’.
- relax21_raw_dvs.zip: contains the full-frame dvs events in an array with dimensions 0 -> addr_x, 1 -> addr_y, 2 -> timestamp, 3 -> polarity. The timestamps are in seconds and synchronized with the Myo. Each file is in the format `subjectXX_sessionYY_dvs` with `XX` subject ID (01 to 21), `YY` session ID (01-03).
- relax21_cropped_aps.zip: contains the 40x40 pixel aps frames for all subjects and trials in the format `subjectXX_sessionYY_Z_W_K` with `XX` subject ID (01 to 21), `YY` session ID (01-03), Z gesture ('pinky', 'elle', 'yo', 'index', 'thumb’), W trial ID (1-5), `K` frame index.
- relax21_cropped_dvs_emg_spikes.pkl: spiking dataset that can be used to reproduce the results in the paper. The dataset is a dictionary with the following keys:
- - y: array of size 1xN with the class (0->4).
- - sub: array of size 1xN with the subject id (1->10).
- - sess: array of size 1xN with the session id (1->3).
- - dvs: list of length N, each object in the list is a 2d array of size 4xT_n where T_n is the number of events in the trial and the 4 dimensions rappresent: 0 -> addr_x, 1 -> addr_y, 2 -> timestamp, 3 -> polarity .
- - emg: list of length N, each object in the list is a 2d array of size 3xT_n where T_n is the number of events in the trial and the 3 dimensions rappresent: 0 -> addr, 1 -> timestamp, 3 -> polarity.
Files
relax21_cropped_aps.zip
Files
(8.3 GB)
Name | Size | Download all |
---|---|---|
md5:0aca5c68eb7cecffcd9f2e3a53cb9124
|
186.9 MB | Preview Download |
md5:8bda33fec74cb4f49a05c6a89eef7163
|
2.0 GB | Download |
md5:e767b6b586c8f6919f945d770fbac529
|
1.6 GB | Preview Download |
md5:9fab8c87e8f04a56c3fdcb1797644885
|
12.7 MB | Preview Download |
md5:074dd072bb2c64726714e9b21c87dac7
|
469.2 kB | Download |
md5:c3c2b5d6bb5fdd1e94c598a399c2fcab
|
139.1 MB | Download |
md5:bcc5d4ccb794f857f9152ab57a1d2b44
|
725.3 MB | Download |
md5:52ed4aa4bb3efabdfc635fccd1f08b1b
|
19.8 MB | Download |
md5:a986c702b71475ce35f16ea2b6164a31
|
76.7 MB | Download |
md5:7ba520a4cc840e5768fdb5ef58123809
|
750.7 kB | Download |
md5:9f4874ed70666c163325f60f45353363
|
503.5 kB | Download |
md5:8efca1dd041bb66d205515d88456b14c
|
132.4 MB | Download |
md5:b0108a92a6f82ed1243435828c442b0d
|
800.1 MB | Download |
md5:71013adc9bb93de7aa910df74eb86a71
|
20.3 MB | Download |
md5:ff9b41078afbf7f19b7091e2a7b6f108
|
78.7 MB | Download |
md5:5e84527a71c35f4ed93b08a2577eceda
|
805.5 kB | Download |
md5:25a37147ba135422490a96c67f2f3c3b
|
506.9 kB | Download |
md5:4ffa7eae007bd7dd77176ac9bbccf8ff
|
134.2 MB | Download |
md5:0557e1415cdf16b81ae63eb22e8e20cb
|
602.4 MB | Download |
md5:98a10ff19fe21701467c0cfecbc053d1
|
14.7 MB | Download |
md5:b79770ad0e21931fc68b0ba7f6f1500b
|
55.9 MB | Download |
md5:2ead7e33c4355e4975430ab0ac175f5e
|
811.0 kB | Download |
md5:b77306f2bd5fdd6fc1a9e9cb3ed3f4ea
|
506.5 kB | Download |
md5:4ad4d3c2975468cb6bd5cb4a541a16d5
|
133.8 MB | Download |
md5:9f01bd8c918e1dde12cfae9fe0f4da81
|
596.1 MB | Download |
md5:e8a460aec91c8ae32d4fde9695dd9f5f
|
15.8 MB | Download |
md5:d0cb00275f0d16e844c9fb6af7685018
|
57.0 MB | Download |
md5:90517b3013d8410e2461b7bcea4c0ece
|
810.3 kB | Download |
md5:5d82018828a802df886e2bf0a2862f6d
|
506.6 kB | Download |
md5:d0b8fc7aca971bce7101faca94215e2a
|
135.8 MB | Download |
md5:b56b518a8614183dcd3dbd136cc0d899
|
613.9 MB | Download |
md5:1d60d6697059a79d12d78afa22a37657
|
15.4 MB | Download |
md5:c768552e8aa5731f1b4eef99556a77a5
|
58.2 MB | Download |
md5:4c18646b291bf8e835f8e4cd53831a1f
|
810.5 kB | Download |