10.5281/zenodo.4064409
https://zenodo.org/records/4064409
oai:zenodo.org:4064409
Gaddy, David
David
Gaddy
UC Berkeley
Silent Speech EMG
Zenodo
2020
2020-10-02
10.5281/zenodo.4064408
1.0
Creative Commons Attribution 4.0 International
Facial electromyography recordings during both silent and vocalized speech.
This data is described in the publication "Digital Voicing of Silent Speech" at EMNLP 2020 (https://arxiv.org/abs/2010.02960).
Code for processing this data can be found at https://github.com/dgaddy/silent_speech.
Each data sample has 5 data files: {i}_emg.npy - a saved numpy array of size (T, 8) with the raw EMG signals; {i}_audio.flac - the raw audio recording; {i}_audio_clean.flac - audio with background noise reduced; {i}_info.json - JSON with extra information, such as the text prompt that was read; {i}_button.npy - a numpy array containing device button state, which is generally unused. Note that some samples do not represent actual datapoints, but are used as reference EMG or audio signals. These samples are marked with "sentence_index: -1" in the associated info file.