Published January 20, 2025 | Version v2
Dataset Open

VocalMind: A Stereotactic EEG Dataset for Vocalized, Mimed, and Imagined Speech in Tonal Language

  • 1. Chinese University of Hong Kong, Shenzhen
  • 2. ROR icon Shenzhen University
  • 3. Chinese University of Hongkong, Shenzhen

Description

 Speech BCIs based on implanted electrodes hold significant promise for enhancing spoken communication through high temporal resolution and invasive neural sensing. Despite the potential, acquiring such data is challenging due to its invasive nature, and publicly available datasets, particularly for tonal languages, are limited. In this study, we introduce VocalMind, a stereotactic electroencephalography (sEEG) dataset focused on Mandarin Chinese, a tonal language. This dataset includes sEEG-speech parallel recordings from three distinct speech modes, namely vocalized speech, mimed speech, and imagined speech, at both word and sentence levels, totaling over one hour of intracranial neural recordings related to speech production. This paper also presents a baseline model as the reference model for future studies, at the same time, ensuring the integrity of the dataset. The diversity of tasks and the substantial data volume provide a valuable resource for developing advanced algorithms for speech decoding, thereby advancing BCI research for spoken communication.

Files

Original_Audio_Sentence.zip

Files (3.7 GB)

Name Size Download all
md5:6539216a75561b5c7b35c6152f46916c
110.8 MB Preview Download
md5:504755a852fd0cb47f0f829b3da44daa
34.3 MB Preview Download
md5:76a21aa7f6119662b5e84f77bfc29ee5
520.3 MB Preview Download
md5:302bc108c913914cc7ab748b7e3f519c
188.7 MB Preview Download
md5:058a3296902caa26d7793925395a1a4f
519.0 MB Preview Download
md5:9dfd978d3c4595cdb5a3adb472d5bc4d
187.6 MB Preview Download
md5:efe65b86a55899cf14184e4c8c09696a
506.5 MB Preview Download
md5:1cf951dca48cea887eedf414fdd736e6
190.2 MB Preview Download
md5:b93fc81cd841d85832e9ee83c30b9aca
13.9 MB Preview Download
md5:89339a2fb8e2e4725c42938108e225ae
4.9 MB Preview Download
md5:e153009b4e4a9868d5bb7e4f05b48878
338.0 MB Preview Download
md5:dd7ee3a086e7755e110485bd3f5af15e
120.7 MB Preview Download
md5:adcffafcf6c0a7fe084196002baadbc2
338.0 MB Preview Download
md5:4b6710048a824e7acb442e5f8dac0e3e
120.7 MB Preview Download
md5:068ac1055fb7993a37173e271bb7d61e
338.0 MB Preview Download
md5:31ebd68a28d6af7e89f30efe527c93af
120.7 MB Preview Download