Published March 18, 2024 | Version v1
Dataset Open

N20EMv2 dataset for automatic music transcription from multimodal singing

Description

N20EMv2 dataset for multimodal automatic music transcription from multimodal singing, presented in our TOMM 2024 paper, Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing. This dataset contains recordings of two modalities: audio and video. 

Our paper is available at: https://dl.acm.org/doi/10.1145/3651310.

Code is available at: https://github.com/guxm2021/SVT_SpeechBrain

Please cite our work as:

@article{gu2024automatic,
  title={Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing}, 
  author={Gu, Xiangming and Ou, Longshen and Zeng, Wei and Zhang, Jianan and Wong, Nicholas and Wang, Ye},
  journal={ACM Transactions on Multimedia Computing, Communications and Applications},
  publisher={ACM New York, NY},
  year={2024}
}

Files

annotations.json

Files (11.5 GB)

Name Size Download all
md5:7a16c0c9f032c415ecfbade5997b3d5e
1.4 MB Preview Download
md5:ae89423aea0215e9e8675d63d88fe652
1.3 GB Preview Download
md5:a5281c734dfe5cc0f138e88f25e95027
362.6 MB Preview Download
md5:f30c28df08b46ccb4a2e121bb58a9439
1.4 GB Preview Download
md5:d70f78904f5a7d4f8f6647dbe0a641fd
1.3 GB Preview Download
md5:43f8e5b5e513ac69989be9d6bf421b1f
1.1 GB Preview Download
md5:5a27852e907200e5d44423ac6363a247
1.3 GB Preview Download
md5:c0ff35d45161448daa52423976e3202e
1.3 GB Preview Download
md5:baf22100ef2bef70172e1af94000880d
1.1 GB Preview Download
md5:1e8ae7031058c10716c0744ccb10136a
1.3 GB Preview Download
md5:f90d134786c982d0244bd2bfbcc959c9
1.1 GB Preview Download

Additional details

Related works

Is published in
Journal article: 10.1145/3651310 (DOI)

Software

Repository URL
https://github.com/guxm2021/SVT_SpeechBrain
Programming language
Python
Development Status
Active

References

  • Gu X, Ou L, Zeng W, et al. Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing[J]. ACM Transactions on Multimedia Computing, Communications and Applications.