WikiMuTe: A web-sourced dataset of semantic descriptions for music audio
Description
This upload contains the supplementary material for our paper presented at the MMM2024 conference.
Dataset
The dataset contains rich text descriptions for music audio files collected from Wikipedia articles.
The audio files are freely accessible and available for download through the URLs provided in the dataset.
Example
A few hand-picked, simplified examples of the dataset.
file |
aspects |
sentences |
['bongoes', 'percussion instrument', 'cumbia', 'drums'] |
['a loop of bongoes playing a cumbia beat at 99 bpm'] |
|
🔈 Example of double tracking in a pop-rock song (3 guitar tracks).ogg |
['bass', 'rock', 'guitar music', 'guitar', 'pop', 'drums'] |
['a pop-rock song'] |
['jazz standard', 'instrumental', 'jazz music', 'jazz'] |
['Considered to be a jazz standard', 'is an jazz composition'] |
|
['chirping birds', 'ambient percussion', 'new-age', 'flute', 'recorder', 'single instrument', 'woodwind'] |
['features a single instrument with delayed echo, as well as ambient percussion and chirping birds', 'a new-age composition for recorder'] |
|
['instrumental', 'brass band'] |
['an instrumental brass band performance'] |
|
... |
... |
... |
Dataset structure
We provide three variants of the dataset in the data
folder.
All are described in the paper.
all.csv
contains all the data we collected, without any filtering.filtered_sf.csv
contains the data obtained using the self-filtering method.filtered_mc.csv
contains the data obtained using the MusicCaps dataset method.
File structure
Each CSV file contains the following columns:
file
: the name of the audio filepageid
: the ID of the Wikipedia article where the text was collected fromaspects
: the short-form (tag) description texts collected from the Wikipedia articlessentences
: the long-form (caption) description texts collected from the Wikipedia articlesaudio_url
: the URL of the audio fileurl
: the URL of the Wikipedia article where the text was collected from
Citation
If you use this dataset in your research, please cite the following paper:
@inproceedings{wikimute,
title = {WikiMuTe: {A} Web-Sourced Dataset of Semantic Descriptions for Music Audio},
author = {Weck, Benno and Kirchhoff, Holger and Grosche, Peter and Serra, Xavier},
booktitle = "MultiMedia Modeling",
year = "2024",
publisher = "Springer Nature Switzerland",
address = "Cham",
pages = "42--56",
doi = {10.1007/978-3-031-56435-2_4},
url = {https://doi.org/10.1007/978-3-031-56435-2_4},
}
License
The data is available under the Creative Commons Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0) license.
Each entry in the dataset contains a URL linking to the article, where the text data was collected from.
Files
all.csv
Additional details
Related works
- Is supplement to
- Preprint: arXiv:2312.09207 (arXiv)
- Publication: 10.1007/978-3-031-56435-2_4 (DOI)
- Is supplemented by
- Software: https://github.com/Bomme/wikimute (URL)