Conference paper Open Access
Evaluating a Collection of Sound-Tracing Data of Melodic Phrases
Tejaswinee Kelkar; Udit Roy; Alexander Refsum Jensenius
Melodic contour, the 'shape' of a melody, is a common way to visualize and remember a musical piece. The purpose of this paper is to explore the building blocks of a future 'gesture-based' melody retrieval system. We present a dataset containing 16 melodic phrases from four musical styles and with a large range of contour variability. This is accompanied by full-body motion capture data of 26 participants performing sound-tracing to the melodies. The dataset is analyzed using canonical correlation analysis (CCA), and its neural network variant (Deep CCA), to understand how melodic contours and sound tracings relate to each other. The analyses reveal non-linear relationships between sound and motion. The link between pitch and verticality does not appear strong enough for complex melodies. We also find that descending melodic contours have the least correlation with tracings.
Files
(546.2 kB)
| Name | Size | |
|---|---|---|
|
209_Paper.pdf
md5:ed6fd7e0de2de6b4b121c80b891ff54e |
546.2 kB | Download |
108
47
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 108 | 109 |
| Downloads | 47 | 47 |
| Data volume | 25.7 MB | 25.7 MB |
| Unique views | 93 | 94 |
| Unique downloads | 45 | 45 |
Indexed in
- Publication date:
- September 23, 2018
- DOI:
-
- Published in:
- Proceedings of the 19th International Society for Music Information Retrieval Conference, ISMIR, Paris, France, pp. 74-81.
- Meeting:
- International Society for Music Information Retrieval Conference (ISMIR 2018), Paris, France, September 23-27, 2018
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International