Conference paper Open Access

Evaluating a Collection of Sound-Tracing Data of Melodic Phrases

Tejaswinee Kelkar; Udit Roy; Alexander Refsum Jensenius

JSON-LD ( Export

  "description": "Melodic contour, the 'shape' of a melody, is a common way to visualize and remember a musical piece. The purpose of this paper is to explore the building blocks of a future 'gesture-based' melody retrieval system. We present a dataset containing 16 melodic phrases from four musical styles and with a large range of contour variability. This is accompanied by full-body motion capture data of 26 participants performing sound-tracing to the melodies. The dataset is analyzed using canonical correlation analysis (CCA), and its neural network variant (Deep CCA), to understand how melodic contours and sound tracings relate to each other. The analyses reveal non-linear relationships between sound and motion. The link between pitch and verticality does not appear strong enough for complex melodies. We also find that descending melodic contours have the least correlation with tracings.", 
  "license": "", 
  "creator": [
      "@type": "Person", 
      "name": "Tejaswinee Kelkar"
      "@type": "Person", 
      "name": "Udit Roy"
      "@type": "Person", 
      "name": "Alexander Refsum Jensenius"
  "headline": "Evaluating a Collection of Sound-Tracing Data of Melodic Phrases", 
  "image": "", 
  "datePublished": "2018-09-23", 
  "url": "", 
  "@type": "ScholarlyArticle", 
  "@context": "", 
  "identifier": "", 
  "@id": "", 
  "workFeatured": {
    "url": "", 
    "alternateName": "ISMIR 2018", 
    "location": "Paris, France", 
    "@type": "Event", 
    "name": "International Society for Music Information Retrieval Conference"
  "name": "Evaluating a Collection of Sound-Tracing Data of Melodic Phrases"
All versions This version
Views 110111
Downloads 4747
Data volume 25.7 MB25.7 MB
Unique views 9596
Unique downloads 4545


Cite as