Conference paper Open Access

Adaptive Multimodal Music Learning via Interactive Haptic Instrument

Zhang, Yian; Li, Yinmiao; Chin, Daniel; Xia, Gus

Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We have recently seen various improvements of interface design on tactile feedback and force guidance aiming to make instrument learning more effective. However, most interfaces are still quite static; they cannot yet sense the learning progress and adjust the tutoring strategy accordingly. To solve this problem, we contribute an adaptive haptic interface based on the latest design of haptic flute. We first adopted a clutch mechanism to enable the interface to turn on and off the haptic control flexibly in real time. The interactive tutor is then able to follow human performances and apply the "teacher force" only when the software instructs so. Finally, we incorporated the adaptive interface with a step-by-step dynamic learning strategy. Experimental results showed that dynamic learning dramatically outperforms static learning, which boosts the learning rate by 45.3% and shrinks the forgetting chance by 86%.

Files (951.4 kB)
Name Size
nime2019_paper028.pdf
md5:f6ca1fdafabb7ca86906c4a5a4d4928e
951.4 kB Download
42
36
views
downloads
All versions This version
Views 4242
Downloads 3636
Data volume 34.3 MB34.3 MB
Unique views 3939
Unique downloads 3030

Share

Cite as