Conference paper Open Access

Collaborative Musical Performances with Automatic Harp Based on Image Recognition and Force Sensing Resistors

Lu, Yupu; Wu, Yijie; Zhu, Shijie

In this paper, collaborative performance is defined as the performance of the piano by the performer and accompanied by an automatic harp. The automatic harp can play music based on the electronic score and change its speed according to the speed of the performer. We built a 32-channel automatic harp and designed a layered modular framework integrating both hardware and software, for experimental real-time control protocols. Considering that MIDI keyboard lacking information of force (acceleration) and fingering detection, both of which are important for expression, we designed force-sensor glove and achieved basic image recognition. They are used to accurately detect speed, force (corresponding to velocity in MIDI) and pitch when a performer plays the piano.

Files (831.8 kB)
Name Size
nime2019_paper002.pdf
md5:9591fedceb5024a12c0c052870ae3057
831.8 kB Download
83
50
views
downloads
All versions This version
Views 8383
Downloads 5050
Data volume 41.6 MB41.6 MB
Unique views 5858
Unique downloads 4444

Share

Cite as