Conference paper Open Access

Design for auditory imagery: altering instruments to explore performer fluency

Guidi, Andrea; Morreale, Fabio; McPherson, Andrew

Editor(s)
Michon, Romain; Schroeder, Franziska

In NIME design, thorough attention has been devoted to feedback modalities, including auditory, visual and haptic feedback. How the performer executes the gestures to achieve a sound on an instrument, by contrast, appears to be less examined. Previous research showed that auditory imagery, or the ability to hear or recreate sounds in the mind even when no audible sound is present, is essential to the sensorimotor control involved in playing an instrument. In this paper, we enquire whether auditory imagery can also help to support skill transfer between musical instruments resulting in possible implications for new instrument design. To answer this question, we performed two experimental studies on pitch accuracy and fluency where professional violinists were asked to play a modified violin. Results showed altered or even possibly irrelevant auditory feedback on a modified violin does not appear to be a significant impediment to performance. However, performers need to have coherent imagery of what they want to do, and the sonic outcome needs to be coupled to the motor program to achieve it. This finding shows that the design lens should be shifted from a direct feedback model of instrumental playing toward a model where imagery guides the playing process. This result is in agreement with recent research on skilled sensorimotor control that highlights the value of feedforward anticipation in embodied musical performance. It is also of primary importance for the design of new instruments: new sounds that cannot easily be imagined and that are not coupled to a motor program are not likely to be easily performed on the instrument.
Files (15.8 MB)
Name Size
nime2020_paper20.mp4
md5:6f6e750cc6fd58296d0300c5fdf34cd2
15.5 MB Download
nime2020_paper20.pdf
md5:b8333ed0a341a614ee4614fb3c72db3c
334.6 kB Download
nime2020_paper20.srt
md5:710df23170844cee1227e7a6bfe58dc5
11.6 kB Download
62
28
views
downloads
All versions This version
Views 6262
Downloads 2828
Data volume 39.3 MB39.3 MB
Unique views 4848
Unique downloads 2323

Share

Cite as