Conference paper Open Access

NIME or Mime: A Sound-First Approach to Developing an Audio-Visual Gestural Instrument

Ilsar, Alon A; Hughes, Matthew; Johnston, Andrew

Editor(s)
Michon, Romain; Schroeder, Franziska

This paper outlines the development process of an audio-visual gestural instrument—the AirSticks—and elaborates on the role 'miming' has played in the formation of new mappings for the instrument. The AirSticks, although fully-functioning, were used as props in live performances in order to evaluate potential mapping strategies that were later implemented for real. This use of mime when designing Digital Musical Instruments (DMIs) can help overcome choice paralysis, break from established habits, and liberate creators to realise more meaningful parameter mappings. Bringing this process into an interactive performance environment acknowledges the audience as stakeholders in the design of these instruments, and also leads us to reflect upon the beliefs and assumptions made by an audience when engaging with the performance of such 'magical' devices. This paper establishes two opposing strategies to parameter mapping, 'movement-first' mapping, and the less conventional 'sound-first' mapping that incorporates mime. We discuss the performance 'One Five Nine', its transformation from a partial mime into a fully interactive presentation, and the influence this process has had on the outcome of the performance and the AirSticks as a whole.
Files (66.9 MB)
Name Size
nime2020_paper60.mp4
md5:b6a4715836e7352aa846db5d3b4de44a
66.3 MB Download
nime2020_paper60.pdf
md5:faf6c938c3ad3b31baf9111cb34be89a
620.5 kB Download
nime2020_paper60.srt
md5:2b1cc7f4cec9157095dc0704363a1afa
11.7 kB Download
68
38
views
downloads
All versions This version
Views 6868
Downloads 3838
Data volume 23.6 MB23.6 MB
Unique views 5656
Unique downloads 3535

Share

Cite as