Published June 1, 2020 | Version v1
Conference paper Open

Elemental: a Gesturally Controlled System to Perform Meteorological Sounds

Description

In this paper, we present and evaluate Elemental, a NIME (New Interface for Musical Expression) based on audio synthesis of sounds of meteorological phenomena, namely rain, wind and thunder, intended for application in contemporary music/sound art, performing arts and entertainment. We first describe the system, controlled by the performer's arms through Inertial Measuring Units and Electromyography sensors. The produced data is analyzed and used through mapping strategies as input of the sound synthesis engine. We conducted user studies to refine the sound synthesis engine, the choice of gestures and the mappings between them, and to finally evaluate this proof of concept. Indeed, the users approached the system with their own awareness ranging from the manipulation of abstract sound to the direct simulation of atmospheric phenomena - in the latter case, it could even be to revive memories or to create novel situations. This suggests that the approach of instrumentalization of sounds of known source may be a fruitful strategy for constructing expressive interactive sonic systems.

Files

nime2020_paper90.mp4

Files (6.3 MB)

Name Size Download all
md5:36ebc15014698cfe15e1d21a2ce81848
5.6 MB Preview Download
md5:faa9da5cc857dee3907beaf98c2e2a1c
700.1 kB Preview Download

Additional details

Related works

Is part of
2220-4806 (ISSN)