Published June 1, 2020 | Version v1
Conference paper Open

Towards an Interactive Model-Based Sonification of Hand Gesture for Dance Performance

Description

This paper presents an ongoing research on hand gesture interactive sonification in dance performances. For this purpose, a conceptual framework and a multilayered mapping model issued from an experimental case study will be proposed. The goal of this research is twofold. On the one hand, we aim to determine action-based perceptual invariants that allow us to establish pertinent relations between gesture qualities and sound features. On the other hand, we are interested in analysing how an interactive model-based sonification can provide useful and effective feedback for dance practitioners. From this point of view, our research explicitly addresses the convergence between the scientific understandings provided by the field of movement sonification and the traditional know-how developed over the years within the digital instrument and interaction design communities. A key component of our study is the combination between physically-based sound synthesis and motion features analysis. This approach has proven effective in providing interesting insights for devising novel sonification models for artistic and scientific purposes, and for developing a collaborative platform involving the designer, the musician and the performer.

Files

nime2020_paper72.mp4

Files (67.9 MB)

Name Size Download all
md5:a0f2d5047083474435285acef487ab8c
67.1 MB Preview Download
md5:47c6d81ce81972c741a52996e75a3737
752.5 kB Preview Download
md5:f54ebe5f2be7fbe397cdfbcb63395b0a
12.0 kB Download

Additional details

Related works

Is part of
2220-4806 (ISSN)