Published June 1, 2020 | Version v1
Conference paper Open

Felt Sound: A Shared Musical Experience for the Deaf and Hard of Hearing

Description

We present a musical interface specifically designed for inclusive performance that offers a shared experience for both individuals who are deaf and hard of hearing as well as those who are not. This interface borrows gestures (with or without overt meaning) from American Sign Language (ASL), rendered using low-frequency sounds that can be felt by everyone in the performance. The Deaf and Hard of Hearing cannot experience the sound in the same way. Instead, they are able to physically experience the vibrations, nuances, contours, as well as its correspondence with the hand gestures. Those who are not hard of hearing can experience the sound, but also feel it just the same, with the knowledge that the same physical vibrations are shared by everyone. The employment of sign language adds another aesthetic dimension to the instrument --a nuanced borrowing of a functional communication medium for an artistic end.

Files

nime2020_paper34.mp4

Files (68.7 MB)

Name Size Download all
md5:8cd5769dac5a2b730736ea3dbc94a70d
66.4 MB Preview Download
md5:6313f4076694975726e8d26ea200e47d
2.3 MB Preview Download
md5:80bf1b6657e8237e8f9963b018cc0902
9.4 kB Download

Additional details

Related works

Is part of
2220-4806 (ISSN)