Kinectofon: Performing with Shapes in Planes

"The paper presents the Kinectofon, an instrument for creating sounds throughfree-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again,are used as the source material for a sonification process based on inverseFFT. The instrument is intuitive to play, allowing the performer to createsound by ""touching"" a virtual sound wall."