Repurposing Video Game Software for Musical Expression: A Perceptual Approach

The text exposes a perceptual approach to instrument design and composition, and it introduces an instrument that outputs acoustic sound, digital sound, and digital image. We explore disparities between human perception and digital analysis as creative material. Because the instrument repurposes software intended to create video games, we establish a distinction between the notion of ``flow" in music and gaming, questioning how it may substantiate in interaction design. Furthermore, we extrapolate from cognition/attention research to describe how the projected image creates a reactive stage scene without deviating attention from the music.