Published June 1, 2020 | Version v1
Conference paper Open

Brainwaves-driven Effects Automation in Musical Performance

Description

A variety of controllers with multifarious sensors and functions have maximized the real time performers control capabilities. The idea behind this project was to create an interface which enables the interaction between the performers and the effect processor measuring their brain waves amplitudes, e.g., alpha, beta, theta, delta and gamma, not necessarily with the user's awareness. We achieved this by using an electroencephalography (EEG) sensor for detecting performer's different emotional states and, based on these, sending midi messages for digital processing units automation. The aim is to create a new generation of digital processor units that could be automatically configured in real-time given the emotions or thoughts of the performer or the audience. By introducing emotional state information in the real time control of several aspects of artistic expression, we highlight the impact of surprise and uniqueness in the artistic performance.

Files

nime2020_paper105.mp4

Files (250.8 MB)

Name Size Download all
md5:a151826a6d611439d124f9f780041955
250.5 MB Preview Download
md5:9cc4428c02ce09dadd7b4ee698a153cd
272.0 kB Preview Download
md5:e1f29daeacbafdae36d92c307e54c9a1
2.6 kB Download

Additional details

Related works

Is part of
2220-4806 (ISSN)