Published June 1, 2020 | Version v1
Conference paper Open

A Laptop Ensemble Performance System using Recurrent Neural Networks

Description

The popularity of applying machine learning techniques in musical domains has created an inherent availability of freely accessible pre-trained neural network (NN) models ready for use in creative applications. This work outlines the implementation of one such application in the form of an assistance tool designed for live improvisational performances by laptop ensembles. The primary intention was to leverage off-the-shelf pre-trained NN models as a basis for assisting individual performers either as musical novices looking to engage with more experienced performers or as a tool to expand musical possibilities through new forms of creative expression. The system expands upon a variety of ideas found in different research areas including new interfaces for musical expression, generative music and group performance to produce a networked performance solution served via a web-browser interface. The final implementation of the system offers performers a mixture of high and low-level controls to influence the shape of sequences of notes output by locally run NN models in real time, also allowing performers to define their level of engagement with the assisting generative models. Two test performances were played, with the system shown to feasibly support four performers over a four minute piece while producing musically cohesive and engaging music. Iterations on the design of the system exposed technical constraints on the use of a JavaScript environment for generative models in a live music context, largely derived from inescapable processing overheads.

Files

nime2020_paper9.mp4

Files (26.2 MB)

Name Size Download all
md5:630739aa5f753c3855d7b5693b70eb48
25.2 MB Preview Download
md5:b03213a882485e7f2f145ebbffac08ee
982.6 kB Preview Download
md5:ad26a026fca53ef78eda1c577cef0a42
13.3 kB Download

Additional details

Related works

Is part of
2220-4806 (ISSN)