Published June 1, 2020 | Version v1
Conference paper Open

BachDuet: A Deep Learning System for Human-Machine Counterpoint Improvisation

Description

During theBaroque period, improvisation was a key element of music performance and education. Great musicians, such as J.S. Bach, were better known as improvisers than composers. Today, however, there is a lack of improvisation culture in classical music performance and education; classical musicians either are not trained to improvise, or cannot find other people to improvise with. Motivated by this observation, we develop BachDuet, a system that enables real-time counterpoint improvisation between a human anda machine. This system uses a recurrent neural network toprocess the human musician's monophonic performance ona MIDI keyboard and generates the machine's monophonic performance in real time. We develop a GUI to visualize the generated music content and to facilitate this interaction. We conduct user studies with 13 musically trained users and show the feasibility of two-party duet counterpoint improvisation and the effectiveness of BachDuet for this purpose. We also conduct listening tests with 48 participants and show that they cannot tell the difference between duets generated by human-machine improvisation using BachDuet and those generated by human-human improvisation. Objective evaluation is also conducted to assess the degree to which these improvisations adhere to common rules of counterpoint, showing promising results.

Files

nime2020_paper125.pdf

Files (25.8 MB)

Name Size Download all
md5:282fb66e7d3a1c2b6fe599b850184e8a
24.9 MB Download
md5:d744ac73fac3c99cfde46fff15cd84e5
922.7 kB Preview Download
md5:31ba1b2a17e5a0aeb341e4ae3bf50d3a
13.0 kB Download

Additional details

Related works

Is part of
2220-4806 (ISSN)