Conference paper Open Access

BachDuet: A Deep Learning System for Human-Machine Counterpoint Improvisation

Benetatos, Christodoulos; VanderStel, Joseph; Duan, Zhiyao

Editor(s)
Michon, Romain; Schroeder, Franziska

During theBaroque period, improvisation was a key element of music performance and education. Great musicians, such as J.S. Bach, were better known as improvisers than composers. Today, however, there is a lack of improvisation culture in classical music performance and education; classical musicians either are not trained to improvise, or cannot find other people to improvise with. Motivated by this observation, we develop BachDuet, a system that enables real-time counterpoint improvisation between a human anda machine. This system uses a recurrent neural network toprocess the human musician's monophonic performance ona MIDI keyboard and generates the machine's monophonic performance in real time. We develop a GUI to visualize the generated music content and to facilitate this interaction. We conduct user studies with 13 musically trained users and show the feasibility of two-party duet counterpoint improvisation and the effectiveness of BachDuet for this purpose. We also conduct listening tests with 48 participants and show that they cannot tell the difference between duets generated by human-machine improvisation using BachDuet and those generated by human-human improvisation. Objective evaluation is also conducted to assess the degree to which these improvisations adhere to common rules of counterpoint, showing promising results.
Files (25.8 MB)
Name Size
nime2020_paper125.mp4
md5:282fb66e7d3a1c2b6fe599b850184e8a
24.9 MB Download
nime2020_paper125.pdf
md5:d744ac73fac3c99cfde46fff15cd84e5
922.7 kB Download
nime2020_paper125.srt
md5:31ba1b2a17e5a0aeb341e4ae3bf50d3a
13.0 kB Download
83
45
views
downloads
All versions This version
Views 8383
Downloads 4545
Data volume 89.5 MB89.5 MB
Unique views 6666
Unique downloads 4242

Share

Cite as