Published November 24, 2021 | Version v1

Automatic Piano Fingering Estimation Using Recurrent Neural Networks

  • 1. H. Milton Stewart School ofIndustrial and Systems Engineering, Georgia Institute of Technology
  • 2. Center for Music Technology, Georgia Institute of Technology
  • 3. Music and Arts Technology, Indiana University - Purdue University Indianapolis

Description

Deciding piano fingerings is an essential skill for all piano players regardless of their expertise. Traditionally, pianists and piano educators first need to analyze musical scores, then they manually label the fingerings on the scores; however, this process is time-consuming and inefficient. This paper proposes a novel automatic piano fingerings estimating method by utilizing Bidirectional Long Short-term Memory (BI-LSTM) networks — a special type of Recurrent Neural Networks (RNNs). This is one of the first studies to explore the possibilities of applying deep learning to estimate piano fingerings. Together with the new method, a novel input representation is designed to capture the relations between surrounding notes. Furthermore, in addition to directly comparing the estimations with the ground-truth, this paper proposes a novel evaluation metric to assess the playability of the estimated fingerings. The results illustrate the effectiveness of the proposed method that generates playable and accurate estimated fingerings.

Files

Nordic_SMC_2021_paper_3.pdf

Files (487.2 kB)

Name Size
md5:1b9acc7d31b6372b5861e1e769caeea9
487.2 kB Preview Download