Meet HER: A Language-based Approach to Generative Music Systems Evaluation

Consensus and standardised procedures in the evaluation of generative music systems are hard to come by. In this paper, a novel human-based method adapted from a machine translation metric is proposed and argued to be useful for direct comparison between different systems. To this end, detailed results from a study using this metric for the evaluation of a language-based model for generative counterpoint is presented.