Published August 16, 2026 | Version v2

Replication package — Doing MOS and its alternatives well: a variance-decomposition guide for TTS perceptual evaluation

  • 1. ROR icon Institut de Recherche en Informatique et Systèmes Aléatoires

Description

Replication package for the paper Doing MOS—and its alternatives—well: a variance-decomposition guide for TTS perceptual evaluation (Chevelu & Barbot, Univ. Rennes, CNRS, IRISA; Computer Speech & Language, Special Issue on the evaluation of speech and speech synthesis). It contains the code, frozen output tables and figures that reproduce every quantitative claim in the paper, organised by section: variance/CI experiments, the K=2 allocation penalty, the BTTF case study, the multi-edition Blizzard Challenge panorama, the corpus design census, and the AnytimeMonitor worked example. Redistributed Blizzard Challenge listening-test scores are included with attribution (no audio). The AnytimeMonitor controller driving Section 8 is released separately as the anytimemonitor software (linked). MIT licence.

Files

doing-mos-well-replication-v2.zip

Files (4.5 MB)

Name Size
md5:5923e60552abb3b432a10549d527d18f
4.5 MB Preview Download

Additional details

Related works

References
Software: 10.5281/zenodo.21326813 (DOI)