Published May 5, 2023 | Version v1
Conference paper Open

Masking Speech Contents by Random Splicing: is Emotional Expression Preserved?

  • 1. audEERING GmbH, Germany
  • 2. University of Geneva, Switzerland
  • 3. Chair EIHW, University of Augsburg, Germany
  • 4. GLAM, Imperial College London, UK

Description

We discuss the influence of random splicing on the perception of emotional expression in speech signals. Random splicing is the randomized reconstruction of short audio snippets with the aim to obfuscate the speech contents. A part of the German parliament recordings has been random spliced and both versions – the original and the scrambled ones – manually labeled with respect to the arousal, valence and dominance dimensions. Additionally, we run a state-of-the-art transformer-based pre-trained emotional model on the data. We find sufficiently high correlation for the annotations and predictions of emotional dimensions between both sample versions to be confident that machine learners can be trained with random spliced data.

Files

Random_splicing_ICASSP-2.pdf

Files (320.1 kB)

Name Size Download all
md5:841c5e97cb6af0710de759a0f2e74b27
320.1 kB Preview Download

Additional details

Funding

MARVEL – Multimodal Extreme Scale Data Analytics for Smart Cities Environments 957337
European Commission
ECoWeB – Assessing and Enhancing Emotional Competence for Well-Being (ECoWeB) in the Young: A principled, evidence-based, mobile-health approach to prevent mental disorders and promote mental well-being 754657
European Commission