Published January 23, 2025 | Version v1
Journal article Open

Audio technology for improving social interaction in extended reality

  • 1. Eurecat, Centre Tecnològic de Catalunya, Tecnologies Multimèdia
  • 2. Universitat Pompeu Fabra, Music Technology Group

Description

In recent years, extended reality (XR) has gained interest as a platform for human communication, with the emergence of the “Metaverse” promising to reshape social interactions. At the same time, concerns about harmful behavior and criminal activities in virtual environments have increased. This paper explores the potential of technology to support social harmony within XR, focusing specifically on audio aspects. We introduce the concept of acoustic coherence and discuss why it is crucial for smooth interaction. We further explain the challenges of speech communication in XR, including noise and reverberation, and review sound processing methods to enhance the auditory experience. We also comment on the potential of using virtual reality as a tool for the development and evaluation of audio algorithms aimed at enhancing communication. Finally, we present the results of a pilot study comparing several audio enhancement techniques inside a virtual environment.

Files

frvir-1-1442774.pdf

Files (1.7 MB)

Name Size Download all
md5:38ef8be1a65ce934063389ea4ee95e7d
1.7 MB Preview Download

Additional details

Funding

European Commission
GuestXR - GuestXR: A Machine Learning Agent for Social Harmony in eXtended Reality 101017884