Published December 2, 2024 | Version v1
Conference paper Open

"Let's ask what AI thinks then!": Using LLMs for Collaborative Problem-Solving in Virtual Environments

  • 1. Institute of Neurosciences, University of Barcelona
  • 2. ROR icon University College London
  • 3. University of Barcelona

Description

Integrating Large Language Models (LLMs) in immersive virtual environments presents a significant opportunity for enhancing collaborative problem-solving. As online communication becomes increasingly embedded in both our personal and professional lives, tools like LLMs show significant potential to facilitate real-time interaction and improve group dynamics including problem-solving. Leveraging the capabilities of virtual environments, combined with LLMs, can provide engaging, immersive and interactive experiences that are different from those found in traditional settings. This paper explores how these technologies can effectively be utilized to foster collaborative problem-solving in virtual environments, examining both the benefits and challenges of this integration. Finally, this paper proposes a framework for developing applications with integrated LLMs.

Files

ISMAR_24_iXR_Workshop__submitted.pdf

Files (313.6 kB)

Name Size Download all
md5:32ee95d07831fdd801f82fef22ac266c
313.6 kB Preview Download

Additional details

Funding

European Commission
GuestXR - GuestXR: A Machine Learning Agent for Social Harmony in eXtended Reality 101017884