Conference paper Open Access

Virtual Reality Conferencing: Multi-user immersive VR experiences on the web

Gunkel, Simon N.B.; Stokking, Hans M.; Prins, Martin J.; van der Stap, Nanda; ter Haar, Frank B.; Niamut, Omar A.; Niamut Omar A.

Virtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. While Social VR applications are getting more momentum, most services regarding Social VR focus on animated avatars. In this demo, we present our efforts towards Social VR services based on photo-realistic video recordings. In this demo paper, we focus on two parts, the communication between multiple people (max 3) and the integration of new media formats to represent users as 3D point clouds. We enhance a green screen (chroma key) like cut-out of the person with depth data, allowing point cloud based rendering in the client.
Further, the paper presents a user study with 54 people evaluating a three-people communication use case and a technical analysis to move towards 3D representations of users. This demo consists of two shared virtual environments to communicate and interact with others, i.e. i) a 360-degree virtual space with users being represented as 2D video streams (with the background removed) and ii) a 3D space with users being represented as point clouds (based on color and depth video data).

Files (741.3 kB)
Name Size
01_2018-MMsys-TNO-virtual-reality-conferencing.CR.pdf
md5:4f4b265f60f0f2b9cf456f6b91857bfe
741.3 kB Download
24
18
views
downloads
All versions This version
Views 2424
Downloads 1818
Data volume 13.3 MB13.3 MB
Unique views 2121
Unique downloads 1515

Share

Cite as