Published April 7, 2022 | Version 1.0
Report Open

D3.2 AI-based Indoor Scene Understanding v2

Description

This deliverable documents the approaches for designing and developing the data-driven models that drive
the ATLANTIS AI services backend. Their basic principle of operation is monocular inference from spherical
panoramas which means that depending on the task at hand, these models will need to provide solutions for
challenging, ill-posed problems. Yet the recent developments in data-driven models and the expanded
availability of data are the drivers of such emerging services, upon which innovative tools and applications
like the ATLANTIS authoring tool can be developed. In this updated version, the improved results from WP3
are presented which include works for scene layout and depth estimation, semantic segmentation, and a
novel generative approach for Diminished Reality applied at spherical panoramas. These services have been
integrated into the ATLANTIS application and assessed in the validation. Note that the deployment-related
aspects (e.g., APIs, registration of the AR scene with the real room) are described in D4.2.

Files

ATLANTIS-D3.2-AIbased_scene_understanding-v2_final.pdf

Files (43.2 MB)

Additional details

Funding

ATLANTIS – AuThoring tooL for indoor Augmented and dimiNished realiTy experIenceS 951900
European Commission