Published April 14, 2021 | Version Accepted pre-print
Conference paper Open

Look Behind You! – Using a Face Camera for Mobile Augmented Reality Odometry

  • 1. Faculty of Informatics, Masaryk University, Brno, Czech Republic
  • 2. Research Centre on Interactive Media, Smart Systems and Emerging Technologies (RISE), Nicosia 1011, Cyprus


Augmented reality applications provide new ways of presenting
cultural heritage assets thanks to the recent advancement in the eld
of smart devices. Unfortunately, the construction of the hardware and
lower computational power of mobile processors limit the potential of
these applications. Namely, almost all current visual-inertial odometry
libraries employed in smartphones require the real tracked objects to be
close and contain distinguishable features, which is an issue when observing
large virtual structures outdoors like historical buildings or objects
on plain walls of halls or museums. This paper exploits the possibility of
using the face cameras available in mobile devices for augmented reality
tracking. It designs a prototype composed of iPhone and iPad devices
and evaluates its contribution in two scenarios that current systems cannot
handle. The results reveal the clear benet of this approach for the
cultural heritage, allowing it to operate in situations when users look up
in the sky to see the roof of virtual buildings, or when they move closer
to a white wall to perceive details of a virtual painting. In the end, the
paper discusses the system's limitations and proposes solutions to them.


This work has been partly supported by the project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 739578 (RISE – Call: H2020-WIDESPREAD-01-2016-2017-TeamingPhase2) and the Republic of Cyprus through the Deputy Ministry of Research, Innovation and Digital Policy.



Files (1.4 MB)

Name Size Download all
1.4 MB Preview Download

Additional details


RISE – Research Center on Interactive Media, Smart System and Emerging Technologies 739578
European Commission