Published March 7, 2022 | Version v1
Journal article Open

Toward an Attentive Robotic Architecture: Learning-Based Mutual Gaze Estimation in Human–Robot Interaction

  • 1. Humanoid Sensing and Perception, Istituto Italiano di Tecnologia, Genova, Italy
  • 2. Social Cognition in Human-Robot Interaction, Istituto Italiano di Tecnologia, Genova, Italy

Description

Social robotics is an emerging field that is expected to grow rapidly in the near future. In fact, it is increasingly more frequent to have robots that operate in close proximity with humans or even collaborate with them in joint tasks. In this context, the investigation of how to endow a humanoid robot with social behavioral skills typical of human–human interactions is still an open problem. Among the countless social cues needed to establish a natural social attunement, this article reports our research toward the implementation of a mechanism for estimating the gaze direction, focusing in particular on mutual gaze as a fundamental social cue in face-to-face interactions. We propose a learning-based framework to automatically detect eye contact events in online interactions with human partners. The proposed solution achieved high performance both in silico and in experimental scenarios. Our work is expected to be the first step toward an attentive architecture able to endorse scenarios in which the robots are perceived as social partners.

Files

MutualGazeClassifier_FrontiersRobotics_main.pdf

Files (17.1 MB)

Name Size Download all
md5:768f54363cb661fbcddd9d5c3c56816e
1.9 MB Preview Download
md5:baab3997d41d604847ad88acdea45a25
2.3 MB Preview Download
md5:324ba92fc6906db02589c3c2e57b789f
12.8 MB Download

Additional details

Funding

InStance – Intentional stance for social attunement 715058
European Commission