Published July 8, 2021 | Version preprint, under review
Journal article Open

Detecting lies is a child (robot)'s play: gaze-based lie detection in HRI

  • 1. Robotics, Brain and Cognitive Science (RBCS) Italian Institute of Technology
  • 2. University of Waterloo
  • 3. COgNiTive Architecture for Collaborative Technologies (CONTACT), Istituto Italiano di Tecnologia

Description

Robots destined for tasks like teaching or caregiving have to build a long-lasting social rapport with their human partners. This requires, from the robot side, to be capable of assessing whether the partner is trustworthy.  To this aim, a robot should be able to assess whether someone is lying or not, while preserving the pleasantness of the social interaction. We present an approach to promptly detect lies based on pupil dilation, as an intrinsic marker of the lie-associated cognitive load that can be applied in an ecological human-robot interaction, autonomously led by a robot. We demonstrated the validity of the approach with an experiment, in which the iCub humanoid robot engages the human partner by playing the role of a magician in a card game and detects in real-time the partner deceptive behavior. On top of that, we show how the robot can leverage on the gained knowledge about the deceptive behavior of each human partner, to better detect subsequent lies of that individual. Also, we explore whether machine learning models could improve lie detection performances for both known individuals (within-participants) over multiple interactions with the same partner, and with novel partners (between-participant). The proposed setup, interaction and models enable iCub to understand when its partners are lying, which is a fundamental skill for evaluating their trustworthiness and hence improving social human-robot interaction.

Files

MT_phase2_journal_v2_final.pdf

Files (1.3 MB)

Name Size Download all
md5:4a6d592127669b140e18e3b37e655e04
1.3 MB Preview Download

Additional details

Funding

wHiSPER – investigating Human Shared PErception with Robots 804388
European Commission