Published July 15, 2017 | Version Camera-ready
Conference paper Open

Global Flow and Temporal-shape Descriptors for Human Action Recognition from 3D Reconstruction Data

  • 1. Centre for Research and Technology Hellas


In this paper, global-level view-invariant descriptors for human action recognition using 3D reconstruction data are proposed. 3D reconstruction techniques are employed for addressing two of the most challenging issues related to human action recognition in the general case, namely view-variance and the presence of (self-) occlusions. Initially, a set of calibrated Kinect sensors are employed for producing a 3D reconstruction of the performing subjects. Subsequently, a 3D flow field is estimated for every captured frame. For performing action recognition, a novel global 3D flow descriptor is introduced, which achieves to efficiently encode the global motion characteristics in a compact way, while also incorporating spatial distribution related information. Additionally, a new global temporal-shape descriptor that extends the notion of 3D shape descriptions for action recognition, by including temporal information, is also proposed. The latter descriptor efficiently addresses the inherent problems of temporal alignment and compact representation, while also being robust in the presence of noise. Experimental results using public datasets demonstrate the efficiency of the proposed approach.



Files (1.1 MB)

Name Size Download all
1.1 MB Preview Download

Additional details


DANTE – Detecting and ANalysing TErrorist-related online contents and financing activities 700367
European Commission