Conference paper Open Access

Global Flow and Temporal-shape Descriptors for Human Action Recognition from 3D Reconstruction Data

Papadopoulos, Georgios Th.; Daras, Petros

In this paper, global-level view-invariant descriptors for human action recognition using 3D reconstruction data are proposed. 3D reconstruction techniques are employed for addressing two of the most challenging issues related to human action recognition in the general case, namely view-variance and the presence of (self-) occlusions. Initially, a set of calibrated Kinect sensors are employed for producing a 3D reconstruction of the performing subjects. Subsequently, a 3D flow field is estimated for every captured frame. For performing action recognition, a novel global 3D flow descriptor is introduced, which achieves to efficiently encode the global motion characteristics in a compact way, while also incorporating spatial distribution related information. Additionally, a new global temporal-shape descriptor that extends the notion of 3D shape descriptions for action recognition, by including temporal information, is also proposed. The latter descriptor efficiently addresses the inherent problems of temporal alignment and compact representation, while also being robust in the presence of noise. Experimental results using public datasets demonstrate the efficiency of the proposed approach.

Files (1.1 MB)
Name Size
mldm-camera-ready.pdf
md5:d276f6e3b8dbbc96c2449fed850dfd99
1.1 MB Download
41
16
views
downloads
All versions This version
Views 4141
Downloads 1616
Data volume 17.5 MB17.5 MB
Unique views 4040
Unique downloads 1616

Share

Cite as