10.5281/zenodo.1055805
https://zenodo.org/records/1055805
oai:zenodo.org:1055805
Mahmoud Elmezain
Mahmoud Elmezain
Ayoub Al-Hamadi
Ayoub Al-Hamadi
Bernd Michaelis
Bernd Michaelis
Hand Gesture Recognition Based on Combined Features Extraction
Zenodo
2009
Gesture Recognition
Computer Vision & Image Processing
Pattern Recognition.
2009-12-21
eng
10.5281/zenodo.1055804
https://zenodo.org/communities/waset
1761
Creative Commons Attribution 4.0 International
Hand gesture is an active area of research in the vision
community, mainly for the purpose of sign language recognition and
Human Computer Interaction. In this paper, we propose a system to
recognize alphabet characters (A-Z) and numbers (0-9) in real-time
from stereo color image sequences using Hidden Markov Models
(HMMs). Our system is based on three main stages; automatic segmentation
and preprocessing of the hand regions, feature extraction
and classification. In automatic segmentation and preprocessing stage,
color and 3D depth map are used to detect hands where the hand
trajectory will take place in further step using Mean-shift algorithm
and Kalman filter. In the feature extraction stage, 3D combined features
of location, orientation and velocity with respected to Cartesian
systems are used. And then, k-means clustering is employed for
HMMs codeword. The final stage so-called classification, Baum-
Welch algorithm is used to do a full train for HMMs parameters.
The gesture of alphabets and numbers is recognized using Left-Right
Banded model in conjunction with Viterbi algorithm. Experimental
results demonstrate that, our system can successfully recognize hand
gestures with 98.33% recognition rate.