PERFORMANCE OF FACIAL EXPRESSION RECOGNITION USING CNN AND DRLBP
Authors/Creators
- 1. * PG Scholar, Computer Science and Engineering Department, Bhiwani Institute of Technology & Sciences, Bhiwani, Haryana ** Assistant Professor, Computer Science Engineering Department, Bhiwani Institute of Technology & Sciences, Bhiwani, Haryana
Description
Facial expression recognition is a crucial task in computer vision with applications in fields such as emotion detection, human-computer interaction, and affective computing. This research presents a novel approach that combines a convolutional neural network (CNN) classifier with the Dynamic Regional Local Binary Patterns (DRLBP) proposed method for accurate and efficient facial expression recognition. The proposed method follows a systematic process that begins with the collection of a diverse dataset of facial images displaying different expressions, along with their corresponding labels. The DRLBP algorithm is then utilized to extract discriminative features from the facial images. Unlike traditional Local Binary Patterns (LBPs), the DRLBP algorithm dynamically selects regions of interest based on facial landmarks or key points, allowing for effective capturing of expressive facial regions.The performance of the proposed method can be evaluated using various metrics such as accuracy, precision, recall, or F1 score, by leveraging the strengths of both CNNs and the DRLBP algorithm, the combined approach achieves accurate and robust facial expression recognition. CNNs excel in learning complex hierarchical representations, while DRLBP effectively captures expressive facial regions. The integration of these two methods presents promising prospects for the development of advanced facial expression recognition systems with numerous practical applications.
Files
195.pdf
Additional details
References
- 1. Majumder, L. Behera, and V. K. Subramanian, "Emotion recognition from geometric facial features using self-organizing map," Pattern Recognition, vol. 47, no. 3, pp. 1282-1293, 2014 2. Y. Tong, R. Chen, J. Yang, and M. Wu, "Robust facial expression recognition based on local tri-directional coding pattern," in Complex, Intelligent, and Software Intensive Systems - Proceedings of the 12th International Conference on Complex, Intelligent, and Software Intensive Systems, CISIS-2018, 2018, pp. 606-614. 3. H. Jung, S. Lee, J. Yim, S. Park, and J. Kim, "Joint fine-tuning in deep neural networks for facial expression recognition," in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 2983-2991 4. H. Yang, U. A. Ciftci, and L. Yin, "Facial expression recognition by de-expression residue learning," in Conference on Computer Vision and Pattern Recognition, CVPR, 2018, pp. 2168-2177. 5. S. Xie, H. Hu, and Y. Wu, "Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition," Pattern Recognition, vol. 92, pp. 177-191, 2019 6. A. Majumder, L. Behera, and V. K. Subramanian, "Automatic facial expression recognition system using deep network-based data fusion," IEEE transactions on cybernetics, vol. 48, no. 1, pp. 103-114, 2018. 7. S. Xie and H. Hu, "Facial expression recognition using hierarchical features with deep comprehensive multipatches aggregation convolutional neural networks," IEEE Transactions on Multimedia, vol. 21, no. 1, pp. 211-220, 2018. 8. Z.-H. Jiang, Q. Wu, K. Chen, and J. Zhang, "Disentangled representation learning for 3d face shape," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 11 957-11 966. 9. T. Zhang, H. Wang, and Q. Dong, "Deep disentangling siamese network for frontal face synthesis under neutral illumination," IEEE Signal Processing Letters, vol. 25, no. 9, pp. 1344-1348, 2018. 10. T. Hinz and S. Wermter, "Image generation and translation with disentangled representations," in 2018 International Joint Conference on Neural Networks (IJCNN). IEEE, 2018, pp. 1-8. 11. I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde Farley, S. Ozair, A. C. Courville, and Y. Bengio, "Generative adversarial nets," in Conference on Neural Information Processing Systems, 2014, pp. 2672-2680. 12. A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks," arXiv preprint, vol. arXiv: 1511.06434, 2015. 13. Syeda Amna Rizwan, "An Accurate Facial Expression Detector using Multi -Landmarks Selection and Local Transform 978-1-7281-4235-7/20/$31.00 ©2020 IEEE 14. Shintaro Kondo; Seiichi Harata; Takuto Sakuma; Shohei Kato acial Expressions Generating Model Reflecting Agent's Emotion Response Using Facial Landmark Residual Networks2022 IEEE 11th Global Conference on Consumer Electronics (GCCE) Year: 2022