Sign Language Interpreter(SignaVision)
Authors/Creators
Description
This report presents the design and implementation of a real-time American Sign Language (ASL) recognition system using computer vision and deep learning techniques. We use MediaPipe for hand landmark detection, OpenCV for image pre-processing and a Convolution Neural Network (CNN) for gesture classification. The system provides a solution to bridge the communication gap between sign language users and non-signers by converting hand gestures into text and speech output in an accessible and affordable way.
The project presents a lightweight webcam-based solution that does not require any specialized hardware like sensor gloves or depth cameras. The system uses skeletal hand landmark rendering to improve robustness and accuracy, reducing the effect of background noise and lighting changes. Experiments show that the method has high recognition accuracy and efficient real-time performance, which makes it applicable to practical applications such as educational support, assistive communication, and public service interaction.
This work showcases the promise of the integration of artificial intelligence, computer vision and human-computer interaction technologies for the development of scalable and inclusive communication systems. The report also discusses system limitations and future enhancements, including dynamic gesture recognition, sentence-level translation, and deployment on mobile and embedded platforms.
Files
SignaVIsion Research Journal.pdf
Files
(287.2 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:2380d62c269eab291a02d8e925cf5e90
|
287.2 kB | Preview Download |
Additional details
Additional titles
- Alternative title (English)
- SignaVision
Dates
- Created
-
2026-05-07
Software
- Repository URL
- https://github.com/AashrayaMan/Sign-Language-Interpreter
- Programming language
- Python
- Development Status
- Active
References
- 1. R. Kumar, A. Bajpai, and A. Sinha, "Real-Time American Sign Language Recognition Using MediaPipe and CNN," arXiv preprint arXiv:2305.05296, 2023. [Online]. Available: https://arxiv.org/abs/2305.05296
- 2. H. Limaye, S. Kumar, S. Yadav, and S. Choudhary, "American Sign Language Recognition using CNN," SSRN Electronic Journal, 2022. [Online]. Available: https://papers.ssrn.com/sol3/Delivery.cfm/SSRN_ID4169172_code5298930.pdf
- 3. Florida Atlantic University, "AI Model Highly Accurate in Recognizing Sign Language Gestures," The Hearing Review, 2024. [Online]. Available: https://hearingreview.com/inside-hearing/research/ai-model-highly-accurate-in-recognizing-sign-language-gestures
- 4. A. Chauhan, B. Bhushan, and S. Pundir, "American Sign Language Recognition Using Deep Convolutional Neural Networks," Materials Today: Proceedings, vol. 46, pp. 6831–6835, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2666990021000471
- 5. M. Bali, "Sign Language Detection for Deaf Using Deep Learning, MediaPipe & OpenCV," Medium, 2023. [Online]. Available: https://medium.com/@mayank.bali/sign-language-detection-for-deaf-using-deep-learning-mediapipe-u-opencv-4c5151e2374c
- 6. M. Madhiarasan and P. P. Roy, "A Comprehensive Review on Sign Language Recognition Systems," arXiv preprint arXiv:2204.03328, 2022. [Online]. Available: https://arxiv.org/abs/2204.03328
- 7. K. L. Cheng, Y. Wang, and T. Wu, "Fully Convolutional Networks for Continuous Sign Language Recognition," arXiv preprint arXiv:2007.12402, 2020. [Online]. Available: https://arxiv.org/abs/2007.12402
- 8. A. Qayyum, M. A. Jamil, and H. Sherazi, "Scale-Invariant Feature Based Deep CNN for Pakistani Sign Language Recognition," Journal of King Saud University - Computer and Information Sciences, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1319157824000235
- 9. M. M. Islam, M. R. Hasan, and M. K. Hasan, "A Review on Vision-Based American Sign Language Recognition: Its Techniques and Outcomes," International Journal of Engineering & Technology, vol. 7, no. 4.34, pp. 237–242, 2018. [Online]. Available: https://www.researchgate.net/publication/326643498
- 10. Laplaces42, "Real-Time Sign Language Interpreter Using MediaPipe," GitHub, 2023. [Online]. Available: https://github.com/laplaces42/sign-language-interpreter
- 11. Neural Network based Indian Sign Language Recognition using hand crafted features," 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2020, pp. 1–6. Available: https://ieeexplore.ieee.org/document/9225294
- 12. R. H. Chile, R. V. Dharaskar and V. M. Wadhai, "Signet: A Deep Learning based Indian Sign Language Recognition System," 2019 IEEE International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 2019, pp. 0669–0673. Available: https://ieeexplore.ieee.org/document/8698006
- 13. A. Raut and P. N. Raut, "Real time Indian Sign Language Recognition System to aid deaf-dumb people," 2011 IEEE 13th International Conference on Communication Technology, Jinan, China, 2011, pp. 699–702. Available: https://ieeexplore.ieee.org/document/6157974
- 14. N. S. Ameen and M. A. Khan, "ML Based Sign Language Recognition System," 2021 International Conference on Innovative Trends in Information Technology (ICITIIT), Kottayam, India, 2021, pp. 1–6. Available: https://ieeexplore.ieee.org/document/9399594
- 15. V. Srivastava and A. Sharma, "Machine learning techniques for Indian sign language recognition," 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), Mysore, India, 2017, pp. 112–117. Available: https://ieeexplore.ieee.org/document/8454988
- 16. R. Kaur and V. Kaur, "Transfer Learning with L2 Norm Regularization for classifying static Two Hand Hindi Sign Language Gestures," 2020 IEEE 9th International Conference on Communication Systems and Network Technologies (CSNT), Gwalior, India, 2020, pp. 239–243. Available: https://ieeexplore.ieee.org/document/9113661
- 17. D. Patel and D. Thakor, "Sign Language Recognition Based on Computer Vision," 2021 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China, 2021, pp. 322–326. Available: https://ieeexplore.ieee.org/document/9498024
- 18. D. B. Patel and K. Bhatt, "A Vision-based System for Recognition of Words used in Indian Sign Language Using MediaPipe," 2021 Sixth International Conference on Image Processing, Applications and Systems (IPAS), Genova, Italy, 2021, pp. 1–6. Available: https://ieeexplore.ieee.org/document/9742141
- 19. A. Mahanta, A. Singh and S. Ghosh, "Real-Time Indian Sign Language Recognition System using YOLOv3 Model," 2021 Sixth International Conference on Image Processing, Applications and Systems (IPAS), Genova, Italy, 2021, pp. 1–6. Available: https://ieeexplore.ieee.org/document/9742198
- 20. A. Wadhwani and D. Patel, "Character and Word Level Gesture Recognition of Indian Sign Language," 2023 IEEE 8th International Conference for Convergence in Technology (I2CT), Pune, India, 2023, pp. 1–6. Available: https://ieeexplore.ieee.org/document/10418341