ELECTRONICS & ELECTRICAL DOMAIN
Published July 18, 2025 | Version v1
Journal article Open

Real-Time AI-Powered Sign Language Translation System for Inclusive Communication

Description

In order to address communication barriers between hearing and deaf people, this paper describes the creation of an AI- based application that enables real-time translation of sign language into speech and text. Convolutional Neural Networks (CNNs), Media Pipe for real-time gesture recognition, an easy-to-use user interface, and a feedback loop for ongoing enhancement are all features of the system. The suggested system improves accessibility and inclusivity in fields like public services, healthcare, and education. Future developments will include support for more sign languages and integration with wearable technology.

Files

Real-Time AI-Powered Sign Language Translation System -Formatted Paper.pdf

Files (291.9 kB)

Additional details

References

  • 1. "Sign Language Recognition: A Re- view," Proc. IEEE ICIP, 2016, by O. Koller and H. Ney.
  • 2. "Sign Language Recognition using Transformers," arXiv preprint arXiv:2010.13067, 2018; N. C. Camgoz et al.
  • 3. Y. Hu and Y. Wang, "Deep Learning for Sign Language Recognition," IEEE Trans. Human-Machine Systems, 2019.
  • 4. RWTH-PHOENIX-Weather 2014T Dataset.
  • 5. A. Ng, "Specialization in Deep Learning," Coursera.
  • 6. Batte, B. (2025). AI-powered sign language translation system: A deep learning approach to enhancing inclusive communication and accessibility in low-resource contexts. Available at SSRN.
  • 7. Bahtiyarova, M., Esenov, L., Hojabalkanova, S., & Myradov, R. (2024). ENHANCING ACCESSIBILITY: THE ROLE OF AI-POWERED VOICE ASSISTANTS IN SIGN LANGUAGE COMMUNICATION. Наука и мировоззрение, 1(37), 344-348.
  • 8. Lawana, S. P. (2024). Development of a Mobile Application for Interactive Sign Language Learning Using AI-Powered Gesture Recognition and Gamification. Idea: Future Research, 2(2), 72-80.
  • 9. Poornachandar, T., Sathieskumar, T., Thangadurai, K., Kumar, M. D., Anuradha, V., & Jayasri, T. (2025, April). Real–Time Communication System for Specially Abled Powered by AI. In 2025 International Conference on Computing and Communication Technologies (ICCCT) (pp. 1-6). IEEE.
  • 10. Muhammed Farsin, K., Mohammed Ashfaque, P. K., Mohamed Abdul Shahid, P. G., Mohammad Mirdas, C. K., Anish Kumar, B., & Jemsheer Ahmed, P. (2024, May). Sign Language Transformation: AI-Enabled Communication for the Deaf. In International Conference on Intelligent Communication, Control and Devices (pp. 787-802). Singapore: Springer Nature Singapore.