A MOBILE-BASED AMERICAN SIGN LANGUAGE LEARNING APPLICATION WITH INTERACTIVE FEATURES FOR THE HEARING AND SPEECH IMPAIRED

Despite the fact that communication is a basic human right, millions of people throughout the world struggle
because of speech and hearing problems. The World Health Organization estimates that 700 million individuals
will have substantial hearing loss by 2050, up from the present level of about 430 million. In order to reduce
communication barriers between the hearing and the Deaf communities, American Sign Language (ASL) is
essential. However, the absence of qualified teachers and standardized resources makes traditional American Sign
Language (ASL) learning approaches costly, inaccessible, and constrained. While some answers are offered by
current mobile applications, they sometimes lack interactive elements, customization options, and real-time
feedback—all of which are critical for successful and interesting language learning.
This aimed to design and developed a mobile-based American Sign Language Learning Application integrated
with Artificial Intelligence (AI) and interactive features to provide a flexible, self-paced, and engaging learning
experience. The Application incorporates video tutorials, gamification elements such as quizzes and progress
tracker, and a real-time hand gesture recognition system for finger spelling practice.
Evaluation results demonstrated that the application significantly improved user engagement, accessibility, and
motivation among the target community. Both hearing-impaired, speech-impaired and hearing community users
reported high satisfaction with its user-friendly interface, interactive features, and comprehensive lessons. This
research highlights the potential of AI-driven mobile technology to bridge communication gaps, promote
inclusivity, and support equal opportunities for education and social participation. Future work includes expanding
the app to support other sign languages, incorporating offline features for low-connectivity areas, and exploring
augmented reality (AR) for immersive learning experiences.