Paper Key : IRJ************411
Author: Madhav Priyan S,Keerthana D,Nanthene R E,Rajalingam P,Ramya D
Date Published: 12 Apr 2025
Abstract
Artificial intelligence (AI) has significantly advanced assistive technologies, particularly by enhancing communication solutions for individuals with hearing impairments. This work introduces a novel AI-powered web application designed to convert spoken language into sign language in real time, thereby improving accessibility for the Deaf and hard-of-hearing community. Leveraging cutting-edge speech recognition and natural language processing (NLP) techniques, the system accurately transcribes spoken input into text and maps it to corresponding sign language gestures. These gestures are then displayed as fluid animations or avatar-based representations, enabling seamless interactions between hearing and non-hearing individuals. The application utilizes deep learning methods to enhance the accuracy of speech-to-text conversion and relies on a comprehensive database of sign language movements to ensure precise translations. A key feature of this tool is its adaptability to various sign languages, such as American Sign Language (ASL) and British Sign Language (BSL), making it a versatile solution for global adoption. The platform is designed with a user-friendly interface, ensuring accessibility across multiple devices, including smartphones and desktop computers. Through the integration of machine learning, the system continuously improves its translation capabilities by learning from user interactions, resulting in increased efficiency and accuracy over time. This AI-driven solution aims to bridge the communication gap between hearing and non-hearing individuals by providing a simple yet effective method for converting speech into sign language. Its web-based architecture ensures wide availability without the need for specialized hardware. Representing a significant step toward inclusivity, this technology has the potential to transform educational, professional, and social opportunities for the Deaf community. Looking ahead, future enhancements could involve support for regional linguistic variations, improved gesture visualization, and the incorporation of augmented reality (AR) to create a more immersive user experience.
DOI Requested