International Research Journal of Engineering and Technology (IRJET)
e-ISSN: 2395-0056
Volume: 11 Issue: 03 | Mar 2024
p-ISSN: 2395-0072
www.irjet.net
Effective Communication Between Blind, Mute And Deaf People Using A Multi-Model Approach Prof. Sonali Karthik1, Shraddha Deshmukh2, Archis Save3, Rani Shah4 1 Professor, Dept. of IT Engineering, Theem College of Engineering, Maharashtra, India 2 U.G. Student, Dept. of IT Engineering, Theem College of Engineering, Maharashtra, India 3 U.G. Student, Dept. of IT Engineering, Theem College of Engineering, Maharashtra, India
3 U.G. Student, Dept. of IT Engineering, Theem College of Engineering, Maharashtra, India
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - Communication is essential for individuals with
effectively. American Sign Language (ASL) and Other Sign Languages: Learn basic sign language or use an interpreter if available. ASL is a widely used sign language in the United States. Written Communication: Use written notes, text messages, or communication apps to convey information. Visual Cues: Use facial expressions, gestures, and body language to enhance communication. Maintain eye contact to show engagement. Assistive Technologies: Consider using video relay services (VRS) or text-based relay services to facilitate communication. Mute people may not be able to speak, but they can still communicate through various methods. Written Communication: To facilitate written communication, individuals can utilize tools such as pen and paper, electronic devices such as computers, tablets, or smartphones, and communication software like email, messaging apps, or word processing programs. These tools enable the exchange of ideas, information, and emotions through written text, allowing for clarity and precision in expression. Written Communication: Provide a means for written communication, such as pen and paper or electronic devices. Gestures and Body Language: Encourage the use of gestures, facial expressions, and body language to convey emotions and thoughts.
disabilities to fully participate in society. However, those who are blind, deaf, and mute face significant challenges in traditional communication methods. The paper proposes a multimodal approach to facilitate communication for individuals with these multiple disabilities. The approach combines sign language, translator, and assistive technologies to create a comprehensive communication system. Through voice assistant, individuals who are blind can receive information through voice or touch, while translator devices provide real-time feedback. For sign language gestures. Additionally, assistive technologies such as text-to-speech and speech-to-text software enable individuals who are mute to communicate verbally, which can be translated into tactile or visual formats for those who are blind or deaf. By integrating these modalities, individuals with multiple disabilities can overcome communication barriers and engage more effectively with their environment and peers. This multimodal approach offers a promising avenue for enhancing communication. In today’s advance world of science and technology, communication field has developed at such extent where we can connect to any part of the world within fraction of minutes and hour. We can send messages, make call or send documents, files to anyone, according to need. Communication has been important to express our thoughts, idea etc. but when it’s come about blind, deaf and mute people’s it become difficult for them and us to communicate with each other. So, here we have made such a software which shall help them to communicate with each other without depending upon any middle man. With the help of this we would be able to help mute, blind and deaf people to communicate with each other without depending upon each other.
2. LITERATURE SURVEY Systematic literature reviews involve evaluating and interpreting all available research pertinent to a specific research question or topic. Researchers use scientific databases with full-text papers and other relevant scholarly articles in the social sciences. These reviews help synthesize existing knowledge, pinpoint research gaps, inform theoretical frameworks, and shape future research directions in the social sciences and beyond.
Key Words: Multi-Model Communication system, Sign Language, Gestured Based, ASR, CNN.
2.1. Existing Papers
1.INTRODUCTION
It has focused on the problems of Visually (Who Can't see), Audibly (who can't hear), Vocally (who can't talk), through a single device is a tough task. After researching on this a convenient assistive device can be made for them using latest devices like Raspberry, Windows, MAC etc. They have used monitor instead of LCD screen. The model has 2 options to select the required conversion technique. Image to Gesture (ITT)•Gesture to Text (GTT)
For communication and understanding of their surroundings, blind people rely on their other senses and assistive technologies. Audio Descriptions: When describing visual content, provide detailed audio descriptions of images, videos, or surroundings. Deaf people use sign language, written communication, and visual cues to communicate
© 2024, IRJET
|
Impact Factor value: 8.226
|
ISO 9001:2008 Certified Journal
|
Page 1518