International Research Journal of Engineering and Technology (IRJET)
e-ISSN: 2395-0056
Volume: 10 Issue: 08 | Aug 2023
p-ISSN: 2395-0072
www.irjet.net
HAND GESTURE BASED SPEAKING SYSTEM FOR THE MUTE PEOPLE Gaurav Dharankar1, Devavrat Yende2, Prachi Ghadge3, Snehal Gawhale4 1Gaurav Sunil Dharankar, Student at PES Modern COE in Department of E&TC Engineering, Pune, Maharashtra,
India
2Devavrat Prashant Yende, Student at PES Modern COE in Department of E&TC Engineering, Pune, Maharashtra,
India 3Prachi Hanumant Ghadge, Student at PES Modern COE in Department of E&TC Engineering, Pune, Maharashtra,
India
4Snehal Shrikrushna Gawhale, Student at PES Modern COE in Department of E&TC Engineering, Pune,
Maharashtra, India
5Anuradha Kasangottuwar, Assistant Professor at PES Modern COE in department of E&TC Engineering, Pune,
Maharashtra, India ---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - - Communication between Mute community has
washroom” and a few more messages that help mute in imparting basic messages through finger actions.
become more unfavourable in day-to-day life. Approximately 432 million people across globe are deaf and mute, and around 34 million out of these are children. Mute groups in the world mosty use gestural type of communication called Sign language. We ideated a verbal exchange device for the DeafMute which translates hand gestures into audio message as an intermediatory. The aim behind developing this plan, is to assist the humans using a deaf-mute communication intermediatory device. In the Prototype, we utilized Flex sensor module to understand hand motions. The motions of the fingers of mute people is captured by flex sensor, raspberry pi 3B+ identifies these gestures. Now using text to speech conversion these gestures are then converted into adequate and predefined audio messages and audio output is given through speaker module. Thus more effective communication is enabled. The developed system it is easy to operate and capable to building efficient and effective interaction between human and computer and also user friendly.
1.1 Objective Focused on developing a device for Mute community that is independent of hardware and feasible to use.
In several fields Hand gestures are used as a form of non-verbal communication.
The device consists of a Flex Sensor, to capture the finger gesture performed by the user, connected with raspberry pi and captures the signal as the input to the proposed algorithm and produce voice messages as output through the speaker module.
The sample algorithm divided into four main steps, which includes capturing, analog signal conversion to digital, pattern matching and classification.
The final output is given through speaker module.
Key Words: Text to speech conversion, Raspberry pi 3B+, Flex Sensors, ADC ADS1115.
1. INTRODUCTION It becomes difficult for mute people for conveying their message to regular people. As, regular people are not trained on hand sign language, Hence the communication becomes very difficult. In emergency situations or other times communicating to nearby people or effectively explaining their thoughts becomes a major task. So to solve the we propose a smart speaking system which makes use of hand motions and gestures and hence assists mute community in imparting their message to normal population. The device hardware includes a system of hand motion reading incorporated with Flex sensor and microcontroller. For processing the received input and operating the system a Raspberry pi processor is used. The devices includes some inbuilt messages like “I need water”, “I want to use the
© 2023, IRJET
|
Impact Factor value: 8.226
1.2 Applications
|
Gesture recognition and conversion.
As a translating device for Mute people.
Education and Learning: It can aid in classroom participation, enabling students to interact with teachers and classmates more effectively. Additionally, it facilitates language learning and vocabulary development.
ISO 9001:2008 Certified Journal
|
Page 552