Two Way Communication System with Binary Code Medium for People with Multiple Disabilities
5
Abstract - Communication is the driving force of mankind. In this modern era, Science and technology have made the human world so easy but still some physically and visually challenged people suffer from communication with others. It may be by birth or caused by any kind of accident. After losing communication, these people cannot do the normal functions or normal life. Majorly they cannot communicate with others. Various languages specifying sign language, Braille scripts, Morse codes were proposed by researchers to provide a specific communication medium. Even after such inventions, there is a clear visible gap between the communication of the normal person and a specially challenged person and communication between two specifically challenged people.
Key Words: blind,deaf,dumb,communication,issues,text, speech,vibrator,sensor
1.INTRODUCTION
According to ministry of statistics and program implementation2.68croreofthecurrentIndianpopulation isspeciallychallenged,ofwhich44%consistofpeoplewho suffer from neither hearing speech or visual impairment. We're going to propose a new system prototype in this projectcalledcommunicationamongblind,deaf,anddumb persons.Thiswillaidthosewithdisabilitiesinovercoming their communication barriers with both those without disabilitiesandthosewhohavedisabilities.
Blind individuals will use the speakers to communicate, whilethedeafanddumbwillbeabletoseethroughitand respond by tapping the sensor. All of these have been developedasapplicationssothatpeoplewithimpairments can use them with comfort. A model has been developed which is focused on multi model approach can be able to convert speech to visual contexts and vibrations and similarly the contexts and vibrations can be converted to speech.
1.1 Binary Code
I. Binary code represents text, computer processor instructionsoranyotherdatausingatwo-symbol system. The two-symbol system used is often "0" and"1"representing"off"or"on"respectivelyfrom binarynumbersystem.
II. In today's digital world, binary code is one of the mostimportantnumbersystems.
III. Ourgoalforthisprojectistoteachdisabledpeople aboutbinarynumbersystemandhowitappliesto the technologies. In this we convert 26 letters of Englishalphabetto5-bitbinarycode
1.2 ESP8266 WIFI Module
The ESP8266 is a low-cost, Wi-Fi enabled microcontroller. It has a powerful 32-bit microcontroller and an integrated Wi-Fi transceiver.
Itcancommunicate wirelesslywithotherdevices andithasawiderangeofinputandoutputpinsfor connecting sensors, actuators, and other components.
It can be programmed using the Arduino IDE, MicroPython, Lua, and other languages and developmentenvironments.
2. LITERATURE REVIEW
[1] A two-way communication system with Morse code medium for people with multiple disabilities:
Thispaperwaspublishedintheyear2020.Inthisresearch, a wearable system with a wide network of Morse code recognitionandtransmissionisproposed.Itcanbeusedto establishshort-andlong-distancecommunicationbetweena person with a disability and a healthy person, as well as communication within themselves. Four user-selectable operating modes, 1. Morse to Speech (MTS), 2. Speech to Morse(STM),3.DistanceMorsetoText(DMTT)4.Distance TexttoMorseareusedbythesystem(DTTM).Dependingon the application, the user can access each mode by making particulargestures.Basedonthemachinelearningmodel, the gesture is identified. The project employs the SVM algorithm, but it is not effective for large data sets and struggleswithnoisydata.
[2] A Chat Application for Communicating with Hearing Impaired Persons:
This paper is published in 2019 it proposes an assistive technology framework is presented that offers a chat application as a communication interface for hearing impairedandnon-hearing-impairedpeopleutilizingmobile phones. It converts regular people's voicemails into text messages.Theframeworkcombinesavarietyofspecifically createdchatacronymsoutofthetexts.Lastbutnotleast,it connectsthecombinationtoaseriesoftactilefeedbackfor the deaf person. The feedback is sent using Morse code. Currently,theframeworkonlysupportsEnglishandsimple text messages, but future work aims to incorporate more complexcontent,suchashyperlinks,emojis,andshapes,via MCShorthandvibrations.
[3] Finger Braille: Tactile Communication for Differently Abled
Mobile devices are crucial for modern life, but visually challengedindividualsfacechallengesinusingthem.Braille wascreatedin1824fortheblind.Braillehassixraiseddots andisatactilesystem.Thisstudydemonstratesawearable device withforce-sensitive sensors simulating a six-finger virtual keyboard. Android devices receive input through Braille, making typing easy for the blind. Bluetooth sends input to the device, and the message is read aloud and displayed on the screen. Users can edit their messages Futureworkmayincludecontrollingemail,contacts,calls, and internet browsing via Braille input. Additionally, the hardwarecouldbemadesmallerandportable.
3. PROPOSED WORK
In this project we proposed a system for multi disability peoplelikeblinddeafanddumbpeople.
Blind module:Asareplacementforthebraillesystemthat was once used to communicate with the blind, we now employtheVoiceControllerSystem.Inthis,blindpersons cancommunicatewithothersbyspeakingthroughthevoice controller.
Deaf module: Using a vibrator to receive messages and a keyboardtotypemessagestoothers,wecanconnectwith deafpersonsusingthismodule.Itisshownonthesystemsof otherpeople.
Dumb module: Withthehelpofthisdumbmodule,users cansendthemessagesbytextandcanreceivethemessages throughvoiceandintextualform.
The model is designed to assist people with multiple disabilities to communicate effectively. It consists of four maincomponents:thetapsensor,vibrationcoin,ESP8266, andlithium-ionbattery.
1. Thetapsensorisasmalldevicethatcanbewornon theuser'sfinger.Itdetectsfingertapsandsendsthe signaltotheESP8266forprocessing.
2. The vibration coin is a small vibrating motor that producesvibrationpatternstoconveymessagesto theuser.
3. The ESP8266 is a microcontroller that receives input from the tap sensor and translates it into messages.Itisconnectedtothevibrationcoinand controls its vibrations to create patterns that representtheinput.TheESP8266isalsoequipped withWi-Ficapabilities,allowingittoconnecttothe internetandcommunicatewithotherdevices.
4. The lithium-ion battery provides power to the entiresystem,allowingittobeportableandused on-the-go. It is rechargeable and can be easily replacedwhenneeded.
Whentheusertapsthesensor,theESP8266processesthe input and generates a corresponding vibration pattern on the vibration coin. The user can feel the vibration and interpretitasamessage.Additionally,theESP8266canbe programmedtocommunicatewithotherdevices,allowing theusertosendandreceivemessageswirelessly
4. IMPLEMENTATION
TherearetwoESP8266,bothareconnectedwiththesame network.TouchsensorTTP223areconnectedtoESP8266's digital pin D2 AND D3. Vibration motor connected to D12 andD13.ESP8266Wi-FimoduleisconnectedtoD9andD10 ofArduino.SpeakerisconnectedtoD10.SPA,SCLofDisplay connectedtoA4andA5.A1RXandTXareconnectedTXand RXofA2.AlltheVCCareconnectedto5V.
Thesystemalsoincludesafeaturewheretheblindperson cansendvoicemessagestothedeafperson,whichwillbe transcribed into text and displayed for the deaf person to read. The deaf person can then reply by sending an audio message, which will be converted into text for the blind persontoread.
Thefigurerepresentsacommunicationsystemthataimsto facilitatecommunicationbetweendeafandblindindividuals. Thesysteminvolvestwomodesofcommunication:text-tospeechandspeech-to-text.
Inthetext-to-speechmode,thetextmessagesenteredbythe deaf person are converted into audio output that can be heardbytheblindperson.Thisisaccomplishedthroughthe useofatext-to-speechsoftwareorapplication.
Inthespeech-to-textmode,theaudiomessagesspokenby theblindpersonareconvertedintotextoutputthatcanbe read by the deaf person. This is done using a speech recognitionsoftwareorapplication.
The figure depicts a communication system for multiple disabledpersons.Thesenderusesbinarycodeinputinan ESP8266moduletosendmessages.TheESP8266modules transmitwirelesslytoeachother.
The receiver's ESP8266 module converts the binary code into a vibration pattern sent to a vibration motor. The receiver interprets the vibration pattern to determine the message.
This technology is a creative solution that enables communicationforindividualswithmultipledisabilities.
The system is low-cost and wireless. It provides an innovativewaytoovercomecommunicationbarriers.
This system demonstrates how technology can benefit peoplewithdisabilities.Itshowcasesthepotentialofbinary code,wirelesscommunication,andvibrationmotors.
4.1 Binary Code 5 Bit Reference
A5-bitbinarycodeisasequenceof5digits(0or1)usedto representacharacter.With5bits,wecanrepresent upto 2^5 = 32 different characters, including letters, numbers, andsymbols.
Torepresentalphabeticalcharactersusing5-bitbinarycode, wecanassignauniquecodetoeachletter.
Torepresenttheletter"A"in5-bitbinarycode,weusethe codeassignedtoit,whichis00001.Therefore,wecanwrite
"A-00001" to indicate that "A" is represented by the 5-bit binarycode00001.
Similarly, we can represent other letters using their corresponding codes. For example, we can represent the letter"B"as"B-00010",theletter"C"as"C-00011",andso on.
A 5-bit binary code can be easier than other encoding schemesinsomesituationsbecauseitrequireslessmemory andissimplertoencodeanddecode.
Compared to the more common 8-bit or 7-bit ASCII code, whichrequires more memorytostore eachcharacterand moreprocessingpowertoencodeanddecode,a5-bitbinary codeissimplerandmoreefficientway.
5. WORKING
The system is particularly useful for people with limited mobility, vision, or hearing impairments. It enables communication in situations where verbal or written communication may not be possible or practical. The proposedcommunicationmodeloffersauser-friendlyand accessiblewayforindividualswithdisabilitiestoeffectively communicatewithothers.
Figure 5 shows the working model, Individuals with disabilitiessuchasdeafness,muteness,andblindnesshave accesstoacommunicationsystemthatinvolvesavibration coinformessagereception,atapsensorformessagesending via physical tapping, and an OLED display for message viewing.Furthermore,avoicecontrollerisincludedforblind individuals to send messages via voice input, while deaf individualscanutilizetext,tap,orvoicetosendmessages, and mute individuals can send messages via text or tap. Normal person can send the message through the app created;thedisabledpersoncanseethemessageviadisplay. To facilitate communication between multiple individuals withdifferentdisabilities,binarycodeisutilizedtotransmit messages, which can be received by the receiver through vibration. This system is designed to enable effective communicationamongindividualswithvariousdisabilities by providing a comprehensive range of input and output optionsthatcatertotheirspecificneeds.
6. CONCLUSIONS
The paper highlights the challenges faced by people with disabilities like blindness, deafness, and dumbness, which often lead to difficulties in communication and limit their ability to navigate their surroundings and connect with
otherssocially.Thelackofcommunicationcanresultinpoor healthoutcomes,makingitcrucialtofindeffectivesolutions toovercomethesebarriers.
The proposed solution is a compact device that aims to minimize the communication gap between people with disabilitiesandthenormalworld.Thedeviceconvertstext to voice for the blind, allowing them to send messages throughvoiceortap.Forthedeaf,thedeviceconvertstapto text,enablingthemtocommunicateviatext.Forthedumb, the device converts tap to text, allowing them to send messagesthrougheithertextortap.
Thedevice'soperationinvolvesconvertingmessagesfrom tap to text and text to vibration for people with multiple disabilities,creatingasimplemodelfortheblind,deaf,and dumbpeopleinasingledevice.Thelanguage-independent featureofthedevicemakesitasmartassistantforspeciallyabled individuals to communicate with others effectively. The lightweight and compact design of the device make it easytocarry,enhancingitsconvenienceandportability.
The proposed solution is a significant step towards minimizing the communication gap between people with disabilitiesandtherestoftheworld,promotinginclusivity andaccessibility.
REFERENCES
[1] "A two-way communication system with Morse code medium for people with multiple disabilities," 2020 IEEE7thUttarPradeshSectionInternationalConference on Electrical, Electronics and Computer Engineering, byBopanna Jaswant Kranti, Kantheti Bharath Varma, Gangireddy Suhas, and G. Pradeep Reddy. DOI: 10.1109/UPCON50219.2020.9376479M. Young, The TechnicalWriter’sHandbook.MillValley,CA:University Science,1989.
[2] A. Amarasinghe and V.B.Wijesuriya, “Stimme: A Chat ApplicationforCommunicatingwithHearingImpaired Persons” 2019 IEEE 14th Int. Conf. Ind. Inf. Syst. Eng. Innov. Ind. 4.0, ICIIS 2019 - Proc., pp. 458–463, 2019, doi:10.1109/ICIIS47346.2019.9063252.
[3] A. K. Tripathy, M. D'sa, R. Alva, J. Fernandes, and A. L. Joseph, “Finger Braille: Tactile communication for differentlyabled”Proc.-Int.Conf.Technol.Sustain.Dev. ICTSD 2015, pp. 5–9, 2015, doi: 10.1109/ICTSD.2015.7095893.