International Research Journal of Engineering and Technology (IRJET) e ISSN:2395 0056
Volume: 09 Issue: 05 | May 2022 www.irjet.net p ISSN:2395 0072
AIR WRITING USING PYTHON (2021-2022)
Engineering
Abstract-Writing in air has been one of the most entrancing and challenging research regions in field of image processing and pattern recognition in the recent years . It contributes enormously to the progression of an automation process and can get to the next level the connection point among man and machine in various applications.
Object following is considered as a significant task within the field of Computer Vision. The development of quicker PCs, accessibilityofcheap andgreat qualitycamcorders and requests of computerized video investigation has given prevalence to object tracking strategies. Generally , video investigation system has three significant stages: first and foremost, identifying of the Object, furthermore following its movement from frame to frame and lastly analyzing the behaviour of that object. For object tracking , four unique issues are considered; determination of suitable article representation , feature selection for tracking, object recognitionandobjecttracking
Key Words :AugmentedReality(AR),VirtualReality(VR), HumanComputerInteraction(HCI),ComputerVision(CV)
1.INTRODUCTION
AllwewantinthisundertakingisaPCwithawebcamera introduced in it. We will prepare our PC or our screen to peruseanythingthattheclientwillcomposeInfrontofthe screen.WehaveinvolvedOpenCVforobjectidentification that is with which the client will be writing on air and we haveusedPythonlanguage forcoding.Firstandforemost, aftercodeisexecuted,wegetawhitescreenshowninthe screen and anything we write on air Infront of camera it tracksthearticlewhosepropertieswehaveproclaimedin the code. After that tracked points are connected and projectedonthescreen.
Intheperiodof digital world,traditional art ofcomposing is being supplanted by advanced digital art . Digital art referstoformsofexpressionofartformwithdigitalform Depending on present day science and innovation is the distinctive characteristics of the digital manifestation DigitalArtincorporatesnumerousmethodsof writinglike by utilizing Keyboard, touch screen surface, Digital pen, pointer,utilizingelectronichandglovesandsoforth.
Traditional Art refers to the fine art which is made before the digital Art. The Traditional way incorporates pen and paper,chalkalso,boardforwriting
Digital Art and Traditional art are interrelated and interdependent .Social improvement is certainly not a people'swill,yetatthesametheAtanyrate,requirements ofhumanexistencearethevitallymainimpetus.Thesame circumstance occurs in Art. In the current conditions, digital Art and traditional art are comprehensive of the advantageous state, so we really want to efficiently comprehend the essential knowledge on the structure between digital art and traditional art .The fundamental point of advancedworkmanshipisof building hand signal acknowledgmentframeworktowritedigitally
1.1 OpenCV
OpenCV (Open Source Computer Library) is a programming featured library explicitly focused on at computer vision in real time. This is an open source stage and free for use. Its essential connection point is in C++, it still preservesan olderc interface thatislessdetailed but vast. In the Python interface, all the most recent progressions and algorithms show up. It is significant open sourcecomputervision,machinelearningandimage processing library and now it plays an important part in realtimeactivityintoday’ssystems.Wewillutilizethisto process photos and recordings to perceive individuals, faces or even in handwriting . Python can deal with the OpenCVclusterarrayforreviewasitisjoinedwithvarious libraries like NumPy. We use vector space to perceive the picture design and its unique qualities and perform arithmetic calculations on these attributes. It is available onWindows,Linux,iOSandsoon,withPython,C++,Cand Javaastheinterfaces.
1.2 PYTHON
Python is an high level programming language. It is basically renowned for code reusability and simplicity Despite the fact that it is more slow it has a significant attribute of python that it very well may be handily reached out inside c. Due to this trademark we can write computationally intrinsic codes in C++/C. Python upholds various types of programming patterns , for example,
International Research Journal of Engineering and Technology (IRJET) e ISSN:2395 0056
Volume: 09 Issue: 05 | May 2022 www.irjet.net p ISSN:2395 0072
procedural programming, object oriented programming, functional programming and so forth. It comprises of NumPy library. NumPy is exceptionally strong and upgraded for numerical tasks. To take benefits of multi corefiguring,allthingsarewritteninupgradedCorC++.
2 . Literature Survey
[1]S.V.AshwinKumaretal.
An Implementation of virtual white board using Open CV forvirtualClasses.
The Author Kanakaraja , S.V. Ashwin Kumar and all , "An Implementation of virtual white board using Open CV for virtual Classes," , 10th march 2021 , In this the author expresses that they have involved open CV for Object Detectionthatiswithwhichtheclientwillwriteonairand we have utilized Python language for coding since python isasimplelanguageandeasilyunderstandable Aftercode is executed, we get a white screen shown in the Monitor and anything that we write on air Infront of camera it tracksthearticlewhosepropertieswehavedeclaredinthe code. After the tracked points are associated and anticipatedonthescreen.
[2]PriyanshuMishraetal.
VirtualInkUsingPython.
CreatorsinAkashUniyalandall,‘’VirtualInkUsingPython (No. 5707). Easychair , 2021” , We use python as our essential language and its packages OpenCV and NumPy. Basically, OpenCV is a library of programming functions mainlyaimedatPCvision.InitiallycreatedbyIntel,itwas later upheld by Willow Garage. And NumPy is basically, a library for the Python programming language, adding support for enormous, multi dimensional arrays and lattices, along with an enormous collection of high level numerical capacities to work on these arrays. The Project was fundamentally a PC vision application which utilizes the webcam of your gadget. By opening the webcam of your gadget all you want is to simply hold the pencil or somepeninourgrasp,then,atthatpoint,dragthepenor pencil in air if front of your gadget camera (approx.1530 cm).
[3]AkashKumarChaudharyetal.
AIR CANVAS APPLICATION USING OPENCV AND NUMPY INPYTHON
In Akash Kumar Chaudhary , Bharat Phogat ," Air Canvas Application Using OpenCV and Numpy In Python", International Journal of Research in Engineering and
Innovation. 8. 2395 0056. This Project focuses around changeofMotiontoArt.ThisframeworkutilizesAcamera Devicealso,ComputerVisionSoftwaretofollowthewayof our Finger Tip . A powerful specialized technique decreases mobile and PC usage by taking out the need to write
[4]PranaviSrungavarapuetall.
VIRTUALSKETCHUSINGOPENCV
Srungavarapu, Pranavi and Maganti, Eswar Srilekkha (2021). "Virtual Sketch utilizing Open CV." International Journal of Inventive Technology and Exploring Engineering.10.107108.10.35940/ijitee.H9262.0610821. Inthistaskweareplayingoutthemorphologicaltasksare a bunch of tasks that processes pictures based on shapes. These apply a structuring component to an info picture and produce a output Image. Developing a connection point between human hand and the framework utilizing open cv strategies and python language to pick the colour anddrawutilizinghandonthecreateddrawingregion.
[5]HarneetKauretall.
ACOMPREHENSIVEOVERVIEWOFAR/VRBYWRITINGIN AIR
Sai, Guna and Raj, Akula. (2021) "A Comprehensive overview of AR/VR by Writing in Air" , International Journal of Logical Research in Computer Science, Engineering and Data Technology. 477 482. 10.32628/CSEIT217294.InthistheyexpressedthatEvery stroke is comprised of series of points from which the machine programming chooses the primary focuses that willmirrorthestroke.Theyperformedthreepreliminaries to survey the satisfactory tolerance for slope n in getting the significant points to be viewed as in the study . The slope equation is then applied to the two back to back central points, which are comprised of x and y co ordinates. The worth of progress in x co ordinates and changeiny co ordinatesdecidestheslopeofaLine.
3. Purpose of Study
OurprojectaimistoutilizeacombinationofPCvisionand drawingrecognitiontomakeaframeworkthatgoesabout as a virtual whiteboard. Our model perceives motions written in the air and converts it into text. Clients would havetheoptiontoexpress"airwords" confrontinga web camera either constant or ahead of time and have those signalsconvertedart
Air writing acknowledgment is an interesting point to make an answer, since it tends itself to a wide range of
International Research Journal of Engineering and Technology (IRJET) e ISSN:2395 0056
Volume: 09 Issue: 05 | May 2022 www.irjet.net p ISSN:2395 0072
futurepurposes.Mostnaturally,ittakesintoconsideration clients with explicit requirements an elective type of communication Virtual Reality frameworks like the HTC Vive give a virtual whiteboard experience for an extreme price that requires a extensive tracking system .Our systemrequiresonlyaPCandcamera,andinthismanner givesmoreaffordabilityand accessibility.
4. Problem Definition
The undertaking centers around tackling a few significant culturalissues
1. Individuals hearing impairment: Although we take hearing and listening for granted , they communicates utilizing sign languages. The majority of the world can't grasptheiremotions,theirfeelingswithouta translatorin themiddle.
2.Paperwastageisn'tscareinformation.Wewastealotof paper in scribbling, composing, drawing, and so on. A few essentialrealitiesincorporate 5litersofwateronnormal are expected to make one A4 size paper, 93% of composing is from trees, half of business waste is paper, 25% landfill is paper, and the rundown goes on. Paper wastageishurtingtheclimatebyutilizingwaterandtrees furthermore,makeslotsoftrash.
AirWritingcanrapidlysettletheseissues.Itwill goabout as a specialized device for individuals with hearing debilitation. Their air composed message can be introduced utilizing AR or switched over speech. One can rapidlywriteintheairandgoonwithyourworkabsenta lot of interruption. Also, writing in the air doesn't need paper.Everythingisputawayelectronically
5. Methodology
Therearea fewstages whichdeterminethe work process ofthewholeproject:
The First step ie; Start starts the beginning of the task . It demonstratestherunningofthewholeprogram.
The Second step ie; Image Collection expresses that the catchingofpicturebymeansofwebcamerainPCgadget.
The Third step ie ; Image Processing states that getting to thedatapointsOftheImagesfromthecamera.
TheFinaladvanceistheProjectionofOutputonthescreen which is finished by associating the followed focuses and extendingitonthescreen.
(Fig.1.Workstreamofproposedsystem.)
This framework needs a dataset for the Fingertip Detection Model. The Fingertip Model's main role is utilizedtorecordthemovement,i.e.,theaircharacter.
5.1 FINGERTIP DETECTION MODEL :
Weacceptindividualsoughttohavetheoptiontowritein the air without the pain of conveying a pointer. Tracking the article by means of the OpenCV library through every video outline is done through pre handling the frame picture,coveringtheobjectiveitemwitha colourrange to distinguish it from the background, and viewing as the forms in the mask. The program keeps on circling the followingstridesuntilitstops.
5.2
TECHNIQUES OF FINGERTIP RECOGNITION DATASET CREATION:
Utilizes strategies of dataset preparing, examining and displaying.
5.3
TRACING TRAJECTORY:
Trackedpointsareassociatedandprojectedonthescreen.
6 . Algorithms for the Workflow
Thisisthemostintriguingpieceofourframework.Writing includes a part of functionalities. In this way, the quantity of gestures utilized for controlling the framework is equivalent to these number of activities involved. The fundamental functionalities we remembered for our frameworkare
6.1 WRITING MODE
Inthisexpress,theframeworkwillfollowthefingertipco ordinatesandstoresthem.
International Research Journal of Engineering and Technology (IRJET) e ISSN:2395 0056
Volume: 09 Issue: 05 | May 2022 www.irjet.net p ISSN:2395 0072
6.2 COLOUR MODE
The client can change the shade of the text among the differentaccessibletones.
6.3 BACKSPACE
Say in the event that the client turns out badly, we really wantasignaltoaddabackspace.
8. References :
[1]S.V.AswinKumer⇑,P.Kanakaraja,SheikAreez,Yamini Patnaik, Pamarthi Tarun Kumar, " An implementation of virtualwhiteboardusingopenCVforvirtualclasses.
[2]Mishra,P.,&Uniyal,A.(2021).VirtualInkUsingPython (No.5707).EasyChair.
[3] Saoji , Saurabh & Dua, & Vidyapeeth, Bharati & Choudhary,Akash&Phogat,Bharat.(2021).AIRCANVAS
APPLICATIONUSINGOPENCVANDNUMPYIN PYTHON.InternationalJournalofResearchinEngineering andTechnology.8.2395 0056.
[4]Srungavarapu,Pranavi&Maganti,Eswar&Sakhamuri, Srilekkha & Veerada, Sai & Chinta, Anuradha. (2021). Virtual Sketch using Open CV. International Journal of Innovative Technology and Exploring Engineering. 10. 107 108.10.35940/ijitee.H9262.0610821.
7. Conclusion
(Fig.2ExpectedOutput)
The framework can possibly challenge traditional writing methods.ItdeniestheneedtoconveyacellphoneinHand to record notes , giving the straightforward method for doing the same . It will also fill an extraordinary need in aiding particularly abled individuals communicate effectively . Indeed, even Senior resident or individuals who find it hard to utilize consoles will actually want to utilize the framework easily . Expanding magnificent usefulness , framework can likewise be utilized to control IOT gadgets shortly . Attracting the air can likewise be made conceivable . The framework will be a fantastic programming for smart wearables utilizing which individuals could more readily interface with the Digital world.
AugmentedRealitycanmaketextwakeup.Therearesome constraints of the framework which can be worked on from now on. First and foremost, utilizing a handwriting recognizer instead of a character recognizer will permit the client to compose quicker. Also , our framework in some cases perceives fingertips behind the scenes and alterstheirstate.Air composingframeworksoughttojust obey their expert's control motions and ought not be deceived by individuals around. Later on, progresses in Artificial Intelligence will improve the productivity of air writing.
[5] Kaur, Harneet & Reddy, Busireddy & Sai, Guna & Raj, Akula. (2021). A Comprehensive overview of AR/VR by Writing in Air. International Journal of Scientific Research in Computer Science, Engineering and Information Technology.477 482.10.32628/CSEIT217294.
[6] M.S.Alam,K. C.KwonandN.Kim,"Trajectory Based
Air Writing Character Recognition Using Convolutional Neural Network," 2019 4th International Conference on Control, Robotics and Cybernetics (CRC), 2019, pp. 86 90, doi:10.1109/CRC.2019.00026.
[7] Yuan Hsiang Chang , Chen Ming Chang , “Automatic Hand Pose Trajectory Tracking System Using Video Sequences”,INTECH,pp.132 152,Croatia,2019.
[8] J. Patel, U. Mehta, K. Panchal, D. Tailor and D. Zanzmera, "Text Recognition by Air Drawing," 2021 Fourth International Conference on Computational Intelligence and Communication Technologies (CCICT), 2021,pp.292 295,doi:10.1109/CCICT53244.2021.00061.
[9] Z. T.Liu,D.P.Y.WongandP.H.Chou,"AnImu Base Wearable Ring for On Surface Handwriting Recognition," 2020 International Symposium on VLSI Design, Automation and Test (VLSI DAT), 2020, pp. 1 4, doi: 10.1109/VLSIDAT49148.2020.9196479.
[10] S. Tanaka, M. Takuma, Y. Tsukada, Recognition of finger alphabet remote image sensor, (in Japanese), in
International Research Journal
of
Engineering
and
Technology (IRJET) e ISSN:2395 0056
Proc.76thNat.Conv.(IPSJ),2014,vol.76.no.2,pp.2275 2276.
[11] T. Miyake, D. Wakatuki, I. Naito, ‘‘A basic study on recognizing fingerspelling with hand movements by the use of depth image,’’ (in Japanese), Nat. Univ. Corporation Tsukuba, Univ. Technology, Tsukuba, Japan, Tech. Rep., Dec.2012,vol.20,no.1,pp.7 13.
[12] D. Takabayashi et al., Training system for learning finger alphabets with feedback functions (in Japanese), IEICE(HIP),Tech.Rep.112(483)(2013)79 84.
[13] M. Maehatake, M. Nishida, Y. Horiuchi, A. Ichikawa, A study on sign language recognition based on gesture components of position and movement, (in Japanese), in Proc. Workshop Interact. Syst. Softw. (WISS), Japan, Dec. 2007,pp.129 130.
[14] A. Sato, K. Shinoda, S. Furui, ‘Sign language recognitionusingtime of flightcamera(inJapanese),Proc. Meeting Image Recognition. Understand. (MIRU) 3 (44) (2010) 1861 1868. [16] Y. Nishimura, D. Imamura, Y. Horiuchi, K. Kawamoto, T. Shinozaki, S. Kuroiwa, HMM sign language recognition using kinect and particle filter, (inJapanese),IEICE(PRMU),Tech.Rep. 111(430) (2012) 161 166.
[15] M. Ohkura, R. Manabe, H. Shimada, Y. Shimada, A recognition algorithm of numerals written in the air by a finger tip(inJapanese),J.IPSJ52(2)(2011)910 916.
[16] T. Sonoda, Y. Muraoka, A letter input system of handwritinggesture,(inJapanese),IEICETrans.Commun., vol.J86 D II,no.7,pp.1015 1025,2003.
[17] Y. Fujii, M. Takezawa, H. Sanada, K. Watanabe, An aerial handwritten character input system (in Japanese), IPSJ(MBL),Tech.Rep.50(6)(2009)1 4.
[18] T. Murata, J. Shin, Hand gesture and character recognition based on kinect sensor, Int. J. Distributed. Sensor Network. 10 (7) (2014) 278460, https://doi.org/ 10.1155/2014/278460.
[19] Y. Tanaka, Training system for learning finger alphabetswithfeedbackfunctions,M.S.thesis,FacultyInd. Technol.,TsukubaUniv.Technol.,Tsukuba,Japan,2014
Volume: 09 Issue: 05 | May 2022 www.irjet.net p ISSN:2395 0072 © 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page3013