International Research Journal of Engineering and Technology (IRJET)
e-ISSN: 2395-0056
Volume: 12 Issue: 02 | Feb 2025
p-ISSN: 2395-0072
www.irjet.net
Implementation of Air Canvas using Python, OpenCv, MediaPipe and using CvZone Hand-Tracking-Module 1Annant Goyal, 2Aviral Sharma, 3Atul Nag, 4Yash Saxena, 5Kashish Singh, 1Information Technology and Engineering, Maharaja Agrasen Institute of Technology
2Information Technology and Engineering, Maharaja Agrasen Institute of Technology 3Electronics and Communication Engineering, Maharaja Agrasen Institute of Technology 4Electronics and Communication Engineering, Maharaja Agrasen Institute of Technology 5Information Technology and Engineering, Maharaja Agrasen Institute of Technology
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract -The evolution of Human-Computer Interaction
Keywords: Air Canvas, Hand Tracking, Gesture Recognition, Computer Vision, OpenCV, Mediapipe, Cvzone, HumanComputer Interaction
(HCI) has significantly transformed the way individuals engage with digital systems. One of the most groundbreaking advancements in this domain is the ability to interact with computers through natural hand gestures, eliminating the need for traditional input devices such as keyboards and touchscreens. This paper introduces Air Canvas, an innovative application that leverages Python, OpenCV, Mediapipe, and Cvzone’s Hand TrackingModule to enable users to draw in the air seamlessly.
1.INTRODUCTION The rapid evolution of digital technology has revolutionized traditional methods of writing and drawing, replacing conventional tools such as pens, pencils, and paper with advanced digital alternatives. Devices like styluses, touch-sensitive screens, and voiceto-text systems have become prevalent, allowing users to create digital content with ease. Despite these advancements, there remains a need for more intuitive, touch-free interaction methods that provide seamless user experiences. This gap has led to the development of Air Canvas, an innovative system designed to enable users to sketch, write, or draw in mid-air through natural hand gestures, eliminating the necessity for direct physical contact with a surface.
Air Canvas utilizes real-time computer vision techniques to track hand movements and interpret them into digital strokes, allowing users to write, sketch, or create artistic content without physical contact with a screen or surface. The system employs Mediapipe’s Hand Tracking API for accurate landmark detection and OpenCV for processing and rendering the drawings. The integration of these technologies ensures precise fingertip tracking, leading to smooth and fluid stroke generation. This application is particularly beneficial in a variety of fields, including creative design, education, and accessibility. In creative industries, artists and designers can use Air Canvas to sketch and develop concepts in a dynamic and intuitive manner. In education, it serves as a valuable tool for remote learning, allowing teachers to illustrate concepts in real time without requiring a physical whiteboard. Moreover, for individuals with motor disabilities, Air Canvas provides an accessible alternative to traditional input devices, promoting inclusivity in digital interactions.
Hand gesture recognition has gained significant traction in Human-Computer Interaction (HCI) research, with applications spanning a broad spectrum, including virtual reality (VR), augmented reality (AR), and sign language recognition. These applications leverage advanced computer vision algorithms to track and interpret human gestures in real time, enhancing interaction with digital environments. With the advent of real-time hand tracking frameworks such as Cvzone’s Hand TrackingModule, the accuracy and efficiency of gesture-based systems have seen remarkable improvements.
This paper explores the system's architecture, implementation methodology, and performance evaluation, highlighting the efficiency and robustness of the proposed approach. Additionally, potential future enhancements, such as integrating machine learning for predictive gesture recognition and incorporating augmented reality (AR) support, are discussed. By enabling hands-free digital interaction, Air Canvas paves the way for more immersive and intuitive computing experiences.
© 2025, IRJET
|
Impact Factor value: 8.315
The Air Canvas system employs a combination of Python, OpenCV, Mediapipe, and Cvzone to enable seamless hand tracking and precise digital stroke rendering. Mediapipe’s Hand Tracking API plays a pivotal role in detecting and capturing hand landmarks, ensuring high precision and minimal latency. OpenCV is utilized to process the extracted data, rendering the drawings dynamically and allowing users to interact with the digital canvas in an effortless manner. The synergy of these technologies results in a system capable of real-time gesture
|
ISO 9001:2008 Certified Journal
|
Page 675