Skip to main content

Gesture-based virtual painter using Mediapipe

Page 1

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 04 | Apr 2025

p-ISSN: 2395-0072

www.irjet.net

Gesture-based virtual painter using Mediapipe P. Chitralingappa1, Fardeen Hussain2, L. Hemanth Kumar3, C. Dheeraj4, M. Harish Chavan5 1Associate Professor, Dept. of CSM, Srinivasa Ramanujan Institute of Technology, Anantapur, India; 2,3,4,5 Dept. of CSM, Srinivasa Ramanujan Institute of Technology, Anantapur, India;

---------------------------------------------------------------------***--------------------------------------------------------------------2. EXISTING SYSTEM

Abstract - With Air Canvas users can draw on screens

through simple hand movements while they do not need to physically touch it. Index finger serves as the main drawing instrument in this system yet users can switch tools without creating accidents by keeping their second finger shut. A fist gesture has been built into the system to instantly delete everything drawn on the canvas. Despite delivering highprecision landmark detection MediaPipe’s Hand Tracking module enables better control over smooth and precise drawing performance. User interaction receives improvement through the system's implementation of computer vision methods like color detection and contour extraction and tracking algorithms. Air Canvas enables users to create drawings through touchless gestures that find applications in educational settings as well as design and assistive technology fields.

A. Kinetic sensors The most commonly used equipment for the studies involving computer vision using hands is kinetic sensors. The hardware is mounted onto the fingertips of our hands like a glove and then the movement is tracked. B. Simple UI The air canvas designed by others so far has limited features and gestures, it usually has only a single functionality of writing with an index finger and clearing the board with it, the functions like shapes, erasing or brush size are not really implemented. C. Using the canvas It takes a while to get used to the writing in air concept for the user, the canvas has many features and gestures that the user cannot get in the first try, to make the task simple a simple UI is needed.

Key Words: Air Writing, Motion-to-Text Conversion, Computer Vision, Object Tracking, Human-Machine Interaction.

D. Limited features and gestures The tools built for computer vision can be very limited as it takes some knowledge to understand the CV techniques, we can use multiple gestures and tools for making the canvas more versatile.

1.INTRODUCTION Computer vision along with artificial intelligence research has fostered fresh methods of interacting between humans and computers which can function without physical touching devices. Users can now employ the Air Canvas system to draw on digital screens by performing basic hand motions which eliminates manual screen interaction. The touch-free drawing feature of this system enables useful applications across educational institutions and laboratories that specialize in digital art and assistive technology fields. A combination of OpenCV for real-time processing and hand tracking enables the Air Canvas system which uses MediaPipe’s Hand Tracking module to improve recognition efficiency. Index finger operation detects drawings and second finger closure selects tools without producing unwanted marks. Users can easily clear their canvas through the implementation of a fist gesture for an improved user experience. The Air Canvas achieves exact and smooth drawing with its implementation of color detection methods and contour extraction algorithms together with tracking algorithms. A paperless world can be created using this application where there is only need for a device and a hand [1]. Computer vision has proved its capability for developing interactive user interfaces during this project as it sets precedence for new applications in digital accessibility.

© 2025, IRJET

|

Impact Factor value: 8.315

3.PROPOSED SYSTEM A system design for a "Air Canvas" application using OpenCV needs several key components. This app enables users to utilize camera-captured motions to sketch or paint in midair. Below is a simplified system architecture with a flowchart.

Figure 1. Basic Design of the system Canvas User Interface: The frontend part of the canvas has functionalities that a user can interact with, the tools contain

|

ISO 9001:2008 Certified Journal

|

Page 164


Turn static files into dynamic content formats.

Create a flipbook
Gesture-based virtual painter using Mediapipe by IRJET Journal - Issuu