Issuu

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395-0056

Volume: 12 Issue: 01 | Jan 2024

p-ISSN: 2395-0072

www.irjet.net

Gesture Recognition Based Virtual Mouse and Keyboard Anurup Yemle1, Shreepad Wadgave2, Rohan Jadhav3, Karan Anarase4, Kashmira Jayakar5 1234Student, Dept. of Information Technology, RMD Sinhgad School of Engineering ,Warje ,Pune, Maharashtra,

India

5Professor, Dept. of Information Technology, RMD Sinhgad School of Engineering ,Warje ,Pune, Maharashtra, India

---------------------------------------------------------------------***--------------------------------------------------------------------1.1 Motivation

Abstract - Computer vision has advanced significantly,

allowing computers to identify their users through simple image processing programs. This technology is now widely applied in everyday life, including face recognition, color detection, autonomous vehicles, and more. In this project, computer vision is utilized to create an optical mouse and keyboard controlled by hand gestures. The computer’s camera captures images of hand gestures, and based on their movements, the mouse cursor moves accordingly. Gestures can also simulate right and left clicks, while specific gestures enable keyboard functions, such as selecting alphabets or swiping left and right.

Gestures, commonly used in personal communication, play a significant role in enhancing interactions between humans and machines. They provide a natural and intuitive way to control devices, eliminating the need for physical interfaces. This opens up vast opportunities for developing unique methods of human-machine interaction, allowing for seamless integration of technology into daily life. By leveraging gestures, innovative applications can be created to enhance accessibility, efficiency, and user experience in various domains.

1.2 Problem Definition

This system operates as a virtual mouse and keyboard, eliminating the need for wires or external devices. The project hardware requirement is limited to a webcam, with Python used for coding on the Anaconda platform. Convex hull defects are calculated, and an algorithm maps these defects to mouse and keyboard functions. By linking specific gestures with these functions, the computer interprets user gestures and executes corresponding actions.

Traditionally, computers and laptops rely on physical mice or touchpads, which were developed years ago. However, this project eliminates the need for external hardware by using human-computer interaction technology. It detects hand movements, gestures, and eye features to control mouse movements and trigger mouse events, offering a more innovative and intuitive approach.

Key Words: Computer Vision, Optical Mouse, Optical Keyboard, Hand Gestures, Python, Convex Hull Defects, Gesture Recognition, Virtual Input Devices

2. FUNCTIONAL REQUIREMENTS The system features involve a comprehensive approach to understanding the problem statement, which is the foundation for identifying the core objectives and goals of the proposed system. By thoroughly analyzing the problem, one can determine the specific requirements and challenges that need to be addressed. The identification of both hardware and software requirements plays a crucial role in ensuring that the system is compatible with the necessary technologies and will function as intended. Understanding the proposed system in detail is essential to ensure that all components and processes are aligned with the intended functionality. This enables a seamless integration of various elements, such as sensors, processing units, and user interfaces, to work together efficiently. Furthermore, careful planning of activities is vital for maintaining a structured approach throughout the system development lifecycle. Using a planner allows for the organization of tasks, resources, and timelines to ensure that all steps, from design to implementation, are executed in a timely manner. This includes stages such as system design, where architectural decisions are made, programming, where the code is written, and testing, where the system’s functionality is verified.

1. INTRODUCTION The computer's webcam captures live video of the person sitting in front of it. A small green box appears in the center of the screen, where objects displayed within the box are processed by the program. If an object matches the predefined criteria, the green box changes to a red border, indicating that the object has been recognized. Once recognized, moving the object allows the mouse cursor to move accordingly. This feature enhances computer security and provides a virtual interaction experience. Hand gestures are used in place of objects, with different gestures assigned to specific functions. For instance, one gesture controls the cursor movement, another performs a right-click, and a third triggers a left-click. Similarly, keyboard functions can also be performed using simple gestures, eliminating the need for a physical keyboard. If the gesture does not match any predefined patterns, the box remains green, while a recognized gesture changes the border to red.

Impact Factor value: 8.315

ISO 9001:2008 Certified Journal

Page 389