Embedded Control for Manipulating Video Game Objects in Real Time using Hand Gesture Recognition

Page 1

International Research Journal of Engineering and Technology (IRJET)

e-ISSN: 2395 -0056

Volume: 04 Issue: 04 | Apr -2017

p-ISSN: 2395-0072

www.irjet.net

Embedded Control for Manipulating Video Game objects in Real Time using Hand Gesture Recognition Pranav Pawar1, Kiran Tupe2, Sanket Somvanshi3, Vishal Shinde4, Sudam Pawar5 1234 Student, 5Assistant

Professor Department of Computer Engineering, STES’s Sinhgad Institute of Technology and Science, Narhe, Pune, Maharashtra, India. ---------------------------------------------------------------------***------------------------------------------------------------------Computer information technology is increasingly entering the hospital applications. It is important that such technology should be used in a safe way in order avoid serious mistakes leading to possible incidents. Keyboards and mice are an important method of human – computer interaction (HCI) nowadays. Unfortunately, it is noticed that a common method of spreading infection from one person to another include computer keyboards and mice in intensive care units (ICUs) used by doctors and nurses [4]. Introducing a more natural human computer interaction (HCI) will have a positive impact in today's hospital environment [4]. Speech and gestures (including facial expressions, hand gestures, body gestures and eye gaze) is the basis of human machine interaction (HMI). In face mouse a surgeon can control the motion of the laparoscope by simply making the appropriate face gesture, without using their hand or foot or voice input. Here we explore the use of hand gestures which can be further enhanced in the future by other modalities. A vision-based gesture capture system is used to manipulate windows and objects in a graphical user interface (GUI). Current research to incorporate hand gestures into doctor-computer interface have appeared in Graetzel et al [4]. They developed a computer vision system that enables surgeons to perform standard mouse functions such as pointer movement and button presses by using hand gestures. Zeng et al. by tracking position of the fingers they gather quantitative data about the breast palpation process which is used for further analysis. Much of the research on real-time gesture recognition is focused exclusively on the dynamic or static gestures. In our work, we consider the hand gesture and posture at the same time. This gives us much richer and realistic gesture representation.

Abstract - The hand gestures provide a natural and

intuitive communication modality for human–computer interaction. Efficient human computer interfaces (HCIs) have to be developed to allow computers to visually recognize in real time hand gestures. This deals with real time hand gesture recognition using various microcontroller. In this project the gesture based recognition is of computer graphics. The existing system uses Digital camera for hand gesture recognition. The camera ways used as an input device and the object need to present in front of the camera for capturing gesture. The proposed system, based on the input signal from the accelerometer sensors measure the acceleration such as direction to the graphics like up down motion. It is reliably and accurate detect. The up down motion of sensor makes the graphics movable. Key Words: gestures, human machine interfacing, gaming, controller, gesture recognition for gaming, microcontroller.

1. INTRODUCTION Gestures as an input modality can provide efficient and flexible interaction between human and computer. Gesture control has few advantages compared with more traditional modalities: gestures are silent, they require no eye focus and, for certain tasks, they can feel more natural than, for instance, pressing a key on the keyboard. Inspired by the proliferation of MEMS accelerometer sensors built-in personal electronic devices, such as smartphones, music players and game consoles, it presents a novel gesture recognition system based solely on accelerometer data. The acceleration data is utilized to recognize the hand gestures. The algorithm used for Gesture recognition is developed based on Sign Sequence and Template Matching Algorithm.

2. Literature Review The hand gestures provide a natural communication method for human computer interaction. Efficient human computer interfaces (HCIs) have to be developed to allow computers for visually identifying real time hand gestures. This project deals with real time hand gesture recognition

Up to eight hand gestures can be recognised. In future work the hand gesture recognition system is to be used in Human- Machine interface such as controlling a flying machine using the hand gesture etc.

© 2016, IRJET

|

Impact Factor value: 4.45

|

ISO 9001:2008 Certified Journal

|

Page 517


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.
Embedded Control for Manipulating Video Game Objects in Real Time using Hand Gesture Recognition by IRJET Journal - Issuu