International Research Journal of Engineering and Technology (IRJET)
e-ISSN: 2395-0056
Volume: 10 Issue: 04 | Apr 2023
p-ISSN: 2395-0072
www.irjet.net
Facial-Expression Based Mouse Cursor Control for Physically Challenged Individuals: A Human Computer Interaction (HCI) Approach. 1.Madan Venkat Sai P, 2.Harish Reddy N, 3.Akshay S, 4.Tarun Sai K, 5.Rajamani P (Prof.) 1-4 UG Student, Dept. of Computer science Engineering, GITAM UNIVERITY, Visakhapatnam, Andhra Pradesh, India. 5 Assistant Professor, Dept. of Computer science Engineering, GITAM UNIVERSITY, Visakhapatnam, Andhra
Pradesh, India. ---------------------------------------------------------------------------***--------------------------------------------------------------------and desktops and enables operations such as cursor 1. Abstract:
movement in all directions, click events, and scroll events. The system is deeply centered around facial landmarks prediction for the face from eye- blinks and mouth movements detection in a video. This research paper delves into the technologies used in the development of this HCI application, including face detection models, landmark detection models, head pose estimation models, and gaze estimation models. This study major objective focuses on an effective & accessible HCI application for individuals with disabilities, making computer usage an easier and more inclusive experience.
The Human-Computer Interaction application i.e., cursor control using facial movements works with just regular webcam. The system targets on using user’s facial movements. Its free of hands, avoidance of wearable hardware or sensors. The application deeply centered around facial landmarks prediction for face from eyeblinks and mouth movements detection in a video. Actions like mouth open to activate or deactivate mouse control, Wink of Right-side eye to right click, Wink of Left side eye for function of left click, squinting a person’s Eye for activate or deactivate scrolling, Head Movements (Pitch and Yaw) –scrolling or cursor movement. With the help of these landmarks of the face make use of building corresponding features for further allowance to detect certain actions, for detection of winking and blinking of eye using eye-aspect-ratio and yawn and pout of mouth using mouth-aspect-ratio. The actions act as triggers for the mouse control. The model mainly looks into two main factors while analyzing, they are Eye Aspect-Ratio (EAR) that helps for detecting winks and blinks etc. and MAR which is known as Mouth-Aspect-Ratio to get to know the status of mouth either closed or opened.
3. Literature survey: The advancement of technology has led to the development of various human-computer interaction (HCI) systems, including those based on facial and ocular movements for cursor control. In one proposed system, the mouse cursor can be controlled using facial movements, with a suggested algorithm for a multimodal HCI system that efficiently controls all mouse actions, including clicks and scrolling. The system also offers the possibility to add functions to cover practical situations, and the use of HCI techniques can control other computer-generated biases [1]. Another system employs the Raspberry Pi and OpenCV for cursor control using eyeball movement based on the Eye Aspect Ratio (EAR) method, which can be expanded to cover all mouse tasks [2]. A third system also employs Dlib and the Haar Cascade algorithm for cursor control based on eyes and facial movements, which can be improved through additional techniques such as clicking events and interfaces using eye movement and blinking [3]. Another facial expression-based system uses the Viola & Jones algorithm and a standard web camera to record the subject's emotion and send data, enabling physically disabled individuals to use the mouse cursor independently [4,10]. In a system based on eye movement, the mouse cursor is controlled using limbus tracking, pupil tracking, electrooculography, and saccade, which has some limitations related to head movement and squinting [5]. Another system enhances cursor control using eye mouse with Haar- like object
2. Introduction: In the modern era, computing systems have taken the most integral role of our daily life. With the evolution of technology, computer systems have been developed to perform various tasks, both simple and specialized. However, for individuals with physical disabilities, many input devices such as keyboards and mice can be difficult or impossible to use. This challenge can be solved through the development of assistive technologies, such as HCI which is known as Human-Computer Interaction applications. Current research paper concentrates on the development of a robust HCI application for disabled persons using directed cursor control and facial expression tracking technology. With just a regular webcam, users can control the cursor using their facial expressions, without the need for wearable hardware or sensors. This application is compatible with both laptops
© 2023, IRJET
|
Impact Factor value: 8.226
|
ISO 9001:2008 Certified Journal
|
Page 242