Hand Gesture Recognition System as Virtual Mouse for HCI

Abstract: The technique of interaction between human and computer is evolving since the invention of computer technology. The mouse is one of the invention in HCI (human computer interaction) technology. Though wireless are Bluetooth mouse technology is invented still, that technology is not completely device free. A Bluetooth mouse has the requirement of battery power it requires extra power supply. Presence of extra devices in a mouse increases the difficulty level of more hardware components. The proposed mouse system is outside this limitation. This paper proposes a virtual mouse system using colored hand glove based on HCI using computer vision and hand gestures. Gestures captured with a webcam on processed with color segmentation, detection technique and feature extraction. The user will be allowed to control some of the computer cursor functions with a colored glove on the hand. Primarily, a user can perform with their fingers, scrolling up or down using their hands in different gestures. This system captures frames using a webcam or built-in cam it is based on the camera quality. So the usage of colored glove mouse system eliminates device dependency in order to use a mouse. Keywords: HCI(human computer interaction), colored hand glove , gestures

Download Full-text

Development of CNN-based Virtual Mouse

International Journal for Research in Applied Science and Engineering Technology ◽

10.22214/ijraset.2021.35169 ◽

2021 ◽

Vol 9 (VI) ◽

pp. 800-807

Author(s):

Mohammed Anasuddin

Keyword(s):

Neural Network ◽

Computer Vision ◽

Human Computer Interaction ◽

Convolutional Neural Network ◽

Neural Network Model ◽

Hand Gestures ◽

Battery Power ◽

Virtual Mouse ◽

Device Free ◽

Mouse System

The technique of building a process of interaction between human and computer is evolving since the invention of technology. The mouse is a superb invention in HCI (Human-Computer Interaction) technology. Though wireless mouse technology is invented still, that technology isn't completely device free. A Bluetooth mouse has the need of battery power and connecting dongle. The proposed mouse system is beyond this limitation. This paper proposes a virtual mouse system supported HCI using computer vision and hand gestures. Gestures captured with a built-in camera or webcam and processed by a Convolutional Neural Network Model for classification among the desired mouse operations. The users are going to be allowed to regulate a number of the pc cursor functions with their hand gestures. Primarily, a user can perform left clicks, right clicks, and double clicks, scrolling up or down using their hand in several gestures. This technique captures frames employing a webcam or built-in cam and processes the frames to make them track-able and then recognizes different gestures made by users and perform the mouse functions. Therefore the proposed mouse system eliminates device dependency so as to use a mouse.

Download Full-text

A Review Paper on Human Computer Interaction

International Journal of Advanced Research in Computer Science and Software Engineering ◽

10.23956/ijarcsse.v8i4.630 ◽

2018 ◽

Vol 8 (4) ◽

pp. 53 ◽

Cited By ~ 1

Author(s):

Himanshu Bansal ◽

Rizwan Khan

Keyword(s):

Human Computer Interaction ◽

Computer Technology ◽

Mental Model ◽

Review Paper ◽

Current Approach ◽

Automated System ◽

Age Group ◽

Long Time ◽

Interaction Research ◽

Computer Interaction

The advancement in the development of computer technology has led to the idea of human computer interaction. Research experiments in human computer interaction involves the young age group of people that are educated and technically knowledgeable. This paper focuses on the mental model in Human Computer Interaction. There are various approaches of this review paper and one of them is highlighting current approach, results and the trends in the human computer interaction and the second approach is to find out the research that have been invented a long time before and are currently lagging behind. This paper also focuses on the emotional intelligence of a user to become more user like, fidelity prototyping. The development and design of an automated system that perform such task is still being accomplished.

Download Full-text