Design of Human-computer Interaction System Using Gesture Recognition Algorithm from the Perspective of Machine Learning

Author(s):  
Jiawei Li
Author(s):  
Zhiqiang Teng ◽  
Haodong Chen ◽  
Qitao Hou ◽  
Wanbing Song ◽  
Chenchen Gu ◽  
...  

Abstract Computer-assisted cognitive training is an effective intervention for patients with mild cognitive impairment (MCI), which can avoid the disadvantages of traditional cognitive training that consumes a lot of medical resources and is difficult to be standardized. However, many computer-assisted cognitive training systems have unfriendly human-computer interaction, for not considering that most MCI patients have certain difficulties in using computers. In this paper, we design a cognitive training system which allows patients to implement human-computer interaction through gestures. First, a gesture recognition algorithm is proposed, in which we implement gesture segmentation based on YCbCr color space and Otsu algorithm, extract Fourier Descriptors of gesture contour as feature vectors and use SVM algorithm to train a classifier to recognize gestures. Then, the graphical user interface (GUI) of the system is designed to realize the task requirement of cognitive training for the MCI patients. Finally, the results of tests show the accuracy of the algorithm and the feasibility of the GUI. With the above computer-assisted cognitive training system, patients can achieve human-computer interaction only through gestures without the need to use keyboard, mouse, etc., greatly reducing the burden of patients during training.


undertaking in the field of human-computer interaction (HCI) and computer vision. 10 years prior to the undertaking appeared to be practically unsolvable with the data given by a single RGB camera. In this work, we have actualized a presumable exact strategy to perceive static gestures or image frames from a live camera or video data. As Hand Gesture Recognition is identified with two noteworthy fields of image processing and AI (machine learning), in this way, this report likewise refers to the different tools and APIs that can be utilized to implement different strategies and methods in these fields


Sign in / Sign up

Export Citation Format

Share Document