Multi-classification of action intention understanding brain signals based on thresholding graph metric

BACKGROUND: Classification of action intention understanding is extremely important for human computer interaction. Many studies on the action intention understanding classification mainly focus on binary classification, while the classification accuracy is often unsatisfactory, not to mention multi-classification. METHOD: To complete the multi-classification task of action intention understanding brain signals effectively, we propose a novel feature extraction procedure based on thresholding graph metrics. RESULTS: Both the alpha frequency band and full-band obtained considerable classification accuracies. Compared with other methods, the novel method has better classification accuracy. CONCLUSIONS: Brain activity of action intention understanding is closely related to the alpha band. The new feature extraction procedure is an effective method for the multi-classification of action intention understanding brain signals.

Action Intention Understanding EEG Signal Classification Based on Improved Discriminative Spatial Patterns

Objective. Action intention understanding EEG signal classification is indispensable for investigating human-computer interactions and intention understanding mechanisms. Numerous investigations on classification tasks extract classification features by using graph theory metrics; however, the classification results are usually not good. Method. To effectively implement the task of action intention understanding EEG signal classification, we proposed a new feature extraction method by improving discriminative spatial patterns. Results. The whole frequency band and fusion band achieved satisfactory classification accuracies. Compared with other authors’ methods for action intention understanding EEG signal classification, the new method performs more satisfactorily in some aspects. Conclusions. The new feature extraction method not only effectively avoids complex values when solving the generalized eigenvalue problem but also perfectly realizes appreciable classification accuracies. Fusing the classification features of different frequency bands is a useful strategy for the classification task.

An Intention Understanding Algorithm Based on Multimodal Information Fusion

This paper proposes an intention understanding algorithm (KDI) based on an elderly service robot, which combines Neural Network with a seminaive Bayesian classifier to infer user’s intention. KDI algorithm uses CNN to analyze gesture and action information, and YOLOV3 is used for object detection to provide scene information. Then, we enter them into a seminaive Bayesian classifier and set key properties as super parent to enhance its contribution to an intent, realizing intention understanding based on prior knowledge. In addition, we introduce the actual distance between the users and objects and give each object a different purpose to implement intent understanding based on object-user distance. The two methods are combined to enhance the intention understanding. The main contributions of this paper are as follows: (1) an intention reasoning model (KDI) is proposed based on prior knowledge and distance, which combines Neural Network with seminaive Bayesian classifier. (2) A set of robot accompanying systems based on the robot is formed, which is applied in the elderly service scene.

Say What You Are Looking At: An Attention-Based Interactive System for Autistic Children

Gaze-following is an effective way for intention understanding in human–robot interaction, which aims to follow the gaze of humans to estimate what object is being observed. Most of the existing methods require people and objects to appear in the same image. Due to the limitation in the view of the camera, these methods are not applicable in practice. To address this problem, we propose a method of gaze following that utilizes a geometric map for better estimation. With the help of the map, this method is competitive for cross-frame estimation. On the basis of this method, we propose a novel gaze-based image caption system, which has been studied for the first time. Our experiments demonstrate that the system follows the gaze and describes objects accurately. We believe that this system is competent for autistic children’s rehabilitation training, pension service robots, and other applications.