Estimation of stochastic representation of via-points in human motion control by reinforcement learning

Author(s):  
Y. Wada ◽  
K. Tokunaga
2021 ◽  
Vol 11 (10) ◽  
pp. 4678
Author(s):  
Chao Chen ◽  
Weiyu Guo ◽  
Chenfei Ma ◽  
Yongkui Yang ◽  
Zheng Wang ◽  
...  

Since continuous motion control can provide a more natural, fast and accurate man–machine interface than that of discrete motion control, it has been widely used in human–robot cooperation (HRC). Among various biological signals, the surface electromyogram (sEMG)—the signal of actions potential superimposed on the surface of the skin containing the temporal and spatial information—is one of the best signals with which to extract human motion intentions. However, most of the current sEMG control methods can only perform discrete motion estimation, and thus fail to meet the requirements of continuous motion estimation. In this paper, we propose a novel method that applies a temporal convolutional network (TCN) to sEMG-based continuous estimation. After analyzing the relationship between the convolutional kernel’s size and the lengths of atomic segments (defined in this paper), we propose a large-scale temporal convolutional network (LS-TCN) to overcome the TCN’s problem: that it is difficult to fully extract the sEMG’s temporal features. When applying our proposed LS-TCN with a convolutional kernel size of 1 × 31 to continuously estimate the angles of the 10 main joints of fingers (based on the public dataset Ninapro), it can achieve a precision rate of 71.6%. Compared with TCN (kernel size of 1 × 3), LS-TCN (kernel size of 1 × 31) improves the precision rate by 6.6%.


Author(s):  
Nicola Vitiello ◽  
Emanuele Cattin ◽  
Stefano Roccella ◽  
Francesco Giovacchini ◽  
Fabrizio Vecchi ◽  
...  

Author(s):  
Shuichi Fukuda

Abstract Learning from failures approach how to control human motion is developed by extending Mahalanobis Taguchi System. It enables quantitative measurement of how the learner is improving in his or her learning, It helps to acquire tacit knowledge such as swimming, for which we do not have valid approach. Since Mahalanobis Distance is a unitless measure for multi-dimensional variables, this approach can be extended to many adaptive network formation and management, because this approach let the learner recognize how he or she can coordinate their body pars to adapt to the changing situations. Thus, the approach ca be applied to development and operation of soft robots and adaptive network or team formation and management in the IoT connected society.


Sensors ◽  
2019 ◽  
Vol 19 (21) ◽  
pp. 4794
Author(s):  
Alejandro Rodriguez-Ramos ◽  
Adrian Alvarez-Fernandez ◽  
Hriday Bavle ◽  
Pascual Campoy ◽  
Jonathan P. How

Deep- and reinforcement-learning techniques have increasingly required large sets of real data to achieve stable convergence and generalization, in the context of image-recognition, object-detection or motion-control strategies. On this subject, the research community lacks robust approaches to overcome unavailable real-world extensive data by means of realistic synthetic-information and domain-adaptation techniques. In this work, synthetic-learning strategies have been used for the vision-based autonomous following of a noncooperative multirotor. The complete maneuver was learned with synthetic images and high-dimensional low-level continuous robot states, with deep- and reinforcement-learning techniques for object detection and motion control, respectively. A novel motion-control strategy for object following is introduced where the camera gimbal movement is coupled with the multirotor motion during the multirotor following. Results confirm that our present framework can be used to deploy a vision-based task in real flight using synthetic data. It was extensively validated in both simulated and real-flight scenarios, providing proper results (following a multirotor up to 1.3 m/s in simulation and 0.3 m/s in real flights).


Sign in / Sign up

Export Citation Format

Share Document