On-Line Reinforcement Learning Using Cascade Constructive Neural Networks

2005 ◽  
pp. 562-568 ◽  
Author(s):  
Peter Vamplew ◽  
Robert Ollington
Keyword(s):  
Neural Networks ◽  
Reinforcement Learning ◽  
Constructive Neural Networks ◽  
On Line

scholarly journals On-line prediction of the feeding phase in high-cell density cultivation of rE. coli using constructive neural networks

2013 ◽  
Vol 111 (1) ◽  
pp. 228-248 ◽  
Author(s):  
M.C. Nicoletti ◽  
J.R. Bertini ◽  
M.M. Tanizaki ◽  
T.C. Zangirolami ◽  
V.M. Gonçalves ◽  
...  
Keyword(s):  
Neural Networks ◽  
Cell Density ◽  
High Cell Density ◽  
High Cell ◽  
High Cell Density Cultivation ◽  
Constructive Neural Networks ◽  
On Line

Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning

2021 ◽  
Vol 2 (1) ◽  
pp. 1-25
Author(s):  
Yongsen Ma ◽  
Sheheryar Arshad ◽  
Swetha Muniraju ◽  
Eric Torkildson ◽  
Enrico Rantala ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Reinforcement Learning ◽  
Activity Recognition ◽  
Deep Neural Networks ◽  
State Machine ◽  
Recognition Algorithm ◽  
The State ◽  
Neural Architecture ◽  
Learning Agent

In recent years, Channel State Information (CSI) measured by WiFi is widely used for human activity recognition. In this article, we propose a deep learning design for location- and person-independent activity recognition with WiFi. The proposed design consists of three Deep Neural Networks (DNNs): a 2D Convolutional Neural Network (CNN) as the recognition algorithm, a 1D CNN as the state machine, and a reinforcement learning agent for neural architecture search. The recognition algorithm learns location- and person-independent features from different perspectives of CSI data. The state machine learns temporal dependency information from history classification results. The reinforcement learning agent optimizes the neural architecture of the recognition algorithm using a Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM). The proposed design is evaluated in a lab environment with different WiFi device locations, antenna orientations, sitting/standing/walking locations/orientations, and multiple persons. The proposed design has 97% average accuracy when testing devices and persons are not seen during training. The proposed design is also evaluated by two public datasets with accuracy of 80% and 83%. The proposed design needs very little human efforts for ground truth labeling, feature engineering, signal processing, and tuning of learning parameters and hyperparameters.

scholarly journals Task-space regulation of rigid-link electrically-driven robots with uncertain kinematics using neural networks

2021 ◽  
Vol 54 (1-2) ◽  
pp. 102-115
Author(s):  
Wenhui Si ◽  
Lingyan Zhao ◽  
Jianping Wei ◽  
Zhiguang Guan
Keyword(s):  
Neural Networks ◽  
Asymptotic Stability ◽  
Control Method ◽  
Joint Space ◽  
Robot Kinematics ◽  
Rbf Neural Networks ◽  
Task Space ◽  
Actuator Dynamics ◽  
Rigid Link ◽  
On Line

Extensive research efforts have been made to address the motion control of rigid-link electrically-driven (RLED) robots in literature. However, most existing results were designed in joint space and need to be converted to task space as more and more control tasks are defined in their operational space. In this work, the direct task-space regulation of RLED robots with uncertain kinematics is studied by using neural networks (NN) technique. Radial basis function (RBF) neural networks are used to estimate complicated and calibration heavy robot kinematics and dynamics. The NN weights are updated on-line through two adaptation laws without the necessity of off-line training. Compared with most existing NN-based robot control results, the novelty of the proposed method lies in that asymptotic stability of the overall system can be achieved instead of just uniformly ultimately bounded (UUB) stability. Moreover, the proposed control method can tolerate not only the actuator dynamics uncertainty but also the uncertainty in robot kinematics by adopting an adaptive Jacobian matrix. The asymptotic stability of the overall system is proven rigorously through Lyapunov analysis. Numerical studies have been carried out to verify efficiency of the proposed method.

Sign in / Sign up

Export Citation Format

Share Document