To swing up an inverted Pendulum using stochastic real-valued Reinforcement Learning

ICANN ’94 ◽  
1994 ◽  
pp. 655-658
Author(s):  
A. Standfuss ◽  
R. Eckmiller
Author(s):  
Gokhan Demirkiran ◽  
Ozcan Erdener ◽  
Onay Akpinar ◽  
Pelin Demirtas ◽  
M. Yagiz Arik ◽  
...  

2021 ◽  
Vol 54 (3-4) ◽  
pp. 417-428
Author(s):  
Yanyan Dai ◽  
KiDong Lee ◽  
SukGyu Lee

For real applications, rotary inverted pendulum systems have been known as the basic model in nonlinear control systems. If researchers have no deep understanding of control, it is difficult to control a rotary inverted pendulum platform using classic control engineering models, as shown in section 2.1. Therefore, without classic control theory, this paper controls the platform by training and testing reinforcement learning algorithm. Many recent achievements in reinforcement learning (RL) have become possible, but there is a lack of research to quickly test high-frequency RL algorithms using real hardware environment. In this paper, we propose a real-time Hardware-in-the-loop (HIL) control system to train and test the deep reinforcement learning algorithm from simulation to real hardware implementation. The Double Deep Q-Network (DDQN) with prioritized experience replay reinforcement learning algorithm, without a deep understanding of classical control engineering, is used to implement the agent. For the real experiment, to swing up the rotary inverted pendulum and make the pendulum smoothly move, we define 21 actions to swing up and balance the pendulum. Comparing Deep Q-Network (DQN), the DDQN with prioritized experience replay algorithm removes the overestimate of Q value and decreases the training time. Finally, this paper shows the experiment results with comparisons of classic control theory and different reinforcement learning algorithms.


2019 ◽  
Vol 17 (02) ◽  
pp. 323-329 ◽  
Author(s):  
Guillermo Puriel Gil ◽  
Wen Yu ◽  
Humberto Sossa

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 36682-36690 ◽  
Author(s):  
Ju-Bong Kim ◽  
Hyun-Kyo Lim ◽  
Chan-Myung Kim ◽  
Min-Suk Kim ◽  
Yong-Geun Hong ◽  
...  

Author(s):  
Atikah Surriani ◽  
Oyas Wahyunggoro ◽  
Adha Imam Cahyadi

Sign in / Sign up

Export Citation Format

Share Document