Stochastic differential dynamic programming for multi-reservoir system control

1998 ◽  
Vol 12 (4) ◽  
pp. 247-266 ◽  
Author(s):  
F. A. El-Awar ◽  
J. W. Labadie ◽  
T. B. M. J. Ouarda
Keyword(s):  
Dynamic Programming ◽  
System Control ◽  
Differential Dynamic Programming ◽  
Reservoir System

Control Design for Automated Vehicle Emergency Safe Stop System Based on Differential Dynamic Programming

2020 ◽  
Author(s):  
Lisheng Yang ◽  
Tomonari Furukawa ◽  
Lei Zuo ◽  
Zachary Doerzaph
Keyword(s):  
Dynamic Programming ◽  
Real Time ◽  
Control Algorithm ◽  
Computation Time ◽  
Grid Cell ◽  
System Control ◽  
Real Time Control ◽  
Differential Dynamic Programming ◽  
Time Control ◽  
Emergency Stop

Abstract This paper presents the control algorithm and system design for a newly proposed automated emergency stop system, which aims to navigate the vehicle out of its travel lane to a safe road-side location when an emergency (e.g. driver fails to take control during fallback of the Dynamic Driving Task) occurs. To address the unique requirements of such a system, control techniques based on differential dynamic programming are developed. Optimal control sequence computation is broken down into step-by-step quadratic optimization and solved iteratively. Control constraints are addressed efficiently by a tailored Projected-Newton algorithm. The iterative control algorithm is then integrated into a real-time control system which considers both computation delay and modeling errors. The system employs a novel grid-based storage structure for recording all acceptable control commands computed within the iteration and uses a high frequency estimator for self-localization. During operation, the real-time control thread will extract commands from the grid cell corresponding to current states. Simulation results show strong potential of the proposed system for addressing the engineering challenges of the automated emergency stop function. The robustness of the system in presence of computation time delay and modelling errors is also demonstrated.

scholarly journals An optimal algorithm for cascaded reservoir operation by combining the grey forecasting model with DDDP

2017 ◽  
Vol 18 (1) ◽  
pp. 142-150 ◽  
Author(s):  
Yong Peng ◽  
Xiaoli Zhang ◽  
Wei Xu ◽  
Yajun Shi ◽  
Zixin Zhang
Keyword(s):  
Power Generation ◽  
Dynamic Programming ◽  
Reservoir Operation ◽  
Optimal Algorithm ◽  
Computing Time ◽  
Forecasting Model ◽  
Differential Dynamic Programming ◽  
Reservoir System ◽  
Grey Forecasting ◽  
Grey Forecasting Model

Abstract The operation of cascaded reservoirs is a complex problem, and lots of algorithms have been developed for optimal cascaded reservoir operation. However, the existing algorithms usually have disadvantages such as the ‘curse of dimensionality’ and prematurity. This study proposes a grey discrete differential dynamic programming (GDDDP) algorithm for effectively optimizing the cascaded reservoir operation model, which is a combination of the grey forecasting model and discrete differential dynamic programming (DDDP). Additionally, a modification of the grey forecasting model is presented for better forecast accuracy. The proposed method is applied to optimize the Baishan-Fengman cascaded reservoir system in the northeast of China. The results show that GDDDP obtains more power generation than DDDP with less computing time in three cases, i.e., dry years, wet years and the whole series. Especially in the case of the whole series, the power generation of GDDDP is 2.13 MWH more than that of DDDP, while the computing time is decreased by 66,161 ms. Moreover, the power generation of GDDDP is comparable with that of dynamic programming but the computing time is much less. All these indicate GDDDP has high accuracy and efficiency, which implies that it is practicable for the operation of a cascaded reservoir system.

scholarly journals Computational Guidance Using Sparse Gauss-Hermite Quadrature Differential Dynamic Programming

2019 ◽  
Vol 52 (12) ◽  
pp. 13-18 ◽  
Author(s):  
Shaoming He ◽  
Hyo-Sang Shin ◽  
Antonios Tsourdos
Keyword(s):  
Dynamic Programming ◽  
Differential Dynamic Programming ◽  
Gauss Hermite Quadrature
Sign in / Sign up

Export Citation Format

Share Document