scholarly journals A two-layer model to dispatch electric vehicles and wind power

2020 ◽  
Vol 309 ◽  
pp. 05015
Author(s):  
Song Gao ◽  
Linyu Wang ◽  
Lei Guo ◽  
Zhifeng Qiu ◽  
Yueshuang Bao
Keyword(s):  
Real Time ◽  
Wind Power ◽  
Markov Decision Process ◽  
Power Output ◽  
Decision Process ◽  
Distribution Network ◽  
The Real ◽  
Markov Decision ◽  
The Impact ◽  
Ev Charging

In this paper, the optimal charging and discharging schedules of electric vehicle (EV) are studied considering wind power under the condition of distribution network. In view of the uncertainty of EV charging-discharging demand and wind power output, the Markov decision process is adopted to model the randomness of supply and demand. Considering the dimensional disaster caused by dispatching a large number of EVs’ charging and discharging behavior in a centralized way, this paper proposes the two-layer dispatching model based on Markov decision process. First, the lower EV agents are responsible for collecting the real-time charging-discharging demands for EV and report to the upper dispatching center. Then the upper dispatching center gives the optimal charging and discharging power according to the real-time distribution operating status, wind power output and the EV information reported by each EV agent. Last, the lower agent gives the optimal charging-discharging sequence of each EV according to the upper optimal power. The goal of the upper dispatching center considers the power losses in the distribution network, load variance and the matching degree between EV charging-discharging and wind power output. The goal of the lower EV agent considers the EV charging-discharging fees and costs by EV battery losses. When deciding the optimal charging strategy, we design the two-layer Rollout algorithm to decide the optimal charging-discharging strategy considering the impact on future strategy decisions by current strategy decisions. Finally, the optimal results under four different strategies are simulated on the IEEE 30-bus distribution network system. The simulation results show that the proposed model and strategy can effectively reduce the distribution network losses and load variance, and greatly improve the utilization rate of wind power. Compared to the cost of uncoordinated EV charging, EV charging-discharging fees and battery loss costs by the proposed strategy have been greatly reduced.

scholarly journals Information geometry-based action decision-making for target tracking by fixed-wing unmanned aerial vehicle

2018 ◽  
Vol 15 (4) ◽  
pp. 172988141878706 ◽  
Author(s):  
Yunyun Zhao ◽  
Xiangke Wang ◽  
Yirui Cong ◽  
Lincheng Shen
Keyword(s):  
Target Tracking ◽  
Real Time ◽  
Unmanned Aerial Vehicle ◽  
Markov Decision Process ◽  
Decision Process ◽  
Information Geometry ◽  
Markov Decision ◽  
Aerial Vehicle ◽  
Partially Observable Markov ◽  
Partially Observable

In this article, we study the ground moving target tracking problem for a fixed-wing unmanned aerial vehicle equipped with a radar. This problem is formulated in a partially observable Markov process framework, which contains the following two parts: in the first part, the unmanned aerial vehicle utilizes the measurements from its radar and employs a Kalman filter to estimate the target’s real-time location; in the second part, the unmanned aerial vehicle optimizes its trajectory in a real-time manner so that the radar’s measurements can include more useful information. To solve the trajectory optimization problem, we proposed an information geometry-based partially observable Markov decision process method. Specifically, the cumulative amount of information in the observation is represented by Fisher information of information geometry, and acts as the criterion of the partially observable Markov decision process problem. Furthermore, to guarantee the real-time performance, an important trade-off between the optimality and computation cost is made by an approximate receding horizon approach. Finally, simulation results corroborate the accuracy and time-efficiency of our proposed method and also show our advantage in computation time compared to existing methods.

scholarly journals Multi-Vehicle Tracking via Real-Time Detection Probes and a Markov Decision Process Policy

Sensors ◽  
2019 ◽  
Vol 19 (6) ◽  
pp. 1309 ◽  
Author(s):  
Yi Zou ◽  
Weiwei Zhang ◽  
Wendi Weng ◽  
Zhengyun Meng
Keyword(s):  
Real Time ◽  
Markov Decision Process ◽  
Decision Process ◽  
Autonomous Driving ◽  
Driver Assistance Systems ◽  
Moving Vehicle ◽  
Markov Decision ◽  
Multiple Vehicles ◽  
Significant Performance ◽  
Time Critical

Online multi-object tracking (MOT) has broad applications in time-critical video analysis scenarios such as advanced driver-assistance systems (ADASs) and autonomous driving. In this paper, the proposed system aims at tracking multiple vehicles in the front view of an onboard monocular camera. The vehicle detection probes are customized to generate high precision detection, which plays a basic role in the following tracking-by-detection method. A novel Siamese network with a spatial pyramid pooling (SPP) layer is applied to calculate pairwise appearance similarity. The motion model captured from the refined bounding box provides the relative movements and aspects. The online-learned policy treats each tracking period as a Markov decision process (MDP) to maintain long-term, robust tracking. The proposed method is validated in a moving vehicle with an onboard NVIDIA Jetson TX2 and returns real-time speeds. Compared with other methods on KITTI and self-collected datasets, our method achieves significant performance in terms of the “Mostly-tracked”, “Fragmentation”, and “ID switch” variables.

scholarly journals Multi-Time Scale Rolling Economic Dispatch for Wind/Storage Power System Based on Forecast Error Feature Extraction

Energies ◽  
2018 ◽  
Vol 11 (8) ◽  
pp. 2124 ◽  
Author(s):  
Li Han ◽  
Rongchang Zhang ◽  
Xuesong Wang ◽  
Yu Dong
Keyword(s):  
Power System ◽  
Real Time ◽  
Wind Power ◽  
Power Unit ◽  
Time Scale ◽  
Forecast Error ◽  
Thermal Power ◽  
Time Error ◽  
The Real ◽  
The Impact

This paper looks at the ability to cope with the uncertainty of wind power and reduce the impact of wind power forecast error (WPFE) on the operation and dispatch of power system. Therefore, several factors which are related to WPFE will be studied. By statistical analysis of the historical data, an indicator of real-time error based on these factors is obtained to estimate WPFE. Based on the real-time estimation of WPFE, a multi-time scale rolling dispatch model for wind/storage power system is established. In the real-time error compensation section of this model, the previous dispatch plan of thermal power unit is revised according to the estimation of WPFE. As the regulating capacity of thermal power unit within a short time period is limited, the estimation of WPFE is further compensated by using battery energy storage system. This can not only decrease the risk caused by the wind power uncertainty and lessen wind spillage, but also reduce the total cost. Thereby providing a new method to describe and model wind power uncertainty, and providing economic, safe and energy-saving dispatch plan for power system. The analysis in case study verifies the effectiveness of the proposed model.

scholarly journals Service Migration Algorithm Based On Markov Decision Process With Multiple QoS Attributes

2021 ◽  
Author(s):  
Anhua Ma ◽  
Su Pan ◽  
Shuai Tao ◽  
Weiwei Zhou
Keyword(s):  
Time Delay ◽  
Real Time ◽  
Markov Decision Process ◽  
Decision Process ◽  
Mobile Internet ◽  
Migration Decision ◽  
Decision Algorithm ◽  
Transmission Rates ◽  
Markov Decision ◽  
Service Migration

Abstract With the rapid development of mobile internet cloud computing, the traditional network structure becomes non-suitable for advanced network traffic requirements. A service migration decision algorithm is proposed in the Software Defined Network(SDN) to satisfy differential Quality of Service(QoS) requirements. We divide services into real-time ones and non-real-time ones due to their different requirements on time delay and transmission rates, and construct the revenue function on two QoS attributes i.e. time delay and available transmission rates. We use the Markov decision process to maximize the overall benefits of users and network system to achieve the best user experience. The simulation results show that our proposed algorithm achieves better performance in terms of overall benefits than the exiting algorithms only considering single service and single QoS attribute.

A Markov-Based Multi-Attribute Vertical Handoff Decision Algorithm

2013 ◽  
Vol 785-786 ◽  
pp. 1403-1407
Author(s):  
Qing Yang Song ◽  
Xun Li ◽  
Shu Yu Ding ◽  
Zhao Long Ning
Keyword(s):  
Markov Decision Process ◽  
Decision Process ◽  
Decision Problem ◽  
Vertical Handoff ◽  
Decision Algorithm ◽  
Reward Function ◽  
Total Reward ◽  
Call Dropping ◽  
Markov Decision ◽  
The Impact

Many vertical handoff decision algorithms have not considered the impact of call dropping during the vertical handoff decision process. Besides, most of current multi-attribute vertical handoff algorithms cannot predict users’ specific circumstances dynamically. In this paper, we formulate the vertical handoff decision problem as a Markov decision process, with the objective of maximizing the expected total reward during the handoff procedure. A reward function is formulated to assess the service quality during each connection. The G1 and entropy methods are applied in an iterative way, by which we can work out a stationary deterministic policy. Numerical results demonstrate the superiority of our proposed algorithm compared with the existing methods.

Sign in / Sign up

Export Citation Format

Share Document