scholarly journals Optimization under the PMλ,τ policy of a finite dam with both continuous and jumpwise inputs

2005 ◽  
Vol 42 (2) ◽  
pp. 587-594
Author(s):  
Kyung Eun Lim ◽  
Jee Seon Baek ◽  
Eui Yong Lee
Keyword(s):  
Poisson Process ◽  
Wiener Process ◽  
Release Rate ◽  
Average Cost ◽  
Long Run ◽  
Random Jumps ◽  
Finite Dam

We consider a finite dam under the policy, where the input of water is formed by a Wiener process subject to random jumps arriving according to a Poisson process. The long-run average cost per unit time is obtained after assigning costs to the changes of release rate, a reward to each unit of output, and a penalty that is a function of the level of water in the reservoir.

scholarly journals Optimization under the P M λ,τ policy of a finite dam with both continuous and jumpwise inputs

2005 ◽  
Vol 42 (02) ◽  
pp. 587-594
Author(s):  
Kyung Eun Lim ◽  
Jee Seon Baek ◽  
Eui Yong Lee
Keyword(s):  
Poisson Process ◽  
Wiener Process ◽  
Release Rate ◽  
Average Cost ◽  
Long Run ◽  
Random Jumps ◽  
Finite Dam

We consider a finite dam under the policy, where the input of water is formed by a Wiener process subject to random jumps arriving according to a Poisson process. The long-run average cost per unit time is obtained after assigning costs to the changes of release rate, a reward to each unit of output, and a penalty that is a function of the level of water in the reservoir.

Optimal control of a finite dam: average-cost case

1985 ◽  
Vol 22 (02) ◽  
pp. 480-484 ◽  
Author(s):  
Lam Yeh
Keyword(s):  
Optimal Control ◽  
Wiener Process ◽  
Release Rate ◽  
Optimal Policy ◽  
Average Cost ◽  
Output Rate ◽  
Penalty Cost ◽  
Long Run ◽  
Negative Drift ◽  
Finite Dam

We consider the problem of minimizing the long-run average cost per unit time of operating a finite dam in the class of the policies of the following type. Assume that the dam is initially empty, the release rate is kept at 0 until the dam storage increases to λ, and as soon as this occurs, water is released at rate M, then the output rate is kept at M as long as the dam storage is more than τ and it must be decreased to 0 if the dam storage becomes τ. We assume that the input of water into the finite dam is a Wiener process with non-negative drift μ and variance parameter σ 2. There is a cost in increasing the output rate from 0 to M as well as in decreasing the rate from M to 0 and whenever the dam storage is below level a, there is a penalty cost per unit time depending on the level. A reward is given for each unit of water released. In this paper, the long-run average cost per unit time is determined, and therefore the optimal policy can be found numerically.

Average cost under the P M λ, τ policy in a finite dam with compound Poisson inputs

2003 ◽  
Vol 40 (02) ◽  
pp. 519-526
Author(s):  
Jongho Bae ◽  
Sunggon Kim ◽  
Eui Yong Lee
Keyword(s):  
Poisson Process ◽  
Release Rate ◽  
Average Cost ◽  
Compound Poisson Process ◽  
Water Release ◽  
Compound Poisson ◽  
Long Run ◽  
Finite Dam

We consider the policy in a finite dam in which the input of water is formed by a compound Poisson process and the rate of water release is changed instantaneously from a to M and from M to a (M > a) at the moments when the level of water exceeds λ and downcrosses τ (λ > τ) respectively. After assigning costs to the changes of release rate, a reward to each unit of output, and a cost related to the level of water in the reservoir, we determine the long-run average cost per unit time.

Optimal control of a finite dam: average-cost case

1985 ◽  
Vol 22 (2) ◽  
pp. 480-484 ◽  
Author(s):  
Lam Yeh
Keyword(s):  
Optimal Control ◽  
Wiener Process ◽  
Release Rate ◽  
Optimal Policy ◽  
Average Cost ◽  
Output Rate ◽  
Penalty Cost ◽  
Long Run ◽  
Negative Drift ◽  
Finite Dam

We consider the problem of minimizing the long-run average cost per unit time of operating a finite dam in the class of the policies of the following type. Assume that the dam is initially empty, the release rate is kept at 0 until the dam storage increases to λ, and as soon as this occurs, water is released at rate M, then the output rate is kept at M as long as the dam storage is more than τ and it must be decreased to 0 if the dam storage becomes τ. We assume that the input of water into the finite dam is a Wiener process with non-negative drift μ and variance parameter σ2. There is a cost in increasing the output rate from 0 to M as well as in decreasing the rate from M to 0 and whenever the dam storage is below level a, there is a penalty cost per unit time depending on the level. A reward is given for each unit of water released. In this paper, the long-run average cost per unit time is determined, and therefore the optimal policy can be found numerically.

Average cost under the PMλ, τ policy in a finite dam with compound Poisson inputs

2003 ◽  
Vol 40 (2) ◽  
pp. 519-526 ◽  
Author(s):  
Jongho Bae ◽  
Sunggon Kim ◽  
Eui Yong Lee
Keyword(s):  
Poisson Process ◽  
Release Rate ◽  
Average Cost ◽  
Compound Poisson Process ◽  
Water Release ◽  
Compound Poisson ◽  
Long Run ◽  
Finite Dam

We consider the policy in a finite dam in which the input of water is formed by a compound Poisson process and the rate of water release is changed instantaneously from a to M and from M to a (M > a) at the moments when the level of water exceeds λ and downcrosses τ (λ > τ) respectively. After assigning costs to the changes of release rate, a reward to each unit of output, and a cost related to the level of water in the reservoir, we determine the long-run average cost per unit time.

The control of a finite dam

1982 ◽  
Vol 19 (4) ◽  
pp. 815-825 ◽  
Author(s):  
F. A. Attia ◽  
P. J. Brockwell
Keyword(s):  
Markov Chain ◽  
Wiener Process ◽  
Average Cost ◽  
Type B ◽  
Input Process ◽  
Long Run ◽  
The Cost ◽  
Finite Dam

The long-run average cost per unit time of operating a finite dam controlled by a PlM policy (Faddy (1974), Zuckerman (1977)) is determined when the cumulative input process is (a) a Wiener process with drift and (b) the integral of a Markov chain. It is shown how the cost for (a) can be obtained as the limit of the costs associated with a sequence of input processes of the type (b).

Optimal control of a finite dam using P M λΤ policies and penalty cost: total discounted and long run average cases

1990 ◽  
Vol 27 (04) ◽  
pp. 888-898
Author(s):  
M. Abdel-hameed ◽  
Y. Nakhi
Keyword(s):  
Optimal Control ◽  
Wiener Process ◽  
Average Cost ◽  
Input Process ◽  
Average Case ◽  
Discounted Cost ◽  
Penalty Cost ◽  
Drift Term ◽  
Long Run ◽  
Finite Dam

Zuckermann [10] considers the problem of optimal control of a finite dam using policies, assuming that the input process is Wiener with drift term μ ≧ 0. Lam Yeh and Lou Jiann Hua [7] treat the case where the input is a Wiener process with a reflecting boundary at zero, with drift term μ ≧ 0, using the long-run average cost and total discounted cost criteria. Attia [1] obtains results similar to those of Lam Yeh and Lou Jiann Hua for the long-run average case and extends them to include μ < 0. In this paper we look further into the results of Zuckerman [10], simplify some of the work of Attia [1], [2], offering corrections to some of his formulae and extend the results of Lam Yeh and Lou Jiann Hua [7].

Optimal control of a finite dam: Wiener process input

1987 ◽  
Vol 24 (1) ◽  
pp. 186-199 ◽  
Author(s):  
Lam Yeh ◽  
Lou Jiann Hua
Keyword(s):  
Optimal Control ◽  
Wiener Process ◽  
Optimal Policy ◽  
Average Cost ◽  
Transition Density ◽  
Discounted Cost ◽  
Transition Density Function ◽  
Long Run ◽  
The Resolvent Operator ◽  
Finite Dam

The problem of optimal control of a finite dam in the class of policies has been considered by Lam Yeh [6], [7]. In this paper, by using the first Dynkin formula, the same problems of specifying an optimal policy in the class of the policies to minimize the expected total discounted cost as well as the long-run average cost are considered. Both the expected total discounted cost and long-run average cost are determined explicitly, and then the optimal policy can be found numerically, Also, we obtain the transition density function and the resolvent operator of a reflecting Wiener process.

Optimal control of a finite dam using PMλΤ policies and penalty cost: total discounted and long run average cases

1990 ◽  
Vol 27 (4) ◽  
pp. 888-898 ◽  
Author(s):  
M. Abdel-hameed ◽  
Y. Nakhi
Keyword(s):  
Optimal Control ◽  
Wiener Process ◽  
Average Cost ◽  
Input Process ◽  
Average Case ◽  
Discounted Cost ◽  
Penalty Cost ◽  
Drift Term ◽  
Long Run ◽  
Finite Dam

Zuckermann [10] considers the problem of optimal control of a finite dam using policies, assuming that the input process is Wiener with drift term μ ≧ 0. Lam Yeh and Lou Jiann Hua [7] treat the case where the input is a Wiener process with a reflecting boundary at zero, with drift term μ ≧ 0, using the long-run average cost and total discounted cost criteria. Attia [1] obtains results similar to those of Lam Yeh and Lou Jiann Hua for the long-run average case and extends them to include μ < 0. In this paper we look further into the results of Zuckerman [10], simplify some of the work of Attia [1], [2], offering corrections to some of his formulae and extend the results of Lam Yeh and Lou Jiann Hua [7].

The control of a finite dam

1982 ◽  
Vol 19 (04) ◽  
pp. 815-825 ◽  
Author(s):  
F. A. Attia ◽  
P. J. Brockwell
Keyword(s):  
Markov Chain ◽  
Wiener Process ◽  
Average Cost ◽  
Type B ◽  
Input Process ◽  
Long Run ◽  
The Cost ◽  
Finite Dam

The long-run average cost per unit time of operating a finite dam controlled by a Pl M policy (Faddy (1974), Zuckerman (1977)) is determined when the cumulative input process is (a) a Wiener process with drift and (b) the integral of a Markov chain. It is shown how the cost for (a) can be obtained as the limit of the costs associated with a sequence of input processes of the type (b).

Sign in / Sign up

Export Citation Format

Share Document