scholarly journals An Inequality for Variances of the Discounted Rewards

2009 ◽  
Vol 46 (4) ◽  
pp. 1209-1212 ◽  
Author(s):  
Eugene A. Feinberg ◽  
Jun Fei

We consider the following two definitions of discounting: (i) multiplicative coefficient in front of the rewards, and (ii) probability that the process has not been stopped if the stopping time has an exponential distribution independent of the process. It is well known that the expected total discounted rewards corresponding to these definitions are the same. In this note we show that, the variance of the total discounted rewards is smaller for the first definition than for the second definition.

2009 ◽  
Vol 46 (04) ◽  
pp. 1209-1212 ◽  
Author(s):  
Eugene A. Feinberg ◽  
Jun Fei

We consider the following two definitions of discounting: (i) multiplicative coefficient in front of the rewards, and (ii) probability that the process has not been stopped if the stopping time has an exponential distribution independent of the process. It is well known that the expected total discounted rewards corresponding to these definitions are the same. In this note we show that, the variance of the total discounted rewards is smaller for the first definition than for the second definition.


1995 ◽  
Vol 18 (2) ◽  
pp. 383-390
Author(s):  
Z. Govindarajulu

Sequential fixed-width confidence intervals are obtained for the scale parameterσwhen the location parameterθof the negative exponential distribution is unknown. Exact expressions for the stopping time and the confidence coefficient associated with the sequential fixed-width interval are derived. Also derived is the exact expression for the stopping time of sequential point estimation with quadratic loss and linear cost. These are numerically evaluated for certain nominal confidence coefficients, widths of the interval and cost functions, and are compared with the second order asymptotic expressions.


2014 ◽  
Vol 2014 ◽  
pp. 1-7
Author(s):  
Grine Azedine

We consider a sequence(Xi,Yi)1⩽i⩽nof independent and identically distributed random variables with joint cumulative distribution H(x,y), which has exponential marginalsF(x)andG(y)with parameterλ=1. We also assume thatXi(ω)≠Yi(ω),∀i∈N, andω∈Ω. We denoteRk(j)k⩾1andSk(j)k⩾1by the sequences of thejth records in the sequences(Xi)1⩽i⩽n,(Yi)1⩽i⩽n, respectively. The main result of of the paper is to prove the asymptotic independence ofRk(j)k⩾1andSk(j)k⩾1using the property of stopping time of thejth record times and that of the exponential distribution.


2011 ◽  
Vol 48 (01) ◽  
pp. 293-294
Author(s):  
Rhonda Righter

It is well know that the expected exponentially discounted total reward for a stochastic process can also be defined as the expected total undiscounted reward earned before an independent exponential stopping time (let us call this the stopped reward). Feinberg and Fei (2009) recently showed that the variance of the discounted reward is smaller than the variance of the stopped reward. We strengthen this result to show that the discounted reward is smaller than the stopped reward in the convex ordering sense.


2011 ◽  
Vol 48 (1) ◽  
pp. 293-294 ◽  
Author(s):  
Rhonda Righter

It is well know that the expected exponentially discounted total reward for a stochastic process can also be defined as the expected total undiscounted reward earned before an independent exponential stopping time (let us call this the stopped reward). Feinberg and Fei (2009) recently showed that the variance of the discounted reward is smaller than the variance of the stopped reward. We strengthen this result to show that the discounted reward is smaller than the stopped reward in the convex ordering sense.


1986 ◽  
Vol 23 (04) ◽  
pp. 1019-1024
Author(s):  
Walter Van Assche

The limit of a product of independent 2 × 2 stochastic matrices is given when the entries of the first column are independent and have the same symmetric beta distribution. The rate of convergence is considered by introducing a stopping time for which asymptotics are given.


2002 ◽  
Vol 7 (1) ◽  
pp. 55-60 ◽  
Author(s):  
Antanas Karoblis

The exponential distribution and the Erlang distribution function are been used in numerous areas of mathematics, and specifically in the queueing theory. Such and similar applications emphasize the importance of estimation of error of approximation by the Erlang distribution function. The article gives an analysis and technique of error’s estimation of an accuracy of such approximation, especially in some specific cases.


Author(s):  
Hazim Mansour Gorgees ◽  
Bushra Abdualrasool Ali ◽  
Raghad Ibrahim Kathum

     In this paper, the maximum likelihood estimator and the Bayes estimator of the reliability function for negative exponential distribution has been derived, then a Monte –Carlo simulation technique was employed to compare the performance of such estimators. The integral mean square error (IMSE) was used as a criterion for this comparison. The simulation results displayed that the Bayes estimator performed better than the maximum likelihood estimator for different samples sizes.


Author(s):  
Parisa Torkaman

The generalized inverted exponential distribution is introduced as a lifetime model with good statistical properties. This paper, the estimation of the probability density function and the cumulative distribution function of with five different estimation methods: uniformly minimum variance unbiased(UMVU), maximum likelihood(ML), least squares(LS), weighted least squares (WLS) and percentile(PC) estimators are considered. The performance of these estimation procedures, based on the mean squared error (MSE) by numerical simulations are compared. Simulation studies express that the UMVU estimator performs better than others and when the sample size is large enough the ML and UMVU estimators are almost equivalent and efficient than LS, WLS and PC. Finally, the result using a real data set are analyzed.


2020 ◽  
Vol 81 (7) ◽  
pp. 1192-1210
Author(s):  
O.V. Zverev ◽  
V.M. Khametov ◽  
E.A. Shelemekh

Sign in / Sign up

Export Citation Format

Share Document