Optimal stopping rule for the full-information duration problem with random horizon

2016 ◽  
Vol 48 (1) ◽  
pp. 52-68 ◽  
Author(s):  
Mitsushi Tamaki

Abstract The full-information duration problem with a random number N of objects is considered. These objects appear sequentially and their values Xk are observed, where Xk, independent of N, are independent and identically distributed random variables from a known continuous distribution. The objective of the problem is to find a stopping rule that maximizes the duration of holding a relative maximum (e.g. the kth object is a relative maximum if Xk = max{X1, X2, . . ., Xk}). We assume that N is a random variable with a known upper bound n, so two models, Model 1 and Model 2, can be considered according to whether the planning horizon is N or n. The structure of the optimal rule, which depends on the prior distribution assumed on N, is examined. The monotone rule is defined and a necessary and sufficient condition for the optimal rule to be monotone is given for both models. Special attention is paid to the class of priors such that N / n converges, as n → ∞, to a random variable Vm having density fVm(v) = m(1 - v)m-1, 0 ≤ v ≤ 1 for a positive integer m. An interesting feature is that the optimal duration (relative to n) for Model 2 is just (m + 1) times as large as that for Model 1 asymptotically.

2013 ◽  
Vol 45 (04) ◽  
pp. 1028-1048 ◽  
Author(s):  
Mitsushi Tamaki

As a version of the secretary problem, Ferguson, Hardwick and Tamaki (1992) considered an optimal stopping problem called the duration problem. The basic duration problem is the classical duration problem, in which the objective is to maximize the time of possession of a relatively best object when a known number of rankable objects appear in random order. In this paper we generalize this classical problem in two directions by allowing the number N (of available objects) to be a random variable with a known upper bound n and also allowing the objects to appear in accordance with Bernoulli trials. Two models can be considered for our random horizon duration problem according to whether the planning horizon is N or n. Since the form of the optimal rule is in general complicated, our main concern is to give to each model a sufficient condition for the optimal rule to be simple. For N having a uniform, generalized uniform, or curtailed geometric distribution, the optimal rule is shown to be simple in the so-called secretary case. The asymptotic results, as n → ∞, will also be given for these priors.


2013 ◽  
Vol 45 (4) ◽  
pp. 1028-1048
Author(s):  
Mitsushi Tamaki

As a version of the secretary problem, Ferguson, Hardwick and Tamaki (1992) considered an optimal stopping problem called the duration problem. The basic duration problem is the classical duration problem, in which the objective is to maximize the time of possession of a relatively best object when a known number of rankable objects appear in random order. In this paper we generalize this classical problem in two directions by allowing the number N (of available objects) to be a random variable with a known upper bound n and also allowing the objects to appear in accordance with Bernoulli trials. Two models can be considered for our random horizon duration problem according to whether the planning horizon is N or n. Since the form of the optimal rule is in general complicated, our main concern is to give to each model a sufficient condition for the optimal rule to be simple. For N having a uniform, generalized uniform, or curtailed geometric distribution, the optimal rule is shown to be simple in the so-called secretary case. The asymptotic results, as n → ∞, will also be given for these priors.


2019 ◽  
Vol 51 (4) ◽  
pp. 1209-1235
Author(s):  
M. Ferreira ◽  
D. Pinheiro ◽  
S. Pinheiro

AbstractWe consider a two-player zero-sum stochastic differential game with a random planning horizon and diffusive state variable dynamics. The random planning horizon is a function of a non-negative continuous random variable, which is assumed to be independent of the Brownian motion driving the state variable dynamics. We study this game using a combination of dynamic programming and viscosity solution techniques. Under some mild assumptions, we prove that the value of the game exists and is the unique viscosity solution of a certain nonlinear partial differential equation of Hamilton–Jacobi–Bellman–Isaacs type.


1983 ◽  
Vol 20 (1) ◽  
pp. 165-171 ◽  
Author(s):  
Joseph D. Petruccelli

We consider the problem of maximizing the probability of choosing the largest from a sequence of N observations when N is a bounded random variable. The present paper gives a necessary and sufficient condition, based on the distribution of N, for the optimal stopping rule to have a particularly simple form: what Rasmussen and Robbins (1975) call an s(r) rule. A second result indicates that optimal stopping rules for this problem can, with one restriction, take virtually any form.


2010 ◽  
Vol 47 (03) ◽  
pp. 761-777 ◽  
Author(s):  
Mitsushi Tamaki

We consider the optimal stopping problem of maximizing the probability of stopping on any of the last m successes of a sequence of independent Bernoulli trials of length n, where m and n are predetermined integers such that 1 ≤ m < n. The optimal stopping rule of this problem has a nice interpretation, that is, it stops on the first success for which the sum of the m-fold multiplicative odds of success for the future trials is less than or equal to 1. This result can be viewed as a generalization of Bruss' (2000) odds theorem. Application will be made to the secretary problem. For more generality, we extend the problem in several directions in the same manner that Ferguson (2008) used to extend the odds theorem. We apply this extended result to the full-information analogue of the secretary problem, and derive the optimal stopping rule and the probability of win explicitly. The asymptotic results, as n tends to ∞, are also obtained via the planar Poisson process approach.


2009 ◽  
Vol 46 (04) ◽  
pp. 1086-1099 ◽  
Author(s):  
Mitsushi Tamaki

The problem we consider here is a full-information best-choice problem in which n applicants appear sequentially, but each applicant refuses an offer independently of other applicants with known fixed probability 0≤q<1. The objective is to maximize the probability of choosing the best available applicant. Two models are distinguished according to when the availability can be ascertained; the availability is ascertained just after the arrival of the applicant (Model 1), whereas the availability can be ascertained only when an offer is made (Model 2). For Model 1, we can obtain the explicit expressions for the optimal stopping rule and the optimal probability for a given n. A remarkable feature of this model is that, asymptotically (i.e. n→∞), the optimal probability becomes insensitive to q and approaches 0.580 164. The planar Poisson process (PPP) model provides more insight into this phenomenon. For Model 2, the optimal stopping rule depends on the past history in a complicated way and seems to be intractable. We have not solved this model for a finite n but derive, via the PPP approach, a lower bound on the asymptotically optimal probability.


2010 ◽  
Vol 47 (3) ◽  
pp. 761-777 ◽  
Author(s):  
Mitsushi Tamaki

We consider the optimal stopping problem of maximizing the probability of stopping on any of the last m successes of a sequence of independent Bernoulli trials of length n, where m and n are predetermined integers such that 1 ≤ m < n. The optimal stopping rule of this problem has a nice interpretation, that is, it stops on the first success for which the sum of the m-fold multiplicative odds of success for the future trials is less than or equal to 1. This result can be viewed as a generalization of Bruss' (2000) odds theorem. Application will be made to the secretary problem. For more generality, we extend the problem in several directions in the same manner that Ferguson (2008) used to extend the odds theorem. We apply this extended result to the full-information analogue of the secretary problem, and derive the optimal stopping rule and the probability of win explicitly. The asymptotic results, as n tends to ∞, are also obtained via the planar Poisson process approach.


1983 ◽  
Vol 20 (01) ◽  
pp. 165-171 ◽  
Author(s):  
Joseph D. Petruccelli

We consider the problem of maximizing the probability of choosing the largest from a sequence of N observations when N is a bounded random variable. The present paper gives a necessary and sufficient condition, based on the distribution of N, for the optimal stopping rule to have a particularly simple form: what Rasmussen and Robbins (1975) call an s(r) rule. A second result indicates that optimal stopping rules for this problem can, with one restriction, take virtually any form.


2009 ◽  
Vol 46 (4) ◽  
pp. 1086-1099 ◽  
Author(s):  
Mitsushi Tamaki

The problem we consider here is a full-information best-choice problem in which n applicants appear sequentially, but each applicant refuses an offer independently of other applicants with known fixed probability 0≤q<1. The objective is to maximize the probability of choosing the best available applicant. Two models are distinguished according to when the availability can be ascertained; the availability is ascertained just after the arrival of the applicant (Model 1), whereas the availability can be ascertained only when an offer is made (Model 2). For Model 1, we can obtain the explicit expressions for the optimal stopping rule and the optimal probability for a given n. A remarkable feature of this model is that, asymptotically (i.e. n→∞), the optimal probability becomes insensitive to q and approaches 0.580 164. The planar Poisson process (PPP) model provides more insight into this phenomenon. For Model 2, the optimal stopping rule depends on the past history in a complicated way and seems to be intractable. We have not solved this model for a finite n but derive, via the PPP approach, a lower bound on the asymptotically optimal probability.


Author(s):  
Carsten Wiuf ◽  
Michael P.H Stumpf

In this paper, we discuss statistical families with the property that if the distribution of a random variable X is in , then so is the distribution of Z ∼Bi( X ,  p ) for 0≤ p ≤1. (Here we take Z ∼Bi( X ,  p ) to mean that given X = x ,  Z is a draw from the binomial distribution Bi( x ,  p ).) It is said that the family is closed under binomial subsampling. We characterize such families in terms of probability generating functions and for families with finite moments of all orders we give a necessary and sufficient condition for the family to be closed under binomial subsampling. The results are illustrated with power series and other examples, and related to examples from mathematical biology. Finally, some issues concerning inference are discussed.


Sign in / Sign up

Export Citation Format

Share Document