scholarly journals Exact solution of the Bellman equation for a β-discounted reward in a two-armed bandit with switching arms

1999 ◽  
Vol 12 (2) ◽  
pp. 151-160 ◽  
Author(s):  
Doncho S. Donchev
Keyword(s):  
Exact Solution ◽  
Bellman Equation ◽  
Bandit Problem ◽  
Myopic Policy

We consider the symmetric Poissonian two-armed bandit problem. For the case of switching arms, only one of which creates reward, we solve explicitly the Bellman equation for a β-discounted reward and prove that a myopic policy is optimal.

scholarly journals On the Hamilton-Jacobi-Bellman Equation by the Homotopy Perturbation Method

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Abdon Atangana ◽  
Aden Ahmed ◽  
Suares Clovis Oukouomi Noutchie
Keyword(s):  
Exact Solution ◽  
Perturbation Method ◽  
Decomposition Method ◽  
Bellman Equation ◽  
Homotopy Perturbation Method ◽  
Homotopy Perturbation ◽  
Homotopy Decomposition ◽  
Hamilton Jacobi Bellman Equation ◽  
Hamilton Jacobi Bellman

Our concern in this paper is to use the homotopy decomposition method to solve the Hamilton-Jacobi-Bellman equation (HJB). The approach is obviously extremely well organized and is an influential procedure in obtaining the solutions of the equations. We portrayed particular compensations that this technique has over the prevailing approaches. We presented that the complexity of the homotopy decomposition method is of orderO(n). Furthermore, three explanatory examples established good outcomes and comparisons with exact solution.

Some results for the two armed bandit problem

Optimization ◽  
1976 ◽  
Vol 7 (3) ◽  
pp. 471-475 ◽  
Author(s):  
P.W. Jones
Keyword(s):  
Bandit Problem

Exploration by Pigeons on an N-Armed Bandit Problem

2007 ◽  
Author(s):  
Dennis Garlick ◽  
Aaron P. Blaisdell
Keyword(s):  
Bandit Problem

Exact solution of a four-site crystal model for an intermediate-valence system

1986 ◽  
Vol 47 (6) ◽  
pp. 1029-1034 ◽  
Author(s):  
J.C. Parlebas ◽  
R.H. Victora ◽  
L.M. Falicov
Keyword(s):  
Exact Solution ◽  
Intermediate Valence ◽  
Crystal Model
Sign in / Sign up

Export Citation Format

Share Document