scholarly journals A linear threshold model for optimal stopping behavior

2020 ◽  
Vol 117 (23) ◽  
pp. 12750-12755
Author(s):  
Christiane Baumann ◽  
Henrik Singmann ◽  
Samuel J. Gershman ◽  
Bettina von Helversen

In many real-life decisions, options are distributed in space and time, making it necessary to search sequentially through them, often without a chance to return to a rejected option. The optimal strategy in these tasks is to choose the first option that is above a threshold that depends on the current position in the sequence. The implicit decision-making strategies by humans vary but largely diverge from this optimal strategy. The reasons for this divergence remain unknown. We present a model of human stopping decisions in sequential decision-making tasks based on a linear threshold heuristic. The first two studies demonstrate that the linear threshold model accounts better for sequential decision making than existing models. Moreover, we show that the model accurately predicts participants’ search behavior in different environments. In the third study, we confirm that the model generalizes to a real-world problem, thus providing an important step toward understanding human sequential decision making.

2019 ◽  
Author(s):  
Chrisitiane Baumann ◽  
Samuel J. Gershman ◽  
Henrik Singmann ◽  
Bettina von Helversen

In many real life decisions, options are distributed in space and time, making itnecessary to sequentially search through them, often without a chance to return to arejected option. The optimal strategy in these tasks is to choose the first option that isabove a threshold that depends on the current position in the sequence. The implicitdecision making strategies by humans vary but largely diverge from this optimalstrategy; the reasons for this divergence remain unknown. We present a new model ofhuman stopping decisions in sequential decision making tasks based on a linearthreshold heuristic. We show that the new model outperforms existing models forsequential decision making. Moreover, it accurately predicts participants’ search length,and how they adapt it to different environments. It thus provides an important steptowards understanding human sequential decision making.


2020 ◽  
Author(s):  
Chrisitiane Baumann ◽  
Henrik Singmann ◽  
Samuel J. Gershman ◽  
Bettina von Helversen

In many real life decisions, options are distributed in space and time, making itnecessary to search sequentially through them, often without a chance to return to arejected option. The optimal strategy in these tasks is to choose the first option that isabove a threshold that depends on the current position in the sequence. The implicitdecision making strategies by humans vary but largely diverge from this optimalstrategy. The reasons for this divergence remain unknown. We present a new model ofhuman stopping decisions in sequential decision making tasks based on a linearthreshold heuristic. The first two studies demonstrate that the linear threshold modelaccounts better for sequential decision making than existing models. Moreover, we showthat the model accurately predicts participants’ search behavior in differentenvironments. In the third study, we confirm that the model generalizes to a real-worldproblem, thus providing an important step towards understanding human sequentialdecision making.


Author(s):  
Ming-Sheng Ying ◽  
Yuan Feng ◽  
Sheng-Gang Ying

AbstractMarkov decision process (MDP) offers a general framework for modelling sequential decision making where outcomes are random. In particular, it serves as a mathematical framework for reinforcement learning. This paper introduces an extension of MDP, namely quantum MDP (qMDP), that can serve as a mathematical model of decision making about quantum systems. We develop dynamic programming algorithms for policy evaluation and finding optimal policies for qMDPs in the case of finite-horizon. The results obtained in this paper provide some useful mathematical tools for reinforcement learning techniques applied to the quantum world.


Sign in / Sign up

Export Citation Format

Share Document