scholarly journals Compositional Control Synthesis for Partially Observable Systems

2009 ◽  
pp. 431-447 ◽  
Author(s):  
Wouter Kuijper ◽  
Jaco van de Pol
Keyword(s):  
Control Synthesis ◽  
Partially Observable Systems ◽  
Partially Observable ◽  
Compositional Control

A hybrid method for harmonic state estimation in partially observable systems

2020 ◽  
Author(s):  
Gustavo G. Santos ◽  
Thales L. Oliveira ◽  
José Carlos Oliveira ◽  
José Carlos M. Vieira
Keyword(s):  
State Estimation ◽  
Hybrid Method ◽  
Partially Observable Systems ◽  
Partially Observable

Optimal control for a class of partially observable systems†

Stochastics ◽  
1982 ◽  
Vol 8 (1) ◽  
pp. 17-38 ◽  
Author(s):  
N. Christopeit ◽  
K. Helmes
Keyword(s):  
Optimal Control ◽  
Partially Observable Systems ◽  
Partially Observable

scholarly journals Filtering method for linear and non-linear stochastic optimal control of partially observable systems II

Filomat ◽  
2018 ◽  
Vol 32 (14) ◽  
pp. 5089-5103 ◽  
Author(s):  
Ali Poursherafatan ◽  
Ali Delavarkhalafi
Keyword(s):  
Optimal Control ◽  
Stochastic Optimal Control ◽  
Payoff Function ◽  
Estimation Methods ◽  
Control Factor ◽  
Diffusion Term ◽  
Filtering Method ◽  
Partially Observable Systems ◽  
Partially Observable System ◽  
Partially Observable

In this paper we studied stochastic optimal control problem based on partially observable systems (SOCPP) with a control factor on the diffusion term. A SOCPP has state and observation processes. This kind of problem has also a minimum payoff function. The payoff function should be minimized according to the partially observable systems consist of the state and observation processes. In this regard, the filtering method is used to evaluat this kind of problem and express full consideration of it. Finally, presented estimation methods are used to simulate the solution of a partially observable system corresponding to the control factor of this problem. These methods are numerically used to solve linear and nonlinear cases.

scholarly journals Runtime Monitors for Markov Decision Processes

2021 ◽  
pp. 553-576
Author(s):  
Sebastian Junges ◽  
Hazem Torfah ◽  
Sanjit A. Seshia
Keyword(s):  
Markov Decision Processes ◽  
Partial Information ◽  
Current System ◽  
Geometric Interpretation ◽  
Decision Processes ◽  
System State ◽  
Partially Observable Systems ◽  
Markov Decision ◽  
Novel Algorithms ◽  
Partially Observable

AbstractWe investigate the problem of monitoring partially observable systems with nondeterministic and probabilistic dynamics. In such systems, every state may be associated with a risk, e.g., the probability of an imminent crash. During runtime, we obtain partial information about the system state in form of observations. The monitor uses this information to estimate the risk of the (unobservable) current system state. Our results are threefold. First, we show that extensions of state estimation approaches do not scale due the combination of nondeterminism and probabilities. While exploiting a geometric interpretation of the state estimates improves the practical runtime, this cannot prevent an exponential memory blowup. Second, we present a tractable algorithm based on model checking conditional reachability probabilities. Third, we provide prototypical implementations and manifest the applicability of our algorithms to a range of benchmarks. The results highlight the possibilities and boundaries of our novel algorithms.

Sign in / Sign up

Export Citation Format

Share Document