stochastic control
Recently Published Documents





Sheng Li

In this paper, we consider the robust investment and reinsurance problem with bounded memory and risk co-shocks under a jump-diffusion risk model. The insurer is assumed to be ambiguity-averse and make the optimal decision under the mean-variance criterion. The insurance market is described by two-dimensional dependent claims while the risky asset is depicted by the jump-diffusion model. By introducing the performance in the past, we derive the wealth process depicted by a stochastic delay differential equation (SDDE). Applying the stochastic control theory under the game-theoretic framework, together with stochastic control theory with delay, the robust equilibrium investment-reinsurance strategy and the corresponding robust equilibrium value function are derived. Furthermore, some numerical examples are provided to illustrate the effect of market parameters on the optimal investment and reinsurance strategy.

Ashley Davey ◽  
Harry Zheng

AbstractThis paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation. We solve this highly nonlinear partial differential equation (PDE) with a second order backward stochastic differential equation (2BSDE) formulation. The convex structure of the problem allows us to describe a dual problem that can either verify the original primal approach or bypass some of the complexity. The second algorithm utilises the full power of the duality method to solve non-Markovian problems, which are often beyond the scope of stochastic control solvers in the existing literature. We solve an adjoint BSDE that satisfies the dual optimality conditions. We apply these algorithms to problems with power, log and non-HARA utilities in the Black-Scholes, the Heston stochastic volatility, and path dependent volatility models. Numerical experiments show highly accurate results with low computational cost, supporting our proposed algorithms.

2021 ◽  
Vol Volume 17, Issue 4 ◽  
Thomas Colcombet ◽  
Nathanaël Fijalkow ◽  
Pierre Ohlmann

Bertrand et al. introduced a model of parameterised systems, where each agent is represented by a finite state system, and studied the following control problem: for any number of agents, does there exist a controller able to bring all agents to a target state? They showed that the problem is decidable and EXPTIME-complete in the adversarial setting, and posed as an open problem the stochastic setting, where the agent is represented by a Markov decision process. In this paper, we show that the stochastic control problem is decidable. Our solution makes significant uses of well quasi orders, of the max-flow min-cut theorem, and of the theory of regular cost functions. We introduce an intermediate problem of independence interest called the sequential flow problem and study its complexity.

2021 ◽  
Vol 0 (0) ◽  
Lucas Izydorczyk ◽  
Nadia Oudjane ◽  
Francesco Russo

Abstract We propose a fully backward representation of semilinear PDEs with application to stochastic control. Based on this, we develop a fully backward Monte-Carlo scheme allowing to generate the regression grid, backwardly in time, as the value function is computed. This offers two key advantages in terms of computational efficiency and memory. First, the grid is generated adaptively in the areas of interest, and second, there is no need to store the entire grid. The performances of this technique are compared in simulations to the traditional Monte-Carlo forward-backward approach on a control problem of thermostatic loads.

Sign in / Sign up

Export Citation Format

Share Document