A neuro-dynamic programming approach to the optimal stand management problem

Some ideas of neuro-dynamic programming (NDP) are illustrated by considering the problem of optimally managing a forest stand under uncertainty. Because reasonable growth models require state information such as height (or age), basal area, and stand diameter, as well as an indicator variable for treatments that have been performed on the stand, they can easily lead to very large state spaces that include continuous variables. Realistic stand management policies include silvicultural options such as pre-commercial and commercial thinning as well as post-harvest treatments. We are interested in problems that are stochastic in their basic growth dynamics, in market prices, and in disturbances, ranging from insects to fire to hurricanes. NDP algorithms are appropriate for problems with large dimensions that may lack a simple model of dynamics and stochastic processes. This paper looks at applying these ideas in the context of a multispecies model. Results show that policies obtained using NDP are optimal within a 95% confidence interval or better. The set of states and controls incorporated into our NDP model allows us to develop optimal policies with a level of detail not typically seen in the forestry literature.