Actor-Critic–Like Stochastic Adaptive Search for Continuous Simulation Optimization

Many systems arising in applications from engineering design, manufacturing, and healthcare require the use of simulation optimization (SO) techniques to improve their performance. In “Actor-Critic–Like Stochastic Adaptive Search for Continuous Simulation Optimization,” Q. Zhang and J. Hu propose a randomized approach that integrates ideas from actor-critic reinforcement learning within a class of adaptive search algorithms for solving SO problems. The approach fully retains the previous simulation data and incorporates them into an approximation architecture to exploit knowledge of the objective function in searching for improved solutions. The authors provide a finite-time analysis for the method when only a single simulation observation is collected at each iteration. The method works well on a diverse set of benchmark problems and has the potential to yield good performance for complex problems using expensive simulation experiments for performance evaluation.

Organization of Emergency Care for Children on the Outpatient Stage

The article considers the principles of emergency care at the outpatient stage, clarifies the terms, and analyzes the regulatory framework. The example of anaphylactic shock and respiratory failure management shows the most crucial details of proper emergency room organization. The importance of continuous simulation training of nursing staff and outpatient doctors is emphasized.

Continuous Simulation of Highly Urbanized Watershed to Quantify Nutrients’ Loadings

The United States has witnessed various extreme land use changes over the years. These changes led to alterations in watersheds’ characteristics, impacting their water quality and quantity. To quantify this impact in highly urbanized watersheds such as the Chicago Metropolitan Area, it is crucial to examine the characteristics and imperviousness distribution of urban land uses and available point and non-point sources. In this paper, the effect of urban runoff and nutrient loadings to water bodies in the Chicago River Watershed resulting from level (III) detailed urban land uses is investigated. A watershed scale hydrologic and water quality simulation using BASINS/HSPF model was developed for the highly urbanized watershed. Appropriate considerations were given to the effective impervious area (EIA). The results from the five-year calibrated water quality simulation were reasonably reflected with observed data in the study area and nutrient loadings of both point and non-point sources for 44 different land uses were found. The export coefficients (EC) values obtained are site-specific depending on conditions and variables at the watershed level such as physical characteristics, land use management practices, hydro-meteorological and topographical data, while using a continuous simulation approach and watershed perspective analysis. This is the first attempt to measure and model nutrients’ loadings using detailed land use types in the Chicago River Watershed. The proposed continuous calibrated and validated model can be used in the investigation and analysis of different scenarios and possible future conditions and land utilization.

Stochastic Hybrid Event Based and Continuous Approach to Derive Flood Frequency Curve

This study proposes a methodology that combines the advantages of the event-based and continuous models, for the derivation of the maximum flow and maximum hydrograph volume frequency curves, by combining a stochastic continuous weather generator (the advanced weather generator, abbreviated as AWE-GEN) with a fully distributed physically based hydrological model (the TIN-based real-time integrated basin simulator, abbreviated as tRIBS) that runs both event-based and continuous simulation. The methodology is applied to Peacheater Creek, a 64 km2 basin located in Oklahoma, United States. First, a continuous set of 5000 years’ hourly weather forcing series is generated using the stochastic weather generator AWE-GEN. Second, a hydrological continuous simulation of 50 years of the climate series is generated with the hydrological model tRIBS. Simultaneously, the separation of storm events is performed by applying the exponential method to the 5000- and 50-years climate series. From the continuous simulation of 50 years, the mean soil moisture in the top 10 cm (MSM10) of the soil layer of the basin at an hourly time step is extracted. Afterwards, from the times series of hourly MSM10, the values associated to all the storm events within the 50 years of hourly weather series are extracted. Therefore, each storm event has an initial soil moisture value associated (MSM10Event). Thus, the probability distribution of MSM10Event for each month of the year is obtained. Third, the five major events of each of the 5000 years in terms of total depth are simulated in an event-based framework in tRIBS, assigning an initial moisture state value for the basin using a Monte Carlo framework. Finally, the maximum annual hydrographs are obtained in terms of maximum peak-flow and volume, and the associated frequency curves are derived. To validate the method, the results obtained by the hybrid method are compared to those obtained by deriving the flood frequency curves from the continuous simulation of 5000 years, analyzing the maximum annual peak-flow and maximum annual volume, and the dependence between the peak-flow and volume. Independence between rainfall events and prior hydrological soil moisture conditions has been proved. The proposed hybrid method can reproduce the univariate flood frequency curves with a good agreement to those obtained by the continuous simulation. The maximum annual peak-flow frequency curve is obtained with a Nash–Sutcliffe coefficient of 0.98, whereas the maximum annual volume frequency curve is obtained with a Nash–Sutcliffe value of 0.97. The proposed hybrid method permits to generate hydrological forcing by using a fully distributed physically based model but reducing the computation times on the order from months to hours.

Simplified Interception/Evaporation Model

It is known that at the event scale, evaporation losses of rainfall intercepted by canopy are a few millimeters, which is often not much in comparison to other stocks in the water balance. Nevertheless, at yearly scale, the number of times that the canopy is filled by rainfall and then depleted can be so large that the interception flux may become an important fraction of rainfall. Many accurate interception models and models that describe evaporation by wet canopy have been proposed. However, they often require parameters that are difficult to obtain, especially for large-scale applications. In this paper, a simplified interception/evaporation model is proposed, which considers a modified Merrian model to compute interception during wet spells, and a simple power-law equation to model evaporation by wet canopy during dry spells. Thus, the model can be applied for continuous simulation, according to the sub hourly rainfall data that is appropriate to study both processes. It is shown that the Merrian model can be derived according to a simple linear storage model, also accounting for the antecedent intercepted stored volume, which is useful to consider for the suggested simplified approach. For faba bean cover crop, an application of the suggested procedure, providing reasonable results, is performed and discussed.

Emergent properties of coupled bistable switches

Understanding the dynamical hallmarks of network motifs is one of the fundamental aspects of systems biology. Positive feedback loops constituting one or two nodes, self-activation, toggle switch, and double activation loops, are commonly observed motifs in regulatory networks underlying cell-fate decision systems. Their individual dynamics are well-studied; they are capable of exhibiting bistability. However, studies across various biological systems suggest that such positive feedback loops are interconnected with one another, and design principles of coupled bistable motifs remain unclear. We wanted to ask what happens to bistability or multistability traits and the phenotypic space (collection of phenotypes exhibited by a system) due to the couplings. In this study, we explore a set of such interactions using discrete and continuous simulation methods. Our results suggest that couplings that do not connect the bistable switches in a way that contradicts the connections within individual bistable switches lead to a steady state space that is strictly a subset of the set of possible combinations of steady states of bistable switches. Furthermore, adding direct and indirect self-activations to these coupled networks can increase the frequency of multistability. Thus, our observations reveal specific dynamical traits exhibited by various coupled bistable motifs.