Flexible, non-parametric modeling using regularized neural networks

Non-parametric, additive models are able to capture complex data dependencies in a flexible, yet interpretable way. However, choosing the format of the additive components often requires non-trivial data exploration. Here, as an alternative, we propose PrAda-net, a one-hidden-layer neural network, trained with proximal gradient descent and adaptive lasso. PrAda-net automatically adjusts the size and architecture of the neural network to reflect the complexity and structure of the data. The compact network obtained by PrAda-net can be translated to additive model components, making it suitable for non-parametric statistical modelling with automatic model selection. We demonstrate PrAda-net on simulated data, where we compare the test error performance, variable importance and variable subset identification properties of PrAda-net to other lasso-based regularization approaches for neural networks. We also apply PrAda-net to the massive U.K. black smoke data set, to demonstrate how PrAda-net can be used to model complex and heterogeneous data with spatial and temporal components. In contrast to classical, statistical non-parametric approaches, PrAda-net requires no preliminary modeling to select the functional forms of the additive components, yet still results in an interpretable model representation.

Non-parametric synergy modeling of chemical compounds with Gaussian processes

Background Understanding the synergetic and antagonistic effects of combinations of drugs and toxins is vital for many applications, including treatment of multifactorial diseases and ecotoxicological monitoring. Synergy is usually assessed by comparing the response of drug combinations to a predicted non-interactive response from reference (null) models. Possible choices of null models are Loewe additivity, Bliss independence and the recently rediscovered Hand model. A different approach is taken by the MuSyC model, which directly fits a generalization of the Hill model to the data. All of these models, however, fit the dose–response relationship with a parametric model. Results We propose the Hand-GP model, a non-parametric model based on the combination of the Hand model with Gaussian processes. We introduce a new logarithmic squared exponential kernel for the Gaussian process which captures the logarithmic dependence of response on dose. From the monotherapeutic response and the Hand principle, we construct a null reference response and synergy is assessed from the difference between this null reference and the Gaussian process fitted response. Statistical significance of the difference is assessed from the confidence intervals of the Gaussian process fits. We evaluate performance of our model on a simulated data set from Greco, two simulated data sets of our own design and two benchmark data sets from Chou and Talalay. We compare the Hand-GP model to standard synergy models and show that our model performs better on these data sets. We also compare our model to the MuSyC model as an example of a recent method on these five data sets and on two-drug combination screens: Mott et al. anti-malarial screen and O’Neil et al. anti-cancer screen. We identify cases in which the HandGP model is preferred and cases in which the MuSyC model is preferred. Conclusion The Hand-GP model is a flexible model to capture synergy. Its non-parametric and probabilistic nature allows it to model a wide variety of response patterns.

Non-parametric estimation of reference adjusted, standardised probabilities of all-cause death and death due to cancer for population group comparisons

Background Ensuring fair comparisons of cancer survival statistics across population groups requires careful consideration of differential competing mortality due to other causes, and adjusting for imbalances over groups in other prognostic covariates (e.g. age). This has typically been achieved using comparisons of age-standardised net survival, with age standardisation addressing covariate imbalance, and the net estimates removing differences in competing mortality from other causes. However, these estimates lack ease of interpretability. In this paper, we motivate an alternative non-parametric approach that uses a common rate of other cause mortality across groups to give reference-adjusted estimates of the all-cause and cause-specific crude probability of death in contrast to solely reporting net survival estimates. Methods We develop the methodology for a non-parametric equivalent of standardised and reference adjusted crude probabilities of death, building on the estimation of non-parametric crude probabilities of death. We illustrate the approach using regional comparisons of survival following a diagnosis of rectal cancer for men in England. We standardise to the covariate distribution and other cause mortality of England as a whole to offer comparability, but with close approximation to the observed all-cause region-specific mortality. Results The approach gives comparable estimates to observed crude probabilities of death, but allows direct comparison across population groups with different covariate profiles and competing mortality patterns. In our illustrative example, we show that regional variations in survival following a diagnosis of rectal cancer persist even after accounting for the variation in deprivation, age at diagnosis and other cause mortality. Conclusions The methodological approach of using standardised and reference adjusted metrics offers an appealing approach for future cancer survival comparison studies and routinely published cancer statistics. Our non-parametric estimation approach through the use of weighting offers the ability to estimate comparable survival estimates without the need for statistical modelling.