APACHE IV is an accurate measure of predicting in-hospital mortality of ICU patients, but there are covariates associated with its occasional failure - a multicentre analysis of intensive care units
Abstract Background: APACHE IV provides typically useful and accurate predictions on in-hospital mortality and length of stay for patients in critical care. However, there are factors which may preclude APACHE IV from reaching its ceiling of predictive accuracy. Our primary aim was to determine which variables available within the first 24 hours of a patient’s ICU stay may be indicative of the APACHE IV scoring system making occasional but potentially illuminating errors in predicting in-hospital mortality. Methods: We utilized the publicly available multi-institutional ICU database, eICU, available since 2018, to identify a large observational cohort for our investigation. APACHE IV scores are provided by eICU for each patient’s ICU stay. We used Lasso logistic regression in an aim to build parsimonious final models, using cross-validation to select the penalization parameter, separately for each of our two responses, i.e., errors, of interest, which are APACHE falsely predicting in-hospital death (Type I error), and APACHE falsely predicting in-hospital survival (Type II error). We then assessed the performance of the models with a random holdout validation sample. Results: While the extremeness of the APACHE prediction led to dependable predictions for preventing either type of error, there were a small set of distinct variables identified as being strongly associated with the two different types of errors occurring. These included worst lactate and mean SpO2 for Type I, and mean non-invasive blood pressure and mean respiratory rate for Type II. The two models also differed in their performance metrics in identical holdout validation samples, in large part due to the lower prevalence of Type II errors compared to Type I. Conclusions: The eICU database was a good resource for evaluating our objective, and important recommendations to intensivists are provided, particularly identifying key variables that could lead to APACHE prediction errors when APACHE scores are sufficiently low to predict in-hospital survival.