scholarly journals Development and Validation of Machine Learning Models to Predict Bacteremia and Fungemia Using Electronic Health Record (EHR) Data

2020 ◽  
Author(s):  
S. Bhavani ◽  
Z. Lonjers ◽  
K. Carey ◽  
E.R. Gilbert ◽  
M. Afshar ◽  
...  
Keyword(s):  
Machine Learning ◽  
Electronic Health Record ◽  
Health Record ◽  
Learning Models ◽  
Electronic Health ◽  
Development And Validation ◽  
Machine Learning Models

scholarly journals Assessing stroke severity using electronic health record data: a machine learning approach

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Emily Kogan ◽  
Kathryn Twyman ◽  
Jesse Heap ◽  
Dejan Milentijevic ◽  
Jennifer H. Lin ◽  
...  
Keyword(s):  
Machine Learning ◽  
Electronic Health Record ◽  
Patient Outcomes ◽  
Stroke Severity ◽  
Health Record ◽  
Learning Models ◽  
Electronic Health Record Data ◽  
Record Data ◽  
Electronic Health ◽  
Machine Learning Models

Abstract Background Stroke severity is an important predictor of patient outcomes and is commonly measured with the National Institutes of Health Stroke Scale (NIHSS) scores. Because these scores are often recorded as free text in physician reports, structured real-world evidence databases seldom include the severity. The aim of this study was to use machine learning models to impute NIHSS scores for all patients with newly diagnosed stroke from multi-institution electronic health record (EHR) data. Methods NIHSS scores available in the Optum© de-identified Integrated Claims-Clinical dataset were extracted from physician notes by applying natural language processing (NLP) methods. The cohort analyzed in the study consists of the 7149 patients with an inpatient or emergency room diagnosis of ischemic stroke, hemorrhagic stroke, or transient ischemic attack and a corresponding NLP-extracted NIHSS score. A subset of these patients (n = 1033, 14%) were held out for independent validation of model performance and the remaining patients (n = 6116, 86%) were used for training the model. Several machine learning models were evaluated, and parameters optimized using cross-validation on the training set. The model with optimal performance, a random forest model, was ultimately evaluated on the holdout set. Results Leveraging machine learning we identified the main factors in electronic health record data for assessing stroke severity, including death within the same month as stroke occurrence, length of hospital stay following stroke occurrence, aphagia/dysphagia diagnosis, hemiplegia diagnosis, and whether a patient was discharged to home or self-care. Comparing the imputed NIHSS scores to the NLP-extracted NIHSS scores on the holdout data set yielded an R2 (coefficient of determination) of 0.57, an R (Pearson correlation coefficient) of 0.76, and a root-mean-squared error of 4.5. Conclusions Machine learning models built on EHR data can be used to determine proxies for stroke severity. This enables severity to be incorporated in studies of stroke patient outcomes using administrative and EHR databases.

scholarly journals MP54-19 MACHINE LEARNING MODELS TO PREDICT 24-HOUR URINE ABNORMALITIES FROM ELECTRONIC HEALTH RECORD-DERIVED FEATURES

2021 ◽  
Vol 206 (Supplement 3) ◽  
Author(s):  
Nicholas Kavoussi ◽  
Abin Abraham ◽  
Wilson Sui ◽  
Cosmin Bejan ◽  
John Capra ◽  
...  
Keyword(s):  
Machine Learning ◽  
Electronic Health Record ◽  
Health Record ◽  
Learning Models ◽  
Electronic Health ◽  
Machine Learning Models

scholarly journals Predicting Ventilator-Associated Pneumonia with Machine Learning

2020 ◽  
Author(s):  
Christine Giang ◽  
Jacob Calvert ◽  
Gina Barnes ◽  
Anna Siefkas ◽  
Abigail Green-Saxena ◽  
...  
Keyword(s):  
Machine Learning ◽  
Mechanical Ventilation ◽  
Electronic Health Record ◽  
Health Record ◽  
Ventilator Associated Pneumonia ◽  
Learning Models ◽  
Electronic Health Record Data ◽  
Record Data ◽  
Electronic Health ◽  
Machine Learning Models

Abstract Objective Ventilator-associated pneumonia (VAP) is the most common and fatal nosocomial infection in intensive care units (ICUs). Existing methods for identifying VAP display low accuracy, and their use may delay antimicrobial therapy. ​VAP diagnostics derived from machine learning methods that utilize electronic health record data have not yet been explored. The objective of this study is to compare the performance of a variety of machine learning models trained to predict whether VAP will be diagnosed during the patient stay.Methods A retrospective study examined data from 6,129 adult ICU encounters lasting at least 48 hours following the initiation of mechanical ventilation. The gold standard was the presence of a diagnostic code for VAP. Five different machine learning models were trained to predict VAP 48 hours after initiation of mechanical ventilation. Model performance was evaluated with regard to area under the receiver operating characteristic curve (AUROC) on a 10% hold-out test set. Feature importance was measured in terms of Shapley values.Results The highest performing model achieved an AUROC value of 0.827. The most important features for the best-performing model were the length of time on mechanical ventilation, presence of antibiotics, sputum test frequency, and most recent Glasgow Coma Scale assessment.Discussion Supervised machine learning using patient electronic health record data is promising for VAP diagnosis and warrants further validation. Conclusion This tool has the potential to aid the timely diagnosis of VAP.

scholarly journals Validation of an Internationally Derived Patient Severity Phenotype to Support COVID-19 Analytics from Electronic Health Record Data

2021 ◽  
Author(s):  
Jeffrey G Klann ◽  
Griffin M Weber ◽  
Hossein Estiri ◽  
Bertrand Moal ◽  
Paul Avillach ◽  
...  
Keyword(s):  
Machine Learning ◽  
Electronic Health Record ◽  
Chart Review ◽  
Learning Approach ◽  
Health Record ◽  
Learning Approaches ◽  
Electronic Health Record Data ◽  
Icu Admission ◽  
Machine Learning Approach ◽  
Electronic Health

Abstract Introduction The Consortium for Clinical Characterization of COVID-19 by EHR (4CE) is an international collaboration addressing COVID-19 with federated analyses of electronic health record (EHR) data. Objective We sought to develop and validate a computable phenotype for COVID-19 severity. Methods Twelve 4CE sites participated. First we developed an EHR-based severity phenotype consisting of six code classes, and we validated it on patient hospitalization data from the 12 4CE clinical sites against the outcomes of ICU admission and/or death. We also piloted an alternative machine-learning approach and compared selected predictors of severity to the 4CE phenotype at one site. Results The full 4CE severity phenotype had pooled sensitivity of 0.73 and specificity 0.83 for the combined outcome of ICU admission and/or death. The sensitivity of individual code categories for acuity had high variability - up to 0.65 across sites. At one pilot site, the expert-derived phenotype had mean AUC 0.903 (95% CI: 0.886, 0.921), compared to AUC 0.956 (95% CI: 0.952, 0.959) for the machine-learning approach. Billing codes were poor proxies of ICU admission, with as low as 49% precision and recall compared to chart review. Discussion We developed a severity phenotype using 6 code classes that proved resilient to coding variability across international institutions. In contrast, machine-learning approaches may overfit hospital-specific orders. Manual chart review revealed discrepancies even in the gold-standard outcomes, possibly due to heterogeneous pandemic conditions. Conclusion We developed an EHR-based severity phenotype for COVID-19 in hospitalized patients and validated it at 12 international sites.

Sign in / Sign up

Export Citation Format

Share Document