Development and validation of simplified machine learning algorithms to predict prognosis of hospitalized COVID-19 patients: a multi-center, retrospective study (Preprint)

2021 ◽  
Author(s):  
Fang He ◽  
John H Page ◽  
Kerry R Weinberg ◽  
Anirban Mishra
Keyword(s):  
Machine Learning ◽  
Respiratory Failure ◽  
High Risk ◽  
Learning Algorithms ◽  
Model Development ◽  
Machine Learning Algorithms ◽  
Validation Dataset ◽  
High Risk Patients ◽  
Risk Patients ◽  
Development And Validation

BACKGROUND The current COVID-19 pandemic is unprecedented; under resource-constrained setting, predictive algorithms can help to stratify disease severity, alerting physicians of high-risk patients, however there are few risk scores derived from a substantially large EHR dataset, using simplified predictors as input. OBJECTIVE To develop and validate simplified machine learning algorithms which predicts COVID-19 adverse outcomes, to evaluate the AUC (area under the receiver operating characteristic curve), sensitivity, specificity and calibration of the algorithms, to derive clinically meaningful thresholds. METHODS We conducted machine learning model development and validation via cohort study using multi-center, patient-level, longitudinal electronic health records (EHR) from Optum® COVID-19 database which provides anonymized, longitudinal EHR from across US. The models were developed based on clinical characteristics to predict 28-day in-hospital mortality, ICU admission, respiratory failure, mechanical ventilator usages at inpatient setting. Data from patients who were admitted prior to Sep 7, 2020, is randomly sampled into development, test and validation datasets; data collected from Sep 7, 2020 through Nov 15, 2020 was reserved as prospective validation dataset. RESULTS Of 3.7M patients in the analysis, a total of 585,867 patients were diagnosed or tested positive for SARS-CoV-2; and 50,703 adult patients were hospitalized with COVID-19 between Feb 1 and Nov 15, 2020. Among the study cohort (N=50,703), there were 6,204 deaths, 9,564 ICU admissions, 6,478 mechanically ventilated or EMCO patients and 25,169 patients developed ARDS or respiratory failure within 28 days since hospital admission. The algorithms demonstrated high accuracy (AUC = 0.89 (0.89 - 0.89) on validation dataset (N=10,752)), consistent prediction through the second wave of pandemic from September to November (AUC = 0.85 (0.85 - 0.86) on post-development validation (N= 14,863)), great clinical relevance and utility. Besides, a comprehensive 386 input covariates from baseline and at admission was included in the analysis; the end-to-end pipeline automates feature selection and model development process, producing 10 key predictors as input such as age, blood urea nitrogen, oxygen saturation, which are both commonly measured and concordant with recognized risk factors for COVID-19. CONCLUSIONS The systematic approach and rigorous validations demonstrate consistent model performance to predict even beyond the time period of data collection, with satisfactory discriminatory power and great clinical utility. Overall, the study offers an accurate, validated and reliable prediction model based on only ten clinical features as a prognostic tool to stratifying COVID-19 patients into intermediate, high and very high-risk groups. This simple predictive tool could be shared with a wider healthcare community, to enable service as an early warning system to alert physicians of possible high-risk patients, or as a resource triaging tool to optimize healthcare resources. CLINICALTRIAL N/A

scholarly journals A Novel Epigenetic Machine Learning Model to Define Risk of Progression for Hepatocellular Carcinoma Patients

2021 ◽  
Vol 22 (3) ◽  
pp. 1075
Author(s):  
Luca Bedon ◽  
Michele Dal Bo ◽  
Monica Mossenta ◽  
Davide Busato ◽  
Giuseppe Toffoli ◽  
...  
Keyword(s):  
Machine Learning ◽  
Hepatocellular Carcinoma ◽  
High Risk ◽  
Progression Free Survival ◽  
Low Risk ◽  
Functional Enrichment ◽  
Free Survival ◽  
High Risk Patients ◽  
Risk Of Progression ◽  
Risk Patients

Although extensive advancements have been made in treatment against hepatocellular carcinoma (HCC), the prognosis of HCC patients remains unsatisfied. It is now clearly established that extensive epigenetic changes act as a driver in human tumors. This study exploits HCC epigenetic deregulation to define a novel prognostic model for monitoring the progression of HCC. We analyzed the genome-wide DNA methylation profile of 374 primary tumor specimens using the Illumina 450 K array data from The Cancer Genome Atlas. We initially used a novel combination of Machine Learning algorithms (Recursive Features Selection, Boruta) to capture early tumor progression features. The subsets of probes obtained were used to train and validate Random Forest models to predict a Progression Free Survival greater or less than 6 months. The model based on 34 epigenetic probes showed the best performance, scoring 0.80 accuracy and 0.51 Matthews Correlation Coefficient on testset. Then, we generated and validated a progression signature based on 4 methylation probes capable of stratifying HCC patients at high and low risk of progression. Survival analysis showed that high risk patients are characterized by a poorer progression free survival compared to low risk patients. Moreover, decision curve analysis confirmed the strength of this predictive tool over conventional clinical parameters. Functional enrichment analysis highlighted that high risk patients differentiated themselves by the upregulation of proliferative pathways. Ultimately, we propose the oncogenic MCM2 gene as a methylation-driven gene of which the representative epigenetic markers could serve both as predictive and prognostic markers. Briefly, our work provides several potential HCC progression epigenetic biomarkers as well as a new signature that may enhance patients surveillance and advances in personalized treatment.

Development and validation of the Tool for Pharmacists to Predict 30-day hospital readmission in patients with Heart Failure (ToPP-HF)

2021 ◽  
Author(s):  
Melissa R Riester ◽  
Laura McAuliffe ◽  
Christine Collins ◽  
Andrew R Zullo
Keyword(s):  
Heart Failure ◽  
High Risk ◽  
Hospital Readmission ◽  
Left Ventricular Ejection ◽  
Day Hospital ◽  
High Risk Patients ◽  
C Statistic ◽  
Patients With Heart Failure ◽  
Risk Patients ◽  
Development And Validation

Abstract Purpose Pharmacists are well positioned to provide transitions of care (TOC) services to patients with heart failure (HF); however, hospitalizations for patients with HF likely exceed the capacity of a TOC pharmacist. We developed and validated a tool to help pharmacists efficiently identify high-risk patients with HF and maximize their potential impact by intervening on patients at the highest risk for 30-day all-cause readmission. Methods We conducted a retrospective cohort study including adults with HF admitted to a health system between October 1, 2016, and October 31, 2019. We randomly divided the cohort into development (n = 2,114) and validation (n = 1,089) subcohorts. Nine models were applied to select the most important predictors of 30-day readmission. The final tool, called the Tool for Pharmacists to Predict 30-day hospital readmission in patients with Heart Failure (ToPP-HF) relied upon multivariable logistic regression. We assessed discriminative ability using the C statistic and calibration using the Hosmer-Lemeshow goodness-of-fit test. Results The risk of 30-day all-cause readmission was 15.7% (n = 331) and 18.8% (n = 205) in the development and validation subcohorts, respectively. The ToPP-HF tool included 13 variables: number of hospital admissions in previous 6 months; admission diagnosis of HF; number of scheduled medications; chronic obstructive pulmonary disease diagnosis; number of comorbidities; estimated glomerular filtration rate; hospital length of stay; left ventricular ejection fraction; critical care requirement; renin-angiotensin-aldosterone system inhibitor use; antiarrhythmic use; hypokalemia; and serum sodium. Discriminatory performance (C statistic of 0.69; 95% confidence interval [CI], 0.65-0.73) and calibration (Hosmer-Lemeshow P = 0.28) were good. Conclusions The ToPP-HF performs well and can help pharmacists identify high-risk patients with HF most likely to benefit from TOC services.

Effect of a Real-Time Risk Score on 30-day Readmission Reduction in Singapore

2021 ◽  
Vol 12 (02) ◽  
pp. 372-382
Author(s):  
Christine Xia Wu ◽  
Ernest Suresh ◽  
Francis Wei Loong Phng ◽  
Kai Pik Tai ◽  
Janthorn Pakdeethai ◽  
...  
Keyword(s):  
Machine Learning ◽  
High Risk ◽  
Real Time ◽  
Risk Score ◽  
Patient Specific ◽  
Learning Models ◽  
Medicine Department ◽  
High Risk Patients ◽  
Risk Patients ◽  
Machine Learning Models

Abstract Objective To develop a risk score for the real-time prediction of readmissions for patients using patient specific information captured in electronic medical records (EMR) in Singapore to enable the prospective identification of high-risk patients for enrolment in timely interventions. Methods Machine-learning models were built to estimate the probability of a patient being readmitted within 30 days of discharge. EMR of 25,472 patients discharged from the medicine department at Ng Teng Fong General Hospital between January 2016 and December 2016 were extracted retrospectively for training and internal validation of the models. We developed and implemented a real-time 30-day readmission risk score generation in the EMR system, which enabled the flagging of high-risk patients to care providers in the hospital. Based on the daily high-risk patient list, the various interfaces and flow sheets in the EMR were configured according to the information needs of the various stakeholders such as the inpatient medical, nursing, case management, emergency department, and postdischarge care teams. Results Overall, the machine-learning models achieved good performance with area under the receiver operating characteristic ranging from 0.77 to 0.81. The models were used to proactively identify and attend to patients who are at risk of readmission before an actual readmission occurs. This approach successfully reduced the 30-day readmission rate for patients admitted to the medicine department from 11.7% in 2017 to 10.1% in 2019 (p < 0.01) after risk adjustment. Conclusion Machine-learning models can be deployed in the EMR system to provide real-time forecasts for a more comprehensive outlook in the aspects of decision-making and care provision.

scholarly journals Machine Learning Algorithms to Predict Recurrence within 10 Years after Breast Cancer Surgery: A Prospective Cohort Study

Cancers ◽  
2020 ◽  
Vol 12 (12) ◽  
pp. 3817
Author(s):  
Shi-Jer Lou ◽  
Ming-Feng Hou ◽  
Hong-Tai Chang ◽  
Chong-Chi Chiu ◽  
Hao-Hsien Lee ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Machine Learning ◽  
Learning Algorithms ◽  
External Validation ◽  
Model Development ◽  
Cancer Surgery ◽  
Machine Learning Algorithms ◽  
Breast Cancer Surgery ◽  
Training Dataset

No studies have discussed machine learning algorithms to predict recurrence within 10 years after breast cancer surgery. This study purposed to compare the accuracy of forecasting models to predict recurrence within 10 years after breast cancer surgery and to identify significant predictors of recurrence. Registry data for breast cancer surgery patients were allocated to a training dataset (n = 798) for model development, a testing dataset (n = 171) for internal validation, and a validating dataset (n = 171) for external validation. Global sensitivity analysis was then performed to evaluate the significance of the selected predictors. Demographic characteristics, clinical characteristics, quality of care, and preoperative quality of life were significantly associated with recurrence within 10 years after breast cancer surgery (p < 0.05). Artificial neural networks had the highest prediction performance indices. Additionally, the surgeon volume was the best predictor of recurrence within 10 years after breast cancer surgery, followed by hospital volume and tumor stage. Accurate recurrence within 10 years prediction by machine learning algorithms may improve precision in managing patients after breast cancer surgery and improve understanding of risk factors for recurrence within 10 years after breast cancer surgery.

scholarly journals Effect of Postextubation High-Flow Nasal Cannula vs Noninvasive Ventilation on Reintubation and Postextubation Respiratory Failure in High-Risk Patients

JAMA ◽  
2016 ◽  
Vol 316 (15) ◽  
pp. 1565 ◽  
Author(s):  
Gonzalo Hernández ◽  
Concepción Vaquero ◽  
Laura Colinas ◽  
Rafael Cuena ◽  
Paloma González ◽  
...  
Keyword(s):  
Respiratory Failure ◽  
High Risk ◽  
Noninvasive Ventilation ◽  
High Flow ◽  
Nasal Cannula ◽  
High Flow Nasal Cannula ◽  
High Risk Patients ◽  
Risk Patients
Sign in / Sign up

Export Citation Format

Share Document