scholarly journals Machine learning-based CT radiomics model distinguishes COVID-19 from non-COVID-19 pneumonia

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Hui Juan Chen ◽  
Li Mao ◽  
Yang Chen ◽  
Li Yuan ◽  
Fei Wang ◽  
...  

Abstract Background To develop a machine learning-based CT radiomics model is critical for the accurate diagnosis of the rapid spreading coronavirus disease 2019 (COVID-19). Methods In this retrospective study, a total of 326 chest CT exams from 134 patients (63 confirmed COVID-19 patients and 71 non-COVID-19 patients) were collected from January 20 to February 8, 2020. A semi-automatic segmentation procedure was used to delineate the volume of interest (VOI), and radiomic features were extracted. The Support Vector Machine (SVM) model was built on the combination of 4 groups of features, including radiomic features, traditional radiological features, quantifying features, and clinical features. By repeating cross-validation procedure, the performance on the time-independent testing cohort was evaluated by the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity. Results For the SVM model built on the combination of 4 groups of features (integrated model), the per-exam AUC was 0.925 (95% CI 0.856 to 0.994) for differentiating COVID-19 on the testing cohort, and the sensitivity and specificity were 0.816 (95% CI 0.651 to 0.917) and 0.923 (95% CI 0.621 to 0.996), respectively. As for the SVM models built on radiomic features, radiological features, quantifying features, and clinical features, individually, the AUC on the testing cohort reached 0.765, 0.818, 0.607, and 0.739, respectively, significantly lower than the integrated model, except for the radiomic model. Conclusion The machine learning-based CT radiomics models may accurately classify COVID-19, helping clinicians and radiologists to identify COVID-19 positive cases.

2021 ◽  
Author(s):  
Hui Juan Chen ◽  
Li Mao ◽  
Yang Chen ◽  
Li Yuan ◽  
Fei Wang ◽  
...  

Abstract Background: To develop a machine learning-based CT radiomics model is critical for the accurate diagnosis of the rapid spread Coronavirus disease 2019 (COVID-19).Methods: In this retrospective study, a total of 326 chest CT exams from 134 patients (63 confirmed COVID-19 patients and 71 non-COVID-19 patients) were collected from January 20 to February 8, 2020. A semi-automatic segmentation procedure was used to delineate the region of interest (ROI), and the radiomic features were extracted. The Support Vector Machine(SVM) model was built on the combination of the 4 groups of features, including radiomic features, traditional radiological features, quantifying features and clinical features, by repeated cross-validation procedure and the performance on the time-independent testing cohort was evaluated by the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity and specificity. Results: For the SVM model that built on the combination of 4 groups of features(integrated model), the per-exam AUC of 0.925(95% CI: 0.856 to 0.994) was reached for differentiating COVID-19 on the testing cohort, and the sensitivity and specificity were 0.816(95% CI: 0.651 to 0.917) and 0.923(95% CI: 0.621 to 0.996), respectively. For the SVM models that built on radiomic features, radiological features, quantifying features and clinical features individually, the AUC on the testing cohort reached 0.765, 0.818, 0.607 and 0.739 respectively, significantly lower than the integrated model, except for the radiomic model.Conclusion: The machine learning-based CT radiomics models may accurately detect COVID-19, helping clinicians and radiologists to identify COVID-19 positive cases.


Author(s):  
Hui Juan Chen ◽  
Yang Chen ◽  
Li Yuan ◽  
Fei Wang ◽  
Li Mao ◽  
...  

Abstract Purpose To develop a machine learning-based CT radiomics model is critical for the accurate diagnosis of the rapid spread Coronavirus disease 2019 (COVID-19).Methods In this retrospective study, a machine learning-based CT radiomics model was developed to extract features from chest CT exams for the detection of COVID-19. Other viral-pneumonia CT exams of the corresponding period were also included. The radiomics features extracted from the region of interest (ROI), the radiological features evaluated by the radiologists, the quantity features calculated by the AI segmentation and evaluation, and the clinical parameters including clinical symptoms, epidemiology history and biochemical results were enrolled in this study. The SVM model was built and the performance on the testing cohort was evaluated by the area under the receiver operating characteristic curve (AUC), sensitivity and specificity. Results For the SVM model that built on the radiomics features only, it reached an AUC of 0.688(95% CI 0.496 to 0.881) on the testing cohort. After the radiological features were enrolled, the AUC achieved 0.696(95% CI 0.501 to 0.892), then the AUC reached 0.753(95% CI 0.596 to 0.910) after the quantity features were included. Our final model employed all the features, reached the per-exam sensitivity and specificity for differentiating COVID-19 was 29 of 38 (0.763, 95% CI: 0.598 to 0.886]) and 12 of 13 (0.923, 95% CI: 0.640 to 0.998]), respectively, with an AUC of 0.968(95% CI 0.911 to 1.000). Conclusion The machine learning-based CT radiomics models may accurately detect COVID-19 and differentiate it from other viral pneumonia.


2021 ◽  

Background: The SARS-CoV-2 virus has demonstrated the weakness of many health systems worldwide, creating a saturation and lack of access to treatments. A bottleneck to fight this pandemic relates to the lack of diagnostic infrastructure for early detection of positive cases, particularly in rural and impoverished areas of developing countries. In this context, less costly and fast machine learning (ML) diagnosis-based systems are helpful. However, most of the research has focused on deep-learning techniques for diagnosis, which are computationally and technologically expensive. ML models have been mainly used as a benchmark and are not entirely explored in the existing literature on the topic of this paper. Objective: To analyze the capabilities of ML techniques (compared to deep learning) to diagnose COVID-19 cases based on X-ray images, assessing the performance of these techniques and using their predictive power for such a diagnosis. Methods: A factorial experiment was designed to establish this power with X-ray chest images of healthy, pneumonia, and COVID-19 infected patients. This design considers data-balancing methods, feature extraction approaches, different algorithms, and hyper-parameter optimization. The ML techniques were evaluated based on classification metrics, including accuracy, the area under the receiver operating characteristic curve (AUROC), F1-score, sensitivity, and specificity. Results: The design of experiment provided the mean and its confidence intervals for the predictive capability of different ML techniques, which reached AUROC values as high as 90% with suitable sensitivity and specificity. Among the learning algorithms, support vector machines and random forest performed best. The down-sampling method for unbalanced data improved the predictive power significantly for the images used in this study. Conclusions: Our investigation demonstrated that ML techniques are able to identify COVID-19 infected patients. The results provided suitable values of sensitivity and specificity, minimizing the false-positive or false-negative rates. The models were trained with significantly low computational resources, which helps to provide access and deployment in rural and impoverished areas.


2021 ◽  
Vol 9 ◽  
Author(s):  
Yin Xing ◽  
Jianping Yue ◽  
Zizheng Guo ◽  
Yang Chen ◽  
Jia Hu ◽  
...  

Integration of different models may improve the performance of landslide susceptibility assessment, but few studies have tested it. The present study aims at exploring the way to integrating different models and comparing the results among integrated and individual models. Our objective is to answer this question: Will the integrated model have higher accuracy compared with individual model? The Lvliang mountains area, a landslide-prone area in China, was taken as the study area, and ten factors were considered in the influencing factors system. Three basic machine learning models (the back propagation (BP), support vector machine (SVM), and random forest (RF) models) were integrated by an objective function where the weight coefficients among different models were computed by the gray wolf optimization (GWO) algorithm. 80 and 20% of the landslide data were randomly selected as the training and testing samples, respectively, and different landslide susceptibility maps were generated based on the GIS platform. The results illustrated that the accuracy expressed by the area under the receiver operating characteristic curve (AUC) of the BP-SVM-RF integrated model was the highest (0.7898), which was better than that of the BP (0.6929), SVM (0.6582), RF (0.7258), BP-SVM (0.7360), BP-RF (0.7569), and SVM-RF models (0.7298). The experimental results authenticated the effectiveness of the BP-SVM-RF method, which can be a reliable model for the regional landslide susceptibility assessment of the study area. Moreover, the proposed procedure can be a good option to integrate different models to seek an “optimal” result.


2020 ◽  
Vol 46 (Supplement_1) ◽  
pp. S290-S291
Author(s):  
Johannes Lieslehto ◽  
Erika Jääskeläinen ◽  
Jouko Miettunen ◽  
Matti Isohanni ◽  
Dominic Dwyer ◽  
...  

Abstract Background Previous machine learning studies using structural MRI (sMRI) have been able to separate schizophrenia from controls with relatively high (about 80%) sensitivity and specificity (Kambeitz et al. Neuropsychopharmacology 2015). Interestingly, prediction accuracy in first-episode psychosis is lower compared to older and probably more chronic patients. One possibility is that the appearance of the neurodiagnostic fingerprints (NF) originated from the schizophrenia vs. controls classifier become more visible over time in schizophrenia due to the progressive nature of the disorder. Methods Using the Cobre sample (70 schizophrenia and 74 controls), we trained support vector machine (SVM) to differentiate schizophrenia from controls using sMRI. Next, we utilized the Northern Finland Birth Cohort 1966 (NFBC 1966) sample of 29 schizophrenia and 61 non-psychotic controls who participated in the nine-year follow-up. We applied the Cobre-trained SVM models at the baseline (participants 34 years old) and the follow-up (participants 43 years old) using out of sample cross-validation without any in-between retraining. Two independent schizophrenia datasets (the Neuromorphometry by Computer Algorithm Chicago [NMorphCH] and the Consortium for Neuropsychiatric Phenomics [CNP]) were utilized for replication analyses of the SVM generalizability. To address the possibility that the NF mainly capture some general psychopathology, we tested whether the NF generalize to depression using two independent MDD samples from Munich and Münster, Germany. Results Using the Cobre-trained SVM models for schizophrenia vs. controls differentiation in the NFBC 1966, we found balanced accuracy (i.e. mean of sensitivity and specificity, [BAC]) of 72.8% (sensitivity=58.6%, specificity=86.9%) at the baseline and BAC of 79.7% (sensitivity=75.9%, specificity=83.6%) at the follow-up. In the NFBC 1966 schizophrenia patients, we found that SVM decision scores varied as a function of timepoint into the direction of more schizophrenia-likeness at the follow-up (paired T-test, Cohen’s d=0.58, P=0.004). The same was not true in controls (Cohen’s d=0.09, P=0.49). The SVM decision score difference*timepoint interaction related to the decrease of hippocampus and medial prefrontal cortex. The SVM models’ performance was also validated at the two replication samples (BAC of 77.5% in the CNP and BAC of 69.1% in the NMorphCH). In the NFBC 1966 the strongest clinical variable correlating with the trajectory of SVM decision scores over the follow-up was poor performance in the California Verbal Learning Test. This finding was also replicated in the CNP dataset. Further, in the NFBC 1966, those schizophrenia patients with a low degree of SVM decision scores had a higher probability of being in remission, being able to work, and being without antipsychotic medication at the follow-up. The generalization of the SVM models to MDD was worse compared to schizophrenia classification (DeLong’s tests for the two ROC curves: P<0.001). Discussion The degree of schizophrenia-related neurodiagnostic fingerprints appear to magnify over time in schizophrenia. By contrast, the discernibility of these fingerprints in controls does not change over time. This indicates that the NF captures some schizophrenia-related progressive neural changes, and not, e.g., normal aging-related brain volume loss. The fingerprints were also generalizable to other schizophrenia samples. Further, the fingerprints seem to have some disorder specificity as the SVM models do not generalize to depression. Lastly, it appears that a low degree of schizophrenia-related NF in schizophrenia might possess some value in predicting patients’ future remission and recovery-related factors.


2018 ◽  
Vol 26 (1) ◽  
pp. 141-155 ◽  
Author(s):  
Li Luo ◽  
Fengyi Zhang ◽  
Yao Yao ◽  
RenRong Gong ◽  
Martina Fu ◽  
...  

Surgery cancellations waste scarce operative resources and hinder patients’ access to operative services. In this study, the Wilcoxon and chi-square tests were used for predictor selection, and three machine learning models – random forest, support vector machine, and XGBoost – were used for the identification of surgeries with high risks of cancellation. The optimal performances of the identification models were as follows: sensitivity − 0.615; specificity − 0.957; positive predictive value − 0.454; negative predictive value − 0.904; accuracy − 0.647; and area under the receiver operating characteristic curve − 0.682. Of the three models, the random forest model achieved the best performance. Thus, the effective identification of surgeries with high risks of cancellation is feasible with stable performance. Models and sampling methods significantly affect the performance of identification. This study is a new application of machine learning for the identification of surgeries with high risks of cancellation and facilitation of surgery resource management.


2020 ◽  
Author(s):  
Murad Megjhani ◽  
Kalijah Terilli ◽  
Ayham Alkhachroum ◽  
David J. Roh ◽  
Sachin Agarwal ◽  
...  

AbstractObjectiveTo develop a machine learning based tool, using routine vital signs, to assess delayed cerebral ischemia (DCI) risk over time.MethodsIn this retrospective analysis, physiologic data for 540 consecutive acute subarachnoid hemorrhage patients were collected and annotated as part of a prospective observational cohort study between May 2006 and December 2014. Patients were excluded if (i) no physiologic data was available, (ii) they expired prior to the DCI onset window (< post bleed day 3) or (iii) early angiographic vasospasm was detected on admitting angiogram. DCI was prospectively labeled by consensus of treating physicians. Occurrence of DCI was classified using various machine learning approaches including logistic regression, random forest, support vector machine (linear and kernel), and an ensemble classifier, trained on vitals and subject characteristic features. Hourly risk scores were generated as the posterior probability at time t. We performed five-fold nested cross validation to tune the model parameters and to report the accuracy. All classifiers were evaluated for good discrimination using the area under the receiver operating characteristic curve (AU-ROC) and confusion matrices.ResultsOf 310 patients included in our final analysis, 101 (32.6%) patients developed DCI. We achieved maximal classification of 0.81 [0.75-0.82] AU-ROC. We also predicted 74.7 % of all DCI events 12 hours before typical clinical detection with a ratio of 3 true alerts for every 2 false alerts.ConclusionA data-driven machine learning based detection tool offered hourly assessments of DCI risk and incorporated new physiologic information over time.


PeerJ ◽  
2021 ◽  
Vol 9 ◽  
pp. e10884
Author(s):  
Xin Yu ◽  
Qian Yang ◽  
Dong Wang ◽  
Zhaoyang Li ◽  
Nianhang Chen ◽  
...  

Applying the knowledge that methyltransferases and demethylases can modify adjacent cytosine-phosphorothioate-guanine (CpG) sites in the same DNA strand, we found that combining multiple CpGs into a single block may improve cancer diagnosis. However, survival prediction remains a challenge. In this study, we developed a pipeline named “stacked ensemble of machine learning models for methylation-correlated blocks” (EnMCB) that combined Cox regression, support vector regression (SVR), and elastic-net models to construct signatures based on DNA methylation-correlated blocks for lung adenocarcinoma (LUAD) survival prediction. We used methylation profiles from the Cancer Genome Atlas (TCGA) as the training set, and profiles from the Gene Expression Omnibus (GEO) as validation and testing sets. First, we partitioned the genome into blocks of tightly co-methylated CpG sites, which we termed methylation-correlated blocks (MCBs). After partitioning and feature selection, we observed different diagnostic capacities for predicting patient survival across the models. We combined the multiple models into a single stacking ensemble model. The stacking ensemble model based on the top-ranked block had the area under the receiver operating characteristic curve of 0.622 in the TCGA training set, 0.773 in the validation set, and 0.698 in the testing set. When stratified by clinicopathological risk factors, the risk score predicted by the top-ranked MCB was an independent prognostic factor. Our results showed that our pipeline was a reliable tool that may facilitate MCB selection and survival prediction.


2020 ◽  
Vol 13 (2) ◽  
pp. 148-156
Author(s):  
Keon Vin Park ◽  
Kyoung Ho Oh ◽  
Yong Jun Jeong ◽  
Jihye Rhee ◽  
Mun Soo Han ◽  
...  

Objectives. Prognosticating idiopathic sudden sensorineural hearing loss (ISSNHL) is an important challenge. In our study, a dataset was split into training and test sets and cross-validation was implemented on the training set, thereby determining the hyperparameters for machine learning models with high test accuracy and low bias. The effectiveness of the following five machine learning models for predicting the hearing prognosis in patients with ISSNHL after 1 month of treatment was assessed: adaptive boosting, K-nearest neighbor, multilayer perceptron, random forest (RF), and support vector machine (SVM).Methods. The medical records of 523 patients with ISSNHL admitted to Korea University Ansan Hospital between January 2010 and October 2017 were retrospectively reviewed. In this study, we analyzed data from 227 patients (recovery, 106; no recovery, 121) after excluding those with missing data. To determine risk factors, statistical hypothesis tests (e.g., the two-sample <i>t</i>-test for continuous variables and the chi-square test for categorical variables) were conducted to compare patients who did or did not recover. Variables were selected using an RF model depending on two criteria (mean decreases in the Gini index and accuracy).Results. The SVM model using selected predictors achieved both the highest accuracy (75.36%) and the highest F-score (0.74) on the test set. The RF model with selected variables demonstrated the second-highest accuracy (73.91%) and F-score (0.74). The RF model with the original variables showed the same accuracy (73.91%) as that of the RF model with selected variables, but a lower F-score (0.73). All the tested models, except RF, demonstrated better performance after variable selection based on RF.Conclusion. The SVM model with selected predictors was the best-performing of the tested prediction models. The RF model with selected predictors was the second-best model. Therefore, machine learning models can be used to predict hearing recovery in patients with ISSNHL.


Sign in / Sign up

Export Citation Format

Share Document