The Diagnostic Efficacy of the American College of Radiology (ACR) Thyroid Imaging Report and Data System (TI-RADS) and the American Thyroid Association (ATA) Risk Stratification Systems for Thyroid Nodules

Background. This study is aimed at evaluating the diagnostic efficacy of ultrasound-based risk stratification for thyroid nodules in the American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS) and the American Thyroid Association (ATA) risk stratification systems. Methods. 286 patients with thyroid cancer were included in the tumor group, with 259 nontumor cases included in the nontumor group. The ACR TI-RADS and ATA risk stratification systems assessed all thyroid nodules for malignant risks. The diagnostic effect of ACR and ATA risk stratification system for thyroid nodules was evaluated by receiver operating characteristic (ROC) analysis using postoperative pathological diagnosis as the gold standard. Results. The distributions and mean scores of ACR and ATA rating risk stratification were significantly different between the tumor and nontumor groups. The lesion diameter > 1 cm subgroup had higher malignant ultrasound feature rates detected and ACR and ATA scores. A significant difference was not found in the ACR and ATA scores between patients with or without Hashimoto’s disease. The area under the receiver operating curve (AUC) for the ACR TI-RADS and the ATA systems was 0.891 and 0.896, respectively. The ACR had better specificity (0.90) while the ATA system had higher sensitivity (0.92), with both scenarios having almost the same overall diagnostic accuracy (0.84). Conclusion. Both the ACR TI-RADS and the ATA risk stratification systems provide a clinically feasible thyroid malignant risk classification, with high thyroid nodule malignant risk diagnostic efficacy.

Clinical Significance and Potential Role of LSM4 Overexpression in Hepatocellular Carcinoma: An Integrated Analysis Based on Multiple Databases

Background: Hepatocellular carcinoma (HCC) is a solid tumor with high recurrence rate and high mortality. It is crucial to discover available biomarkers to achieve early diagnosis and improve the prognosis. The effect of LSM4 in HCC still remains unrevealed. Our study is dedicated to exploring the expression of LSM4 in HCC, demonstrating its clinical significance and potential molecular mechanisms.Methods: Clinical information and LSM4 expression values of HCC were obtained from Gene Expression Omnibus (GEO) and The Cancer Genome Atlas (TCGA) databases. Survival analysis and receiver operating characteristic (ROC) curve analysis were applied to evaluate the prognostic and diagnostic significance of LSM4. Calculating pooled standardized mean difference (SMD) and performing summary receiver operating characteristic (sROC) curve analysis to further determine its expression status and diagnostic significance. LSM4-related co-expressed genes (CEGs) were obtained and explored their clinical significance in HCC. LSM4-associated pathways were identified through Gene set enrichment analysis (GSEA).Results: Up-regulated LSM4 was detected in HCC tissues (SMD = 1.56, 95% CI: 1.29–1.84) and overexpressed LSM4 had excellent distinguishing ability (AUC = 0.91, 95% CI: 0.88–0.93). LSM4 was associated with clinical stage, tumor grade, and lymph node metastasis status (p < 0.05). Survival analysis showed that high LSM4 expression was related to poor overall survival (OS) of HCC patients. Cox regression analysis suggested that high LSM4 expression may be an independent risk factor for HCC. We obtained nine up-regulated CEGs of LSM4 in HCC tissues, and six CEGs had good prognostic and diagnostic significance. GSEA analysis showed that up-regulated LSM4 was closely related to the cell cycle, cell replication, focal adhesion, and several metabolism-associated pathways, including fatty acid metabolism.Conclusion: Overexpressed LSM4 may serve as a promising diagnostic and prognostic biomarker of HCC. Besides, LSM4 may play a synergistic effect with CEGs in promoting the growth and metastasis of HCC cells via regulating crucial pathways such as cell cycle, focal adhesion, and metabolism-associated pathways.

Preoperative prediction of microvascular invasion (MVI) in hepatocellular carcinoma based on kupffer phase radiomic features of sonazoid contrast-enhanced ultrasound (SCEUS): A prospective study

OBJECTIVES: To establish and evaluate a machine learning radiomics model based on grayscale and Sonazoid contrast enhanced ultrasound images for the preoperative prediction of microvascular invasion (MVI) in hepatocellular carcinoma (HCC) patients. METHODS: 100 cases of histopathological confirmed HCC lesions were prospectively included. Regions of interest were segmented on both grayscale and Kupffer phase of Sonazoid contrast enhanced (CEUS) images. Radiomic features were extracted from tumor region and region containing 5 mm of peritumoral liver tissues. Maximum relevance minimum redundancy (MRMR) and Least Absolute Shrinkage and Selection Operator (LASSO) were used for feature selection and Support Vector Machine (SVM) classifier was trained for radiomic signature calculation. Radiomic signatures were incorporated with clinical variables using univariate-multivariate logistic regression for the final prediction of MVI. Receiver operating characteristic curves, calibration curves and decision curve analysis were used to evaluate model’s predictive performance of MVI. RESULTS: Age were the only clinical variable significantly associated with MVI. Radiomic signature derived from Kupffer phase images of peritumoral liver tissues (kupfferPT) displayed a significantly better performance with an area under the receiver operating characteristic curve (AUROC) of 0.800 (95% confidence interval: 0.667, 0.834), the final prediction model using Age and kupfferPT achieved an AUROC of 0.804 (95% CI: 0.723, 0.878), accuracy of 75.0%, sensitivity of 87.5% and specificity of 69.1%. CONCLUSIONS: Radiomic model based on Kupffer phase ultrasound images of tissue adjacent to HCC lesions showed an observable better predictive value compared to grayscale images and has potential value to facilitate preoperative identification of HCC patients at higher risk of MVI.

“Emergency Room Evaluation and Recommendations” (ER2) Tool for the Screening of Older Emergency Department Visitors With Major Neurocognitive Disorders: Results From the ER2 Database

Purpose: The Emergency Room Evaluation and Recommendation (ER2) is an application in the electronic medical file of patients visiting the Emergency Department (ED) of the Jewish General Hospital (JGH; Montreal, Quebec, Canada). It screens for older ED visitors at high risk of undesirable events. The aim of this study is to examine the performance criteria (i.e., sensitivity, specificity, positive predictive value [PPV], negative predictive value [NPV], positive likelihood ratio [LR+], negative likelihood ratio [LR-] and area under the receiver operating characteristic curve [AUROC]) of the ER2 high-risk level and its “temporal disorientation” item alone to screen for major neurocognitive disorders in older ED visitors at the JGH.Methods: Based on a cross-sectional design, 999 older adults (age 84.9 ± 5.6, 65.1% female) visiting the ED of the JGH were selected from the ER2 database. ER2 was completed upon the patients' arrival at the ED. The outcomes were ER2's high-risk level, the answer to ER2's temporal disorientation item (present vs. absent), and the diagnosis of major neurocognitive disorders (yes vs. no) which was confirmed when it was present in a letter or other files signed by a physician.Results: The sensitivities of both ER2's high-risk level and temporal disorientation item were high (≥0.91). Specificity, the PPV, LR+, and AROC were higher for the temporal disorientation item compared to ER2's high-risk level, whereas a highest sensitivity, LR-, and NPV were obtained with the ER2 high-risk level. Both area under the receiver operating characteristic curves were high (0.71 for ER2's high-risk level and 0.82 for ER2 temporal disorientation item). The odds ratios (OR) of ER2's high-risk level and of temporal disorientation item for the diagnosis of major neurocognitive disorders were positive and significant with all OR above 18, the highest OR being reported for the temporal disorientation item in the unadjusted model [OR = 26.4 with 95% confidence interval (CI) = 17.7–39.3].Conclusion: Our results suggest that ER2 and especially its temporal disorientation item may be used to screen for major neurocognitive disorders in older ED users.

Diagnostic accuracy of anthropometric indices for discriminating elevated blood pressure in pediatric population: a systematic review and a meta-analysis

Background Childhood obesity is more likely to increase the chance of many adult health problems. Numerous studies have shown obese children to be more prone to elevated blood pressure (BP) and hypertension. It is important to identify an obesity anthropometric index with good discriminatory power for them in pediatric population. Methods MEDLINE/PubMed, Web of Science, and Cochrane databases were retrieved comprehensively for eligible studies on childhood obesity and hypertension/elevated BP through June 2021. The systematic review and meta-analysis of studies used receiver operating characteristics (ROC) curves for evaluating the discriminatory power of body mass index (BMI), waist circumference (WC), and waist-to-height ratio (WHtR) in distinguishing children with elevated BP and hypertension. Results 21 cross-sectional studies involving 177,943 children and 3–19 years of age were included in our study. Meta-analysis showed that the pooled area under the reporting receiver-operating characteristic curves (AUC) and 95% confidence intervals (CIs) for BMI, WC, and WHtR to detect hypertension of boys were 0.68 (0.64, 0.72), 0.69 (0.64, 0.74), 0.67 (0.63, 0.71), for elevated BP, the pooled AUCs and 95% CIs were 0.67 (0.61, 0.73), 0.65 (0.58, 0.73), 0.65 (0.61, 0.71). The pooled AUCs and 95% CIs for BMI, WC and WHtR of predicting hypertension were 0.70 (0.66, 0.75), 0.69 (0.64, 0.75), 0.67 (0.63, 0.72) in girls, the pooled AUCs and 95% CIs of predicting elevated BP were 0.63 (0.61, 0.65), 0.62 (0.60, 0.65), 0.62 (0.60, 0.64) respectively. There was no anthropometric index was statistically superior in identifying hypertension and elevated BP, however, the accuracy of BMI predicting hypertension was significantly higher than elevated BP in girls (P < 0.05). The subgroup analysis for the comparison of BMI, WC and WHtR was performed, no significant difference in predicting hypertension and elevated BP in pediatric population. Conclusions This systematic review showed that no anthropometric index was superior in identifying hypertension and elevated BP in pediatric population. While compared with predicting elevated BP, all the indicators showed superiority in predicting hypertension in children, the difference was especially obvious in girls. A better anthropometric index should be explored to predict children’s early blood pressure abnormalities.

Validation and modification of HEART score components for patients with chest pain in the emergency department

Objective This study aimed to clarify the relative prognostic value of each History, Electrocardiography, Age, Risk Factors, and Troponin (HEART) score component for major adverse cardiac events (MACE) within 3 months and validate the modified HEART (mHEART) score.Methods This study evaluated the HEART score components for patients with chest symptoms visiting the emergency department from November 19, 2018 to November 19, 2019. All components were evaluated using logistic regression analysis and the scores for HEART, mHEART, and Thrombolysis in Myocardial Infarction (TIMI) were determined using the receiver operating characteristics curve.Results The patients were divided into a derivation (809 patients) and a validation group (298 patients). In multivariate analysis, age did not show statistical significance in the detection of MACE within 3 months and the mHEART score was calculated after omitting the age component. The areas under the receiver operating characteristics curves for HEART, mHEART and TIMI scores in the prediction of MACE within 3 months were 0.88, 0.91, and 0.83, respectively, in the derivation group; and 0.88, 0.91, and 0.81, respectively, in the validation group. When the cutoff value for each scoring system was determined for the maintenance of a negative predictive value for a MACE rate >99%, the mHEART score showed the highest sensitivity, specificity, positive predictive value, and negative predictive value (97.4%, 54.2%, 23.7%, and 99.3%, respectively).Conclusion Our study showed that the mHEART score better detects short-term MACE in high-risk patients and ensures the safe disposition of low-risk patients than the HEART and TIMI scores.

Machine Learning-Based Prediction of Myocardial Recovery in Patients With Left Ventricular Assist Device Support

Background: Prospective studies demonstrate that aggressive pharmacological therapy combined with pump speed optimization may result in myocardial recovery in larger numbers of patients supported with left ventricular assist device (LVAD). This study sought to determine whether the use of machine learning (ML) based models predict LVAD patients with myocardial recovery resulting in pump explant. Methods: A total of 20 270 adult patients with a durable continuous-flow LVAD in the INTERMACS registry (Interagency Registry for Mechanically Assisted Circulatory Support) were included in the study. Ninety-eight raw clinical variables were screened using the least absolute shrinkage and selection operator for selection of features associated with LVAD-induced myocardial recovery. ML models were developed in the training data set (70%) and were assessed in the validation data set (30%) by receiver operating curve and Kaplan-Meier analysis. Results: Least absolute shrinkage and selection operator identified 28 unique clinical features associated with LVAD-induced myocardial recovery, including age, cause of heart failure, psychosocial risk factors, laboratory values, cardiac rate and rhythm, and echocardiographic indices. ML models achieved area under the receiver operating curve of 0.813 to 0.824 in the validation data set outperforming logistic regression-based new INTERMACS recovery risk score (area under the receiver operating curve of 0.796) and previously established LVAD recovery risk scores (INTERMACS Cardiac Recovery Score and INTERMACS Recovery Score by Topkara et al.) with area under the receiver operating curve of 0.744 and 0.748 ( P <0.05). Patients who were predicted to recover by ML models demonstrated a significantly higher incidence of myocardial recovery resulting in LVAD explant in the validation cohort compared with those who were not predicted to recover (18.8% versus 2.6% at 4 years of pump support). Conclusions: ML can be a valuable tool to identify subsets of LVAD patients who may be more likely to respond to myocardial recovery protocols.

Artificial Neural Network Analysis-Based Immune-Related Signatures of Primary Non-Response to Infliximab in Patients With Ulcerative Colitis

Infliximab (IFX) is an effective medication for ulcerative colitis (UC) patients. However, one-third of UC patients show primary non-response (PNR) to IFX. Our study analyzed three Gene Expression Omnibus (GEO) datasets and used the RobustRankAggreg (RRA) algorithm to assist in identifying differentially expressed genes (DEGs) between IFX responders and non-responders. Then, an artificial intelligence (AI) technology, artificial neural network (ANN) analysis, was applied to validate the predictive value of the selected genes. The results showed that the combination of CDX2, CHP2, HSD11B2, RANK, NOX4, and VDR is a good predictor of patients’ response to IFX therapy. The range of repeated overall area under the receiver-operating characteristic curve (AUC) was 0.850 ± 0.103. Moreover, we used an independent GEO dataset to further verify the value of the six DEGs in predicting PNR to IFX, which has a range of overall AUC of 0.759 ± 0.065. Since protein detection did not require fresh tissue and can avoid multiple biopsies, our study tried to discover whether the key information, analyzed by RNA levels, is suitable for protein detection. Therefore, immunohistochemistry (IHC) staining of colonic biopsy tissues from UC patients treated with IFX and a receiver-operating characteristic (ROC) analysis were used to further explore the clinical application value of the six DEGs at the protein level. The IHC staining of colon tissues from UC patients confirmed that VDR and RANK are significantly associated with IFX efficacy. Total IHC scores lower than 5 for VDR and lower than 7 for RANK had an AUC of 0.828 (95% CI: 0.665–0.991, p = 0.013) in predicting PNR to IFX. Collectively, we identified a predictive RNA model for PNR to IFX and explored an immune-related protein model based on the RNA model, including VDR and RANK, as a predictor of IFX non-response, and determined the cutoff value. The result showed a connection between the RNA and protein model, and both two models were available. However, the composite signature of VDR and RANK is more conducive to clinical application, which could be used to guide the preselection of patients who might benefit from pharmacological treatment in the future.

Considerations on the region of interest in the ROC space

Receiver Operating Characteristic curves have been widely used to represent the performance of diagnostic tests. The corresponding area under the curve, widely used to evaluate their performance quantitatively, has been criticized in several respects. Several proposals have been introduced to improve area under the curve by taking into account only specific regions of the Receiver Operating Characteristic space, that is, the plane to which Receiver Operating Characteristic curves belong. For instance, a region of interest can be delimited by setting specific thresholds for the true positive rate or the false positive rate. Different ways of setting the borders of the region of interest may result in completely different, even opposing, evaluations. In this paper, we present a method to define a region of interest in a rigorous and objective way, and compute a partial area under the curve that can be used to evaluate the performance of diagnostic tests. The method was originally conceived in the Software Engineering domain to evaluate the performance of methods that estimate the defectiveness of software modules. We compare this method with previous proposals. Our method allows the definition of regions of interest by setting acceptability thresholds on any kind of performance metric, and not just false positive rate and true positive rate: for instance, the region of interest can be determined by imposing that [Formula: see text] (also known as the Matthews Correlation Coefficient) is above a given threshold. We also show how to delimit the region of interest corresponding to acceptable costs, whenever the individual cost of false positives and false negatives is known. Finally, we demonstrate the effectiveness of the method by applying it to the Wisconsin Breast Cancer Data. We provide Python and R packages supporting the presented method.

Prediction of extubation failure in the paediatric cardiac ICU using machine learning and high-frequency physiologic data

Background: Cardiac intensivists frequently assess patient readiness to wean off mechanical ventilation with an extubation readiness trial despite it being no more effective than clinician judgement alone. We evaluated the utility of high-frequency physiologic data and machine learning for improving the prediction of extubation failure in children with cardiovascular disease. Methods: This was a retrospective analysis of clinical registry data and streamed physiologic extubation readiness trial data from one paediatric cardiac ICU (12/2016-3/2018). We analysed patients’ final extubation readiness trial. Machine learning methods (classification and regression tree, Boosting, Random Forest) were performed using clinical/demographic data, physiologic data, and both datasets. Extubation failure was defined as reintubation within 48 hrs. Classifier performance was assessed on prediction accuracy and area under the receiver operating characteristic curve. Results: Of 178 episodes, 11.2% (N = 20) failed extubation. Using clinical/demographic data, our machine learning methods identified variables such as age, weight, height, and ventilation duration as being important in predicting extubation failure. Best classifier performance with this data was Boosting (prediction accuracy: 0.88; area under the receiver operating characteristic curve: 0.74). Using physiologic data, our machine learning methods found oxygen saturation extremes and descriptors of dynamic compliance, central venous pressure, and heart/respiratory rate to be of importance. The best classifier in this setting was Random Forest (prediction accuracy: 0.89; area under the receiver operating characteristic curve: 0.75). Combining both datasets produced classifiers highlighting the importance of physiologic variables in determining extubation failure, though predictive performance was not improved. Conclusion: Physiologic variables not routinely scrutinised during extubation readiness trials were identified as potential extubation failure predictors. Larger analyses are necessary to investigate whether these markers can improve clinical decision-making.