scholarly journals 215 Assessment of the Diagnostic Sensitivity and Specificity of Pain Biomarkers in Cattle Using Receiver Operating Characteristic Curves

2020 ◽  
Vol 98 (Supplement_3) ◽  
pp. 7-8
Author(s):  
Miriam S Martin ◽  
Michael Kleinhenz ◽  
Karen Schwartzkopf-Genswein ◽  
Johann Coetzee
Keyword(s):  
Diagnostic Accuracy ◽  
Receiver Operating Characteristic ◽  
Sensitivity And Specificity ◽  
Predictive Value ◽  
Roc Analysis ◽  
Operating Characteristic ◽  
Diagnostic Sensitivity ◽  
Diagnostic Sensitivity And Specificity ◽  
Good Diagnostic Accuracy ◽  
Receiver Operating

Abstract Biomarkers are commonly used to assess pain and analgesic drug efficacy in livestock. However, the diagnostic sensitivity and specificity of these biomarkers for different pain conditions over time have not been described. Receiver operating characteristic (ROC) curves are graphical plots that illustrate the diagnostic ability of a test as its discrimination threshold is varied. The objective of this analysis was to use area under the curve (AUC) values derived from ROC analysis to assess the predictive value of pain biomarkers at specific timepoints. The biomarkers included in the analysis were blood cortisol, salivary cortisol, hair cortisol, infrared thermography (IRT), mechanical nociceptive threshold (MNT), substance P, and outcomes from a pressure/force measurement system and visual analog scale. A total sample size of 7,992 biomarker outcomes were collected from 6 pain studies involving pain associated with castration, dehorning, lameness, and surgery were included in the analysis. Each study consisted of three treatments; pain, no pain, and analgesia. All statistics were performed using statistical software (JMP Pro 14.0, SAS Institute, Inc., Cary, NC). Results comparing analgesia verses pain yielded good diagnostic accuracy (AUC > 0.7; 95% CI: 0.40 to 0.99) for blood cortisol (timepoints 1.5, 2, and 6 hours); IRT (timepoints 6, 8, 12, and 72 hours); and MNT (timepoints 6, 25, and 49 hours). These results indicate that ROC analysis can be a useful indicator of the predictive value of pain biomarkers and certain timepoints seem to yield good diagnostic accuracy while many do not.

RECEIVER OPERATING CHARACTERISTIC ANALYSIS OF INTRAOPERATIVE PARATHYROID HORMONE MONITORING TO DETERMINE OPTIMUM SENSITIVITY AND SPECIFICITY: ANALYSIS OF 896 CASES

2019 ◽  
Vol 25 (11) ◽  
pp. 1117-1126
Author(s):  
Christina S. Foley ◽  
Edwina C. Moore ◽  
Mira Milas ◽  
Eren Berber ◽  
Joyce Shin ◽  
...  
Keyword(s):  
Computed Tomography ◽  
Parathyroid Hormone ◽  
Primary Hyperparathyroidism ◽  
Receiver Operating Characteristic ◽  
Sensitivity And Specificity ◽  
Roc Curve ◽  
Roc Analysis ◽  
Operating Characteristic ◽  
Intraoperative Parathyroid Hormone ◽  
Receiver Operating

Objective: While intraoperative parathyroid hormone (IOPTH) monitoring with a ≥50% drop commonly guides the extent of exploration for primary hyperparathyroidism (pHPT), receiver operating characteristic (ROC) analysis has not been performed to determine whether other criteria yield better sensitivity and specificity. The aim of this study was to identify the optimum percent change of IOPTH following removal of the abnormal parathyroid pathology, in order to predict biochemical cure. Secondary aims were to identify patient subgroups with increased area under the ROC curve (AUC) and the need for moderated criteria. Methods: A retrospective review was performed on patients undergoing primary parathyroid surgery for sporadic pHPT between 1999 and 2010 at a tertiary center for endocrine surgery. Eight hundred and ninety-six patients with primary hyperparathyroidism were included. Multigland disease (MGD) was defined as the intraoperative detection of more than 1 enlarged hypercellular gland or persistent disease after single gland excision. ROC analysis was used to determine the value with the best performance at predicting MGD, following bilateral exploration. Results: MGD was diagnosed in 174 patients (19.4%). ROC analysis demonstrated an AUC of 0.69. An IOPTH drop of 72% was the point of optimal discrimination with a sensitivity of 55% and specificity of 76% for predicting MGD. Subgroup analysis by preoperative calcium, preoperative PTH, localization studies, or pre- and post-excision IOPTH, did not identify any factors associated with an improved AUC. Conclusion: To our knowledge, this is the first study to use ROC analysis in a large patient cohort. An IOPTH drop of 72% was found to have optimal discriminating ability. We failed to identify a subset of patients for whom there was substantial improvement in the AUC, sensitivity, or specificity. Abbreviations: AUC = area under the ROC curve; BE = bilateral neck exploration; FE = focal parathyroid exploration; IOPTH = intraoperative parathyroid hormone; MGD = multigland disease; MIBI = Tc99m-sestamibi I-123 subtraction single-photon emission computed tomography/computed tomography; pHPT = primary hyperparathyroidism; ROC = receiver operating characteristic; SGD = single gland disease; US = surgeon-performed neck ultrasound

scholarly journals Standard echocardiography versus handheld echocardiography for the detection of subclinical rheumatic heart disease: a systematic review and meta-analysis of diagnostic accuracy

BMJ Open ◽  
2020 ◽  
Vol 10 (10) ◽  
pp. e038449
Author(s):  
Lisa Helen Telford ◽  
Leila Hussein Abdullahi ◽  
Eleanor Atieno Ochodo ◽  
Liesl Joanna Zuhlke ◽  
Mark Emmanuel Engel
Keyword(s):  
Systematic Review ◽  
Heart Disease ◽  
Diagnostic Accuracy ◽  
Receiver Operating Characteristic ◽  
Rheumatic Heart Disease ◽  
Operating Characteristic ◽  
Meta Analysis ◽  
Endemic Areas ◽  
Rheumatic Heart ◽  
Receiver Operating

ObjectiveTo summarise the accuracy of handheld echocardiography (HAND) which, if shown to be sufficiently similar to that of standard echocardiography (STAND), could usher in a new age of rheumatic heart disease (RHD) screening in endemic areas.DesignSystematic review and meta-analysis.Data sourcesPubMed, Scopus, EBSCOHost and ISI Web of Science were initially searched on 27 September 2017 and again on 3 March 2020 for studies published from 2012 onwards.Eligibility criteriaStudies assessing the accuracy of HAND compared with STAND when performed by an experienced cardiologist in conjunction with the 2012 World Heart Federation criteria among populations of children and adolescents living in endemic areas were included.Data extraction and synthesisTwo reviewers independently extracted data and assessed the methodological quality of included studies against review-specific Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 criteria. A meta-analysis using the hierarchical summary receiver operating characteristic model was conducted to produce summary results of sensitivity and specificity. Forest plots and scatter plots in receiver operating characteristic space in combination with subgroup analyses were used to investigate heterogeneity. Publication bias was not investigated.ResultsSix studies (N=4208) were included in the analysis. For any RHD detection, the pooled results from six studies were as follows: sensitivity: 81.56% (95% CI 76.52% to 86.61%) and specificity: 89.75% (84.48% to 95.01%). Meta-analytical results from five of the six included studies were as follows: sensitivity: 91.06% (80.46% to 100%) and specificity: 91.96% (85.57% to 98.36%) for the detection of definite RHD only and sensitivity: 62.01% (31.80% to 92.22%) and specificity: 82.33% (65.15% to 99.52%) for the detection of borderline RHD only.ConclusionsHAND displayed good accuracy for detecting definite RHD only and modest accuracy for detecting any RHD but demonstrated poor accuracy for the detection of borderline RHD alone. Findings from this review provide some evidence for the potential of HAND to increase access to echocardiographic screening for RHD in resource-limited and remote settings; however, further research into feasibility and cost-effectiveness of wide-scale screening is still needed.PROSPERO registration numberCRD42016051261.

scholarly journals Interaction of MRE11 and Clinicopathologic Characteristics in Recurrence of Breast Cancer: Individual and Cumulated Receiver Operating Characteristic Analyses

2017 ◽  
Vol 2017 ◽  
pp. 1-9 ◽  
Author(s):  
Cheng-Hong Yang ◽  
Sin-Hua Moi ◽  
Li-Yeh Chuang ◽  
Shyng-Shiou F. Yuan ◽  
Ming-Feng Hou ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Receiver Operating Characteristic ◽  
Roc Analysis ◽  
Operating Characteristic ◽  
Growth Factor Receptor ◽  
Cancer Recurrence ◽  
Breast Cancer Recurrence ◽  
Prognostic Indicators ◽  
Clinicopathologic Characteristics ◽  
Receiver Operating

The interaction between the meiotic recombination 11 homolog A (MRE11) oncoprotein and breast cancer recurrence status remains unclear. The aim of this study was to assess the interaction between MRE11 and clinicopathologic variables in breast cancer. A dataset for 254 subjects with breast cancer (220 nonrecurrent and 34 recurrent) was used in individual and cumulated receiver operating characteristic (ROC) analyses of MRE11 and 12 clinicopathologic variables for predicting breast cancer recurrence. In individual ROC analysis, the area under curve (AUC) for each predictor of breast cancer recurrence was smaller than 0.7. In cumulated ROC analysis, however, the AUC value for each predictor improved. Ten relevant variables in breast cancer recurrence were used to find the optimal prognostic indicators. The presence of any six of the following ten variables had a high (79%) sensitivity and a high (70%) specificity for predicting breast cancer recurrence: tumor size ≥ 2.4 cm, tumor stage II/III, therapy other than hormone therapy, age ≥ 52 years, MRE11 positive cells > 50%, body mass index ≥ 24, lymph node metastasis, positivity for progesterone receptor, positivity for epidermal growth factor receptor, and negativity for estrogen receptor. In conclusion, this study revealed that these 10 clinicopathologic variables are the minimum discriminators needed for optimal discriminant effectiveness in predicting breast cancer recurrence.

scholarly journals Age-Adjusted Endothelial Activation and Stress Index for Coronavirus Disease 2019 at Admission Is a Reliable Predictor for 28-Day Mortality in Hospitalized Patients With Coronavirus Disease 2019

2021 ◽  
Vol 8 ◽  
Author(s):  
Felipe Pérez-García ◽  
Rebeca Bailén ◽  
Juan Torres-Macho ◽  
Amanda Fernández-Rodríguez ◽  
Maria Ángeles Jiménez-Sousa ◽  
...  
Keyword(s):  
Positive Predictive Value ◽  
Receiver Operating Characteristic ◽  
Negative Predictive Value ◽  
Predictive Value ◽  
Operating Characteristic ◽  
Predictive Performance ◽  
Endothelial Activation ◽  
Stress Index ◽  
Reliable Predictor ◽  
Receiver Operating

Background: Endothelial Activation and Stress Index (EASIX) predict death in patients undergoing allogeneic hematopoietic stem cell transplantation who develop endothelial complications. Because coronavirus disease 2019 (COVID-19) patients also have coagulopathy and endotheliitis, we aimed to assess whether EASIX predicts death within 28 days in hospitalized COVID-19 patients.Methods: We performed a retrospective study on COVID-19 patients from two different cohorts [derivation (n = 1,200 patients) and validation (n = 1,830 patients)]. The endpoint was death within 28 days. The main factors were EASIX [(lactate dehydrogenase * creatinine)/thrombocytes] and aEASIX-COVID (EASIX * age), which were log2-transformed for analysis.Results: Log2-EASIX and log2-aEASIX-COVID were independently associated with an increased risk of death in both cohorts (p < 0.001). Log2-aEASIX-COVID showed a good predictive performance for 28-day mortality both in the derivation cohort (area under the receiver-operating characteristic = 0.827) and in the validation cohort (area under the receiver-operating characteristic = 0.820), with better predictive performance than log2-EASIX (p < 0.001). For log2 aEASIX-COVID, patients with low/moderate risk (<6) had a 28-day mortality probability of 5.3% [95% confidence interval (95% CI) = 4–6.5%], high (6–7) of 17.2% (95% CI = 14.7–19.6%), and very high (>7) of 47.6% (95% CI = 44.2–50.9%). The cutoff of log2 aEASIX-COVID = 6 showed a positive predictive value of 31.7% and negative predictive value of 94.7%, and log2 aEASIX-COVID = 7 showed a positive predictive value of 47.6% and negative predictive value of 89.8%.Conclusion: Both EASIX and aEASIX-COVID were associated with death within 28 days in hospitalized COVID-19 patients. However, aEASIX-COVID had significantly better predictive performance than EASIX, particularly for discarding death. Thus, aEASIX-COVID could be a reliable predictor of death that could help to manage COVID-19 patients.

scholarly journals Bayesian Sensitivity-Specificity and ROC Analysis for Finding Key Drivers

2021 ◽  
Vol 19 (1) ◽  
pp. 2-15
Author(s):  
Stan Lipovetsky ◽  
Michael W. Conklin
Keyword(s):  
Receiver Operating Characteristic ◽  
Statistical Modeling ◽  
Roc Analysis ◽  
Operating Characteristic ◽  
Regression Modeling ◽  
Modeling And Analysis ◽  
Numerical Comparisons ◽  
Key Drivers ◽  
Sensitivity Specificity ◽  
Receiver Operating

Finding key drivers in regression modeling via Bayesian Sensitivity-Specificity and Receiver Operating Characteristic is suggested, and clearly interpretable results are obtained. Numerical comparisons with other techniques show that this methodology can be useful in practical statistical modeling and analysis helping to researchers and managers in making meaningful decisions.

scholarly journals Accuracy and adequacy of waist circumference cut-off points currently recommended in Brazilian adults

2013 ◽  
Vol 17 (4) ◽  
pp. 861-869 ◽  
Author(s):  
Carolina Avila Vianna ◽  
Rogério da Silva Linhares ◽  
Renata Moraes Bielemann ◽  
Eduardo Coelho Machado ◽  
David Alejandro González-Chica ◽  
...  
Keyword(s):  
Cardiovascular Risk ◽  
Waist Circumference ◽  
Receiver Operating Characteristic ◽  
Sensitivity And Specificity ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Predictive Ability ◽  
Youden Index ◽  
Southern Brazil ◽  
Receiver Operating

AbstractObjectiveTo evaluate the adequacy and accuracy of cut-off values currently recommended by the WHO for assessment of cardiovascular risk in southern Brazil.DesignPopulation-based study aimed at determining the predictive ability of waist circumference for cardiovascular risk based on the use of previous medical diagnosis for hypertension, diabetes mellitus and/or dyslipidaemia. Descriptive analysis was used for the adequacy of current cut-off values of waist circumference, receiver operating characteristic curves were constructed and the most accurate criteria according to the Youden index and points of optimal sensitivity and specificity were identified.SettingPelotas, southern Brazil.SubjectsIndividuals (n2112) aged ≥20 years living in the city were selected by multistage sampling, since these individuals did not report the presence of previous myocardial infarction, angina pectoris or stroke.ResultsThe cut-off values currently recommended by WHO were more appropriate in men than women, with overestimation of cardiovascular risk in women. The area under the receiver operating characteristic curve showed moderate predictive ability of waist circumference in men (0·74, 95 % CI 0·71, 0·76) and women (0·75, 95 % CI 0·73, 0·77). The method of optimal sensitivity and specificity showed better performance in assessing the accuracy, identifying the values of 95 cm in men and 87 cm in women as the best cut-off values of waist circumference to assess cardiovascular risk.ConclusionsThe cut-off values currently recommended for waist circumference are not suitable for women. Longitudinal studies should be conducted to evaluate the consistency of the findings.

Sign in / Sign up

Export Citation Format

Share Document