scholarly journals Risk assessment and receiver operating characteristic curves

2011 ◽  
Vol 42 (5) ◽  
pp. 895-898 ◽  
Author(s):  
G. Szmukler ◽  
B. Everitt ◽  
M. Leese
Keyword(s):  
Risk Assessment ◽  
Clinical Practice ◽  
Receiver Operating Characteristic ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
Assessment Instruments ◽  
Receiver Operating Characteristic Curves ◽  
Operating Characteristic Curve ◽  
Receiver Operating

Risk assessment is now regarded as a necessary competence in psychiatry. The area under the curve (AUC) statistic of the receiver operating characteristic curve is increasingly offered as the main evidence for accuracy of risk assessment instruments. But, even a highly statistically significant AUC is of limited value in clinical practice.

A conditional approach for the receiver operating characteristic curve construction to evaluate diagnostic test performance in a family-matched case–control design

2021 ◽  
pp. 096228022199595
Author(s):  
Yalda Zarnegarnia ◽  
Shari Messinger
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Case Control ◽  
Paired Data ◽  
Characteristic Curves ◽  
Receiver Operating Characteristic Curves ◽  
Operating Characteristic Curve ◽  
Receiver Operating

Receiver operating characteristic curves are widely used in medical research to illustrate biomarker performance in binary classification, particularly with respect to disease or health status. Study designs that include related subjects, such as siblings, usually have common environmental or genetic factors giving rise to correlated biomarker data. The design could be used to improve detection of biomarkers informative of increased risk, allowing initiation of treatment to stop or slow disease progression. Available methods for receiver operating characteristic construction do not take advantage of correlation inherent in this design to improve biomarker performance. This paper will briefly review some developed methods for receiver operating characteristic curve estimation in settings with correlated data from case–control designs and will discuss the limitations of current methods for analyzing correlated familial paired data. An alternative approach using conditional receiver operating characteristic curves will be demonstrated. The proposed approach will use information about correlation among biomarker values, producing conditional receiver operating characteristic curves that evaluate the ability of a biomarker to discriminate between affected and unaffected subjects in a familial paired design.

A simple method to estimate the time-dependent receiver operating characteristic curve and the area under the curve with right censored data

2016 ◽  
Vol 27 (8) ◽  
pp. 2264-2278 ◽  
Author(s):  
Liang Li ◽  
Tom Greene ◽  
Bo Hu
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Sensitivity And Specificity ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Disease Onset ◽  
Area Under The Curve ◽  
Time Dependent ◽  
Operating Characteristic Curve ◽  
Receiver Operating

The time-dependent receiver operating characteristic curve is often used to study the diagnostic accuracy of a single continuous biomarker, measured at baseline, on the onset of a disease condition when the disease onset may occur at different times during the follow-up and hence may be right censored. Due to right censoring, the true disease onset status prior to the pre-specified time horizon may be unknown for some patients, which causes difficulty in calculating the time-dependent sensitivity and specificity. We propose to estimate the time-dependent sensitivity and specificity by weighting the censored data by the conditional probability of disease onset prior to the time horizon given the biomarker, the observed time to event, and the censoring indicator, with the weights calculated nonparametrically through a kernel regression on time to event. With this nonparametric weighting adjustment, we derive a novel, closed-form formula to calculate the area under the time-dependent receiver operating characteristic curve. We demonstrate through numerical study and theoretical arguments that the proposed method is insensitive to misspecification of the kernel bandwidth, produces unbiased and efficient estimators of time-dependent sensitivity and specificity, the area under the curve, and other estimands from the receiver operating characteristic curve, and outperforms several other published methods currently implemented in R packages.

scholarly journals COMPARISION OF BINARY DIAGNOSTIC PREDICTORS USING ENTROPY

2018 ◽  
Vol 6 (1) ◽  
pp. 440-447
Author(s):  
Kathare Alfred ◽  
Otieno Argwings ◽  
Kimeli Victor
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Gold Standard ◽  
Large Scale ◽  
Operating Characteristic ◽  
Standard Procedure ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
Operating Characteristic Curve ◽  
Receiver Operating

The use of gold standard procedures in screening may be costly, risky or even unethical. It is, therefore, not admissible for large scale application. In this case, a more acceptable diagnostic predictor is applied to a sample of subjects alongside a gold standard procedure. The performance of the predictor is then evaluated using Receiver Operating Characteristic curve. The area under the curve, then, provides a summative measure of the performance of the predictor. The Receiver Operating Characteristic curve is a trade-off between sensitivity and specificity which in most cases are of different clinical significance. Also, the area under the curve is criticized for lack of coherent interpretation. In this study, we proposed the use of entropy as a summary index measure of uncertainty to compare diagnostic predictors. Noting that a diseased subject who is truly identified with the disease at a lower cut-off will also be identified at a higher cut-off, we substituted time variable in survival analysis for cut-offs in a binary predictor. We then derived the entropy of the functions of diagnostic predictors. Application of the procedure to real data showed that entropy was a strong measure for quantifying the amount of uncertainty engulfed in a set of cut-offs of binary diagnostic predictor.

scholarly journals Smooth time-dependent receiver operating characteristic curve estimators

2017 ◽  
Vol 27 (3) ◽  
pp. 651-674 ◽  
Author(s):  
Pablo Martínez-Camblor ◽  
Juan Carlos Pardo-Fernández
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Time Dependent ◽  
Density Estimator ◽  
Characteristic Curves ◽  
Receiver Operating Characteristic Curves ◽  
Operating Characteristic Curve ◽  
Receiver Operating

The receiver operating characteristic curve is a popular graphical method often used to study the diagnostic capacity of continuous (bio)markers. When the considered outcome is a time-dependent variable, two main extensions have been proposed: the cumulative/dynamic receiver operating characteristic curve and the incident/dynamic receiver operating characteristic curve. In both cases, the main problem for developing appropriate estimators is the estimation of the joint distribution of the variables time-to-event and marker. As usual, different approximations lead to different estimators. In this article, the authors explore the use of a bivariate kernel density estimator which accounts for censored observations in the sample and produces smooth estimators of the time-dependent receiver operating characteristic curves. The performance of the resulting cumulative/dynamic and incident/dynamic receiver operating characteristic curves is studied by means of Monte Carlo simulations. Additionally, the influence of the choice of the required smoothing parameters is explored. Finally, two real-applications are considered. An R package is also provided as a complement to this article.

scholarly journals Efficient nonparametric confidence bands for receiver operating-characteristic curves

2016 ◽  
Vol 27 (6) ◽  
pp. 1892-1908 ◽  
Author(s):  
Pablo Martínez-Camblor ◽  
Sonia Pérez-Fernández ◽  
Norberto Corral
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Confidence Regions ◽  
Confidence Bands ◽  
Receiver Operating Characteristic Curves ◽  
Diagnostic Capacity ◽  
Operating Characteristic Curve ◽  
Receiver Operating

Receiver operating-characteristic curve is a popular graphical method frequently used in order to study the diagnostic capacity of continuous (bio)markers. In spite of the existence of a huge number of papers devoted to both theoretical and practical aspects of this topic, the construction of confidence bands has had little impact in the specialized literature. As far as the authors know, in the CRAN there are only three R packages providing receiver operating-characteristic curve confidence regions: plotROC, pROC and fbroc. This work tries to fill this gap studying and proposing a new nonparametric method to build confidence bands for both the standard receiver operating-characteristic curve and its generalization for nonmonotone relationships. The behavior of the proposed procedure is studied via Monte Carlo simulations and the methodology is applied on two real-world biomedical problems. In addition, an R function to compute the proposed and some of the previously existing methodologies is provided as online supplementary material.

scholarly journals Prediction of Advisability of Returning Home Using the Home Care Score

2015 ◽  
Vol 2015 ◽  
pp. 1-6 ◽  
Author(s):  
Akiyoshi Matsugi ◽  
Keisuke Tani ◽  
Yoshiki Tamaru ◽  
Nami Yoshioka ◽  
Akira Yamashita ◽  
...  
Keyword(s):  
Home Care ◽  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Operating Characteristic ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
Functional Independence Measure ◽  
Functional Independence ◽  
Operating Characteristic Curve ◽  
Receiver Operating

Purpose. The aim of this study was to assess whether the home care score (HCS), which was developed by the Ministry of Health and Welfare in Japan in 1992, is useful for the prediction of advisability of home care.Methods. Subjects living at home and in assisted-living facilities were analyzed. Binominal logistic regression analyses, using age, sex, the functional independence measure score, and the HCS, along with receiver operating characteristic curve analyses, were conducted.Findings/Conclusions. Only HCS was selected for the regression equation. Receiver operating characteristic curve analysis revealed that the area under the curve (0.9), sensitivity (0.82), specificity (0.83), and positive predictive value (0.84) for HCS were higher than those for the functional independence measure, indicating that the HCS is a powerful predictor for advisability of home care.Clinical Relevance. Comprehensive measurements of the condition of provided care and the activities of daily living of the subjects, which are included in the HCS, are required for the prediction of advisability of home care.

scholarly journals Comparative Analysis of Anterior Segment Parameters in Normal and Keratoconus Eyes Generated by Scheimpflug Tomography

2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Faik Orucoglu ◽  
Ebru Toker
Keyword(s):  
Receiver Operating Characteristic Curve ◽  
Receiver Operating Characteristic ◽  
Sensitivity And Specificity ◽  
Operating Characteristic ◽  
Predictive Accuracy ◽  
Characteristic Curve ◽  
Anterior Segment ◽  
Area Under The Curve ◽  
Operating Characteristic Curve ◽  
Receiver Operating

Purpose. To assess and compare the anterior and posterior corneal surface parameters, keratoconus indices, thickness profile data, and data from enhanced elevation maps of keratoconic and normal corneas with the Pentacam Scheimpflug corneal tomography and to determine the sensitivity and specificity of these parameters in discriminating keratoconus from normal eyes.Methods. The study included 656 keratoconus eyes and 515 healthy eyes with a mean age of30.95±9.25and32.90±14.78years, respectively. Forty parameters obtained from the Pentacam tomography were assessed by the receiver operating characteristic curve analysis for their efficiency.Results. Receiver operating characteristic curve analyses showed excellent predictive accuracy (area under the curve, ranging from 0.914 to 0.972) for 21 of the 40 parameters evaluated. Among all parameters indices of vertical asymmetry, keratoconus index, front elevation at thinnest location, back elevation at thinnest location, Ambrósio Relational Thickness (ARTmax), deviation of average pachymetric progression, deviation of ARTmax, and total deviation showed excellent (>90%) sensitivity and specificity in addition to excellent area under the receiver operating characteristic curve (AUROC).Conclusions. Parameters derived from the topometric and Belin-Ambrósio enhanced ectasia display maps very effectively discriminate keratoconus from normal corneas with excellent sensitivity and specificity.

Sign in / Sign up

Export Citation Format

Share Document