scholarly journals Reliability of Oncology Value Framework Outputs: Concordance Between Independent Research Groups

2018 ◽  
Vol 2 (3) ◽  
Author(s):  
Joseph C Del Paggio ◽  
Sierra Cheng ◽  
Christopher M Booth ◽  
Matthew C Cheung ◽  
Kelvin K W Chan

Abstract Research groups are increasingly utilizing value frameworks, but little is known of their reliability. To assess framework concordance and interrater reliability between two major value frameworks currently in use, we identified all previously published datasets containing both scores from the American Society of Clinical Oncology Value Framework (ASCO-VF) and grades from the European Society for Medical Oncology-Magnitude of Clinical Benefit Scale (ESMO-MCBS). The intraclass correlation coefficient (ICC) was used to assess interrater reliability. Four eligible studies contained drugs evaluated by both value frameworks, resulting in a dataset of 39 grades/scores for discrete drug indications. ICC was 0.82 (95% confidence interval = 0.70 to 0.90) for ASCO-VF and 0.88 (95% confidence interval = 0.80 to 0.93) for ESMO-MCBS. Absolute concordance was found to be 5% for ASCO-VF and 44% for ESMO-MCBS, increasing to 74% and 80% when deviations within 20 points and 1 grade were considered, respectively. Interrater reliability of ASCO-VF and ESMO-MCBS is, therefore, near perfect, while absolute concordance is poor. This has implications when considering framework outputs in drug funding or treatment decision making.

2018 ◽  
Vol 2 (1) ◽  
pp. e101 ◽  
Author(s):  
Elise Mansfield ◽  
Jamie Bryant ◽  
Mariko Carey ◽  
Heidi Turon ◽  
Frans Henskens ◽  
...  

Author(s):  
Willem R. Six ◽  
Constantinus F. Buckens ◽  
Johannes L. Tol ◽  
Frank F. Smithuis ◽  
Mario Maas ◽  
...  

AbstractIn clinically suspected acute full-thickness proximal hamstring tendon avulsions, MRI is the gold standard for evaluating the extent of the injury. MRI variables such as full-thickness free tendon discontinuity, extent of tendon retraction (>20 mm), and continuity of the sacrotuberous ligament with the conjoint tendon (STL-CT) are used in treatment decision-making. The objective was to assess the intra- and inter-rater reliability of these relevant MRI variables after acute full-thickness proximal hamstring tendon avulsion. Three musculoskeletal radiologists assessed MRIs of 40 patients with an acute full-thickness proximal hamstring tendon avulsion. MRI variables included assessment of free tendon discontinuity and continuity of the STL-CT and extent of tendon retraction. Absolute and relative intra- and inter-rater reliability were calculated. Intra- and inter-rater reliability for the assessment of tendon discontinuity was substantial (Kappa [ĸ]=0.78;0.77). For the retraction measurement of the conjoint and semimembranosus tendons, intra-rater reliability was moderate and poor (Intraclass correlation coefficient (ICC)=0.74;0.45), inter-rater reliability was moderate (ICC=0.73;0.57). Intra- and inter-rater reliability of the STL-CT continuity assessment was substantial and fair (ĸ=0.74;0.31). In conclusion, MRI assessment for full-thickness free tendon discontinuity is reliable. However, assessment of extent of tendon retraction and STL-CT continuity is not reliable enough to guide the treatment decision-making process.


2017 ◽  
Vol 13 (2) ◽  
pp. 169-184 ◽  
Author(s):  
Shuya Kushida ◽  
Takeshi Hiramoto ◽  
Yuriko Yamakawa

In spite of increasing advocacy for patients’ participation in psychiatric decision-making, there has been little research on how patients actually participate in decision-making in psychiatric consultations. This study explores how patients take the initiative in decision-making over treatment in outpatient psychiatric consultations in Japan. Using the methodology of conversation analysis, we analyze 85 video-recorded ongoing consultations and find that patients select between two practices for taking the initiative in decision-making: making explicit requests for a treatment and displaying interest in a treatment without explicitly requesting it. A close inspection of transcribed interaction reveals that patients make explicit requests under the circumstances where they believe the candidate treatment is appropriate for their condition, whereas they merely display interest in a treatment when they are not certain about its appropriateness. By fitting practices to take the initiative in decision-making with the way they describe their current condition, patients are optimally managing their desire for particular treatments and the validity of their initiative actions. In conclusion, we argue that the orderly use of the two practices is one important resource for patients’ participation in treatment decision-making.


2007 ◽  
Author(s):  
Mary A. O'Brien ◽  
Timothy Whelan ◽  
Amiram Gafni ◽  
Cathy Charles ◽  
Peter Ellis

Sign in / Sign up

Export Citation Format

Share Document