Establishing Interrater Agreement for the Occupation-Based Coaching Fidelity Measure

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500021p1
Author(s):  
Kathryn Carlson ◽  
Amy Abbott ◽  
Vanessa Jewell ◽  
Julia Shin ◽  
Marion Russell
1997 ◽  
Vol 36 (04/05) ◽  
pp. 41-46
Author(s):  
A. Kjaer ◽  
W. Jensen ◽  
T. Dyrby ◽  
L. Andreasen ◽  
J. Andersen ◽  
...  

Abstract.A new method for sleep-stage classification using a causal probabilistic network as automatic classifier has been implemented and validated. The system uses features from the primary sleep signals from the brain (EEG) and the eyes (AOG) as input. From the EEG, features are derived containing spectral information which is used to classify power in the classical spectral bands, sleep spindles and K-complexes. From AOG, information on rapid eye movements is derived. Features are extracted every 2 seconds. The CPN-based sleep classifier was implemented using the HUGIN system, an application tool to handle causal probabilistic networks. The results obtained using different training approaches show agreements ranging from 68.7 to 70.7% between the system and the two experts when a pooled agreement is computed over the six subjects. As a comparison, the interrater agreement between the two experts was found to be 71.4%, measured also over the six subjects.


Author(s):  
Hugh G. Pemberton ◽  
◽  
Olivia Goodkin ◽  
Ferran Prados ◽  
Ravi K. Das ◽  
...  

Abstract Objectives We examined whether providing a quantitative report (QReport) of regional brain volumes improves radiologists’ accuracy and confidence in detecting volume loss, and in differentiating Alzheimer’s disease (AD) and frontotemporal dementia (FTD), compared with visual assessment alone. Methods Our forced-choice multi-rater clinical accuracy study used MRI from 16 AD patients, 14 FTD patients, and 15 healthy controls; age range 52–81. Our QReport was presented to raters with regional grey matter volumes plotted as percentiles against data from a normative population (n = 461). Nine raters with varying radiological experience (3 each: consultants, registrars, ‘non-clinical image analysts’) assessed each case twice (with and without the QReport). Raters were blinded to clinical and demographic information; they classified scans as ‘normal’ or ‘abnormal’ and if ‘abnormal’ as ‘AD’ or ‘FTD’. Results The QReport improved sensitivity for detecting volume loss and AD across all raters combined (p = 0.015* and p = 0.002*, respectively). Only the consultant group’s accuracy increased significantly when using the QReport (p = 0.02*). Overall, raters’ agreement (Cohen’s κ) with the ‘gold standard’ was not significantly affected by the QReport; only the consultant group improved significantly (κs 0.41➔0.55, p = 0.04*). Cronbach’s alpha for interrater agreement improved from 0.886 to 0.925, corresponding to an improvement from ‘good’ to ‘excellent’. Conclusion Our QReport referencing single-subject results to normative data alongside visual assessment improved sensitivity, accuracy, and interrater agreement for detecting volume loss. The QReport was most effective in the consultants, suggesting that experience is needed to fully benefit from the additional information provided by quantitative analyses. Key Points • The use of quantitative report alongside routine visual MRI assessment improves sensitivity and accuracy for detecting volume loss and AD vs visual assessment alone. • Consultant neuroradiologists’ assessment accuracy and agreement (kappa scores) significantly improved with the use of quantitative atrophy reports. • First multi-rater radiological clinical evaluation of visual quantitative MRI atrophy report for use as a diagnostic aid in dementia.


Author(s):  
Enzo Cerullo ◽  
Terry J Quinn ◽  
Jenny McCleery ◽  
Elpida Vounzoulaki ◽  
Nicola J Cooper ◽  
...  

1984 ◽  
Vol 13 (1) ◽  
pp. 15-20 ◽  
Author(s):  
C Wagner ◽  
D Drescher

An electronic gravity goniometer was developed for determining the passive range of movement of the MCP joints II, III, IV, and V in the dorso-volar plane by the use of preset torques. Test–retest measurements on 23 healthy subjects between the ages of 18 and 57 demonstrated high intrarater and interrater agreement for determining the total range. In the determination of the amounts of flexion and extension the measurement of the flexion was less reliable. There was overall evidence of a declining tendency of reliability from MCP joint II to MCP joint V, probably caused by different reactions of the joints to repeated measurements. The higher total range of the MCP joints in women was principally caused by a higher range of extension. In the case of men and women the range of MCP joint V was noticeably greater than that of the other three joints. The mobility of the four MCP joints correlates relatively closely as a whole, however, in the case of the non-adjacent joints less closely than with the adjacent joints. Reliability and validity of the examination method were balanced against one another with regard to testing of the biomechanical pre-conditions for manual dexterity.


Author(s):  
Georgia Williams ◽  
Simone Farrelly ◽  
Andrew Thompson ◽  
Heather Stavely ◽  
Dianne Albiston ◽  
...  

Stroke ◽  
2021 ◽  
Vol 52 (Suppl_1) ◽  
Author(s):  
Yongwoo Kim ◽  
Marie Luby ◽  
Nina-serena F Burkett ◽  
Gina Norato ◽  
Richard Leigh ◽  
...  

Background and Purpose: It is well established that earlier treatment times are associated with better outcomes in acute stroke patients receiving thrombolysis. There is also an association between time from stroke onset and lesion visibility on FLAIR MRI. We hypothesized that lesion visibility on FLAIR, independent of time, may be a predictor of outcome in stroke patients with known onset. Methods: We analyzed data from acute ischemic stroke patients presenting over the last 10 years who were screened with MRI and treated with IV thrombolysis within 4.5 hours from known onset. Three independent readers assessed whether acute ischemic lesions seen on Diffusion Weighted Imaging were also FLAIR-positive based on visual inspection. Multivariable regression analysis was used to obtain an adjusted odds ratio of favorable clinical and radiological outcomes based on FLAIR-positivity. Results: Of 310 stroke patients, 24% had lesion visibility on initial FLAIR MRI. The interrater agreement for the FLAIR-positive assessment was 84% (κ=0.604, 95% CI 0.557-0.652). Patients with FLAIR-positive lesions were younger (67 vs 73 years, p=0.028), had more right hemispheric strokes (57% vs 42%, p=0.018), were imaged later (127 vs 104 minutes, p=0.010), had more frequent blood-brain barrier disruption (44% vs 26%, p=0.004), less frequent early neurologic improvement (30% vs 58%, p<0.001), and less frequent favorable 90-day functional outcome (49% vs 63%, p=0.039). Following multivariable logistic regression, older age, greater NIH Stroke Scale, lesion visibility on FLAIR, but not time-from-onset, were independently associated with less favorable outcome. Conclusions: FLAIR-positive acute ischemic stroke within 4.5 hours of known onset was associated with less favorable 90-day outcome after IV thrombolysis. When compared with time, lesion visibility on FLAIR was more strongly associated with outcome.


Sign in / Sign up

Export Citation Format

Share Document