scholarly journals Establishment of a reliable change index for the GAD-7

2020 ◽  
Vol 8 (1) ◽  
pp. 176-187
Author(s):  
Thomas Bischoff ◽  
Shayne R. Anderson ◽  
Joy Heafner ◽  
Rachel Tambling
Keyword(s):  
Online Community ◽  
Clinical Sample ◽  
Community Sample ◽  
Mental Healthcare ◽  
Reliable Change Index ◽  
Good Test ◽  
Reliable Change ◽  
Retest Reliability ◽  
The Mean ◽  
Test Retest Reliability

Aim It is increasingly important for mental healthcare providers and researchers to reliably assess client change, particularly with common presenting problems such as anxiety. The current study addresses this need by establishing a Reliable Change Index of 6 points for the GAD-7. Method Sample size included 116 online community participants using Amazon’s Mechanical Turk (MTurk) and archival data for 332 clinical participants. Participants completed measures of the GAD-7 and the MDI in 2 rounds. Using previously established cutoff scores and Jacobson and Truax’s (1991) method, we establish a Reliable Change Index which, when applied to 2 administrations of the GAD-7, indicates if a client has experienced meaningful change. Results For the GAD-7, the mean score for the clinical sample was 10.57. For the community sample at Time 1, the mean score was 4.14. A Pearson’s correlation was computed to assess the 14-28-day test-retest reliability of the GAD-7, r(110) = .87, indicating good test-retest reliability. Conclusion Using the RCI equation, this resulted in an RCI of 5.59. For practical use the RCI would be rounded to 6.

Psychometric Properties of the Children's Depression Inventory in Community and Clinical Sample

2010 ◽  
Vol 13 (2) ◽  
pp. 990-999 ◽  
Author(s):  
Anna Figueras Masip ◽  
Juan Antonio Amador-Campos ◽  
Juana Gómez-Benito ◽  
Victoria del Barrio Gándara
Keyword(s):  
Predictive Value ◽  
Clinical Sample ◽  
Community Sample ◽  
Psychometric Characteristics ◽  
Children's Depression Inventory ◽  
Children’S Depression Inventory ◽  
Children’S Depression ◽  
Sample Test ◽  
The Mean ◽  
Test Retest Reliability

The psychometric characteristics of the Children's Depression Inventory, CDI (Kovacs, 1992) in a sample of 1705 participants (792 boys and 913 girls) and a clinical sample of 102 participants (42 boys and 60 girls) between 10 and 18 years old are presented. Reliability coefficients range, for both samples, from .82 (test) to .84 (retest) in the community sample, and .85 (test, clinical sample); test-retest reliability is .81 in the community sample. The mean scores are similar to other Spanish and English ones. Girls score higher than boys. The cut-off point that best differentiates between depressive and community participants is 19, with a sensitivity of 94.7%, a specificity of 95.6%, a positive predictive value of .90, and a negative predictive value of .98.

scholarly journals Test–retest reliability of the 20-min pad test with infusion of strong-desired volume in the bladder for female urodynamic stress incontinence

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Wen-Yih Wu ◽  
Sheng-Mou Hsiao ◽  
Pei-Chi Wu ◽  
Ho-Hsiung Lin
Keyword(s):  
Stress Incontinence ◽  
Intraclass Correlation ◽  
Urodynamic Stress Incontinence ◽  
Good Test ◽  
Retest Reliability ◽  
Pad Test ◽  
The Mean ◽  
Urine Leakage ◽  
Test Retest Reliability ◽  
Good Agreement

Abstract The repeatability of the 20-min pad test has not been reported. The aim of this study was to evaluate the test–retest reliability of the 20-min pad test in women with urodynamic stress incontinence. Among 89 enrolled women, 67 (75%) women were diagnosed with urodynamic stress incontinence and were examined in this study. The mean strong-desire volume of all the women was 306.7 ± 115.7 mL. The pad weights of the test versus retest were 28.3 ± 41.2 g versus 28.4 ± 38.6 g, p = 0.29, respectively. The test and retest pad weight results had a Spearman’s rho of 0.788 (p < 0.0001). The intraclass correlation coefficient was 0.793 (95% confidence interval, 0.704–0.882; p < 0.0001). The Bland–Altman plots all revealed good agreement between the test and the retest in the pad weights. In conclusion, the 20-min pad test infused with a strong-desired volume has good test–retest reliability to assess the severity of urine leakage for women with urodynamic stress incontinence.

Test-Retest Reliability of a Self-Report Questionnaire for DSM-IV and ICD-10 Personality Disorders

2000 ◽  
Vol 16 (1) ◽  
pp. 53-58 ◽  
Author(s):  
Hans Ottosson ◽  
Martin Grann ◽  
Gunnar Kullgren
Keyword(s):  
Personality Disorder ◽  
Anxiety Disorders ◽  
Personality Disorders ◽  
Clinical Sample ◽  
Self Report ◽  
Anxiety State ◽  
Short Term ◽  
Retest Reliability ◽  
Axis I ◽  
Test Retest Reliability

Summary: Short-term stability or test-retest reliability of self-reported personality traits is likely to be biased if the respondent is affected by a depressive or anxiety state. However, in some studies, DSM-oriented self-reported instruments have proved to be reasonably stable in the short term, regardless of co-occurring depressive or anxiety disorders. In the present study, we examined the short-term test-retest reliability of a new self-report questionnaire for personality disorder diagnosis (DIP-Q) on a clinical sample of 30 individuals, having either a depressive, an anxiety, or no axis-I disorder. Test-retest scorings from subjects with depressive disorders were mostly unstable, with a significant change in fulfilled criteria between entry and retest for three out of ten personality disorders: borderline, avoidant and obsessive-compulsive personality disorder. Scorings from subjects with anxiety disorders were unstable only for cluster C and dependent personality disorder items. In the absence of co-morbid depressive or anxiety disorders, mean dimensional scores of DIP-Q showed no significant differences between entry and retest. Overall, the effect from state on trait scorings was moderate, and it is concluded that test-retest reliability for DIP-Q is acceptable.

Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery

1996 ◽  
Vol 2 (6) ◽  
pp. 556-564 ◽  
Author(s):  
Stephen M. Sawrie ◽  
Gordon J. Chelune ◽  
Richard I. Naugle ◽  
Hans O. Lüders
Keyword(s):  
Epilepsy Surgery ◽  
Intractable Epilepsy ◽  
Practice Effects ◽  
Cutoff Score ◽  
Regression To The Mean ◽  
Neuropsychological Battery ◽  
Reliable Change ◽  
Medical Interventions ◽  
The Mean ◽  
Test Retest Reliability

AbstractTraditional methods for assessing the neurocognitive effects of epilepsy surgery are confounded by practice effects, test-retest reliability issues, and regression to the mean. This study employs 2 methods for assessing individual change that allow direct comparison of changes across both individuals and test measures. Fifty-one medically intractable epilepsy patients completed a comprehensive neuropsychological battery twice, approximately 8 months apart, prior to any invasive monitoring or surgical intervention. First, a Reliable Change (RC) index score was computed for each test score to take into account the reliability of that measure, and a cutoff score was empirically derived to establish the limits of statistically reliable change. These indices were subsequently adjusted for expected practice effects. The second approach used a regression technique to establish “change norms” along a common metric that models both expected practice effects and regression to the mean. The RC index scores provide the clinician with a statistical means of determining whether a patient's retest performance is “significantly” changed from baseline. The regression norms for change allow the clinician to evaluate the magnitude of a given patient's change on 1 or more variables along a common metric that takes into account the reliability and stability of each test measure. Case data illustrate how these methods provide an empirically grounded means for evaluating neurocognitive outcomes following medical interventions such as epilepsy surgery. (JINS, 1996, 2, 556–564.)

Test–Retest Reliability of Social Cognition Screening Questionnaire–Taiwan Version in People With Schizophrenia

2021 ◽  
Vol 75 (Supplement_2) ◽  
pp. 7512500023p1-7512500023p1
Author(s):  
Shu-Chun Lee ◽  
Yi-Ching Wu ◽  
David Leland Roberts ◽  
Kuang-Pei Tseng ◽  
Wen-Yin Chen
Keyword(s):  
Social Cognition ◽  
Random Measurement Error ◽  
Good Test ◽  
Retest Reliability ◽  
Screening Questionnaire ◽  
The Core ◽  
Random Measurement ◽  
The Social ◽  
Test Retest Reliability ◽  
Multiple Domains

Abstract Date Presented 04/19/21 The Social Cognition Screening Questionnaire–Taiwan version (SCSQT) was designed to assess multiple domains of social cognition in people with schizophrenia in Taiwan. The SCSQT contains five subscales and provides estimates of the core domains of mentalizing and social perception and an overall social cognition score. Our validation of SCSQT indicated that the SCSQT had good test–retest reliability, acceptable random measurement error, and negligible practice effects. Primary Author and Speaker: Shu-Chun Lee Additional Authors and Speakers: Trudy Mallinson Contributing Authors: Alison M. Cogan, Ann Guernon, Katherine O'Brien, and Piper Hansen

Developing a measure to assess clinicians’ ability to reflect on key staff–patient dynamics in forensic settings

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher
Keyword(s):  
Reflective Practice ◽  
Factor Structure ◽  
Internal Consistency ◽  
Self Report ◽  
Face Validity ◽  
Good Test ◽  
Data Set ◽  
Retest Reliability ◽  
Content Type ◽  
Test Retest Reliability

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.

scholarly journals Reliability and validity of a Mediterranean diet and culinary index (MediCul) tool in an older population with mild cognitive impairment

2018 ◽  
Vol 120 (10) ◽  
pp. 1189-1200 ◽  
Author(s):  
Sue Radd-Vagenas ◽  
Maria A. Fiatarone Singh ◽  
Michael Inskip ◽  
Yorgi Mavros ◽  
Nicola Gates ◽  
...  
Keyword(s):  
Cognitive Impairment ◽  
Mild Cognitive Impairment ◽  
Mediterranean Diet ◽  
Reliability And Validity ◽  
Community Dwelling ◽  
Systematic Bias ◽  
Older Individuals ◽  
Retest Reliability ◽  
The Mean ◽  
Test Retest Reliability

AbstractDementia is a leading cause of morbidity and mortality without pharmacologic prevention or cure. Mounting evidence suggests that adherence to a Mediterranean dietary pattern may slow cognitive decline, and is important to characterise in at-risk cohorts. Thus, we determined the reliability and validity of the Mediterranean Diet and Culinary Index (MediCul), a new tool, among community-dwelling individuals with mild cognitive impairment (MCI). A total of sixty-eight participants (66 % female) aged 75·9 (sd 6·6) years, from the Study of Mental and Resistance Training study MCI cohort, completed the fifty-item MediCul at two time points, followed by a 3-d food record (FR). MediCul test–retest reliability was assessed using intra-class correlation coefficients (ICC), Bland–Altman plots and κ agreement within seventeen dietary element categories. Validity was assessed against the FR using the Bland–Altman method and nutrient trends across MediCul score tertiles. The mean MediCul score was 54·6/100·0, with few participants reaching thresholds for key Mediterranean foods. MediCul had very good test–retest reliability (ICC=0·93, 95 % CI 0·884, 0·954, P<0·0001) with fair-to-almost-perfect agreement for classifying elements within the same category. Validity was moderate with no systematic bias between methods of measurement, according to the regression coefficient (y=−2·30+0·17x) (95 % CI −0·027, 0·358; P=0·091). MediCul over-estimated the mean FR score by 6 %, with limits of agreement being under- and over-estimated by 11 and 23 %, respectively. Nutrient trends were significantly associated with increased MediCul scoring, consistent with a Mediterranean pattern. MediCul provides reliable and moderately valid information about Mediterranean diet adherence among older individuals with MCI, with potential application in future studies assessing relationships between diet and cognitive function.

scholarly journals Psychometric properties of the Short Leyton Obsessional Inventory-Child Version in a community sample of Spanish children and adolescents

2016 ◽  
Vol 33 (1) ◽  
pp. 26
Author(s):  
Marina Iniesta-Sepúlveda ◽  
Ana I. Rosa-Alcázar ◽  
Beatriz Ruiz-García ◽  
Jose A. López-Pina
Keyword(s):  
Psychometric Properties ◽  
Children And Adolescents ◽  
Discriminant Validity ◽  
Factor Model ◽  
Community Sample ◽  
Spanish Version ◽  
Obsessive Compulsive ◽  
Good Test ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

The aim of the current study was to analyze psychometric properties of the Short LOI-CV in Spanish community sample. Participants were 914 children and adolescents with mean age of 13.01 years (51.3% males). An EFA yielded a three-factor model representing Obsessions, Compulsions, and Cleanliness dimensions. Both, total score and subscales showed an adequate internal consistency. The Spanish version also exhibited good test-retest reliability and moderate convergent and discriminant validity. The younger participants (from 8 to 10 years) obtained higher means for total score and subscales than older participants (groups 11-13 and 14-18 years). Significant differences related to gender were also observed since males obtained higher means in Compulsions subscale. Despite more research is required, the Spanish version of the Short LOI-CV exhibited promising psychometric results to assess obsessive-compulsive symptoms in community population.

The TAPS Project. 9: The Reliability of the Patient Attitude Questionnaire

1993 ◽  
Vol 162 (S19) ◽  
pp. 25-29 ◽  
Author(s):  
Graham Thornicroft ◽  
Christopher Gooch ◽  
Catherine O'Driscoll ◽  
Sawsan Reda
Keyword(s):  
Living Arrangements ◽  
Psychiatric Patients ◽  
Kappa Coefficient ◽  
Attitudinal Change ◽  
Attitude Questionnaire ◽  
Retest Reliability ◽  
Patient Attitude ◽  
The Mean ◽  
Test Retest Reliability

The development of the hospital and community versions of the Patient Attitude Questionnaire is described. The instrument rates the attitudes of psychiatric patients towards their treatment settings and staff, and is framed specifically to assess attitudinal change during the transfer of patients from hospital. For the items rated using the kappa coefficient of agreement, the mean test-retest reliability value was 0.51, and the average inter-rater value was 0.82. This study shows that long-term psychiatric patients are able to give clear and consistent views about their living arrangements - views that should be sought and respected by staff.

Sign in / Sign up

Export Citation Format

Share Document