Test-retest reliability of pain-related functional brain connectivity compared with pain self-report

Summary: Short-term stability or test-retest reliability of self-reported personality traits is likely to be biased if the respondent is affected by a depressive or anxiety state. However, in some studies, DSM-oriented self-reported instruments have proved to be reasonably stable in the short term, regardless of co-occurring depressive or anxiety disorders. In the present study, we examined the short-term test-retest reliability of a new self-report questionnaire for personality disorder diagnosis (DIP-Q) on a clinical sample of 30 individuals, having either a depressive, an anxiety, or no axis-I disorder. Test-retest scorings from subjects with depressive disorders were mostly unstable, with a significant change in fulfilled criteria between entry and retest for three out of ten personality disorders: borderline, avoidant and obsessive-compulsive personality disorder. Scorings from subjects with anxiety disorders were unstable only for cluster C and dependent personality disorder items. In the absence of co-morbid depressive or anxiety disorders, mean dimensional scores of DIP-Q showed no significant differences between entry and retest. Overall, the effect from state on trait scorings was moderate, and it is concluded that test-retest reliability for DIP-Q is acceptable.

Download Full-text

Developing a measure to assess clinicians’ ability to reflect on key staff–patient dynamics in forensic settings

Journal of Forensic Practice ◽

10.1108/jfp-07-2021-0041 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Adam Polnay ◽

Helen Walker ◽

Christopher Gallacher

Keyword(s):

Reflective Practice ◽

Factor Structure ◽

Internal Consistency ◽

Self Report ◽

Face Validity ◽

Good Test ◽

Data Set ◽

Retest Reliability ◽

Content Type ◽

Test Retest Reliability

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.

Download Full-text

Validation of the NARCOMS Registry: pain assessment

Multiple Sclerosis Journal ◽

10.1191/1352458505ms1167oa ◽

2005 ◽

Vol 11 (3) ◽

pp. 338-342 ◽

Cited By ~ 28

Author(s):

Ruth Ann Marrie ◽

Gary Cutter ◽

Tuula Tyry ◽

Olympia Hadjimichael ◽

Timothy Vollmer

Keyword(s):

Multiple Sclerosis ◽

Convergent Validity ◽

Disease Duration ◽

Self Report ◽

Research Committee ◽

Retest Reliability ◽

The North ◽

Disability Status ◽

Pain Question ◽

Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

Download Full-text

Brain-behaviour modes of covariation in healthy and clinically depressed young people

10.1101/487421 ◽

2018 ◽

Author(s):

Agoston Mihalik ◽

Fabio S. Ferreira ◽

Maria J. Rosa ◽

Michael Moutoussis ◽

Gabriel Ziegler ◽

...

Keyword(s):

Brain Connectivity ◽

Demographic Data ◽

Strong Association ◽

Early Adulthood ◽

Well Being ◽

Self Report ◽

Multivariate Statistical ◽

Functional Brain ◽

Clinically Depressed ◽

Critical Developmental Period

AbstractUnderstanding how variations in dimensions of psychometrics, IQ and demographics relate to changes in brain connectivity during the critical developmental period of adolescence and early adulthood is a major challenge. This has particular relevance for mental health disorders where a failure to understand these links might hinder the development of better diagnostic approaches and therapeutics. Here, we investigated this question in 306 adolescents and young adults (14-24y, 25 clinically depressed) using a multivariate statistical framework, based on canonical correlation analysis (CCA). By linking individual functional brain connectivity profiles to self-report questionnaires, IQ and demographic data we identified two distinct modes of covariation. The first mode mapped onto an externalization/internalization axis and showed a strong association with sex. The second mode mapped onto a well-being/distress axis independent of sex. Interestingly, both modes showed an association with age. Crucially, the changes in functional brain connectivity associated with changes in these phenotypes showed marked developmental effects. The findings point to a role for the default mode, frontoparietal and limbic networks in psychopathology and depression.

Download Full-text

Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

10.31219/osf.io/8ghda ◽

2020 ◽

Cited By ~ 1

Author(s):

Julia Velten ◽

Gerrit Hirschfeld ◽

Milena Meyers ◽

Jürgen Margraf

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Sexual Interest ◽

Intraclass Correlation ◽

Self Report ◽

Clinical Psychologist ◽

Retest Reliability ◽

Absolute Agreement ◽

Test Retest Reliability ◽

Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

Download Full-text

Test-Retest Reliability of the Trauma and Life Events Self-Report Inventory

Psychological Reports ◽

10.2466/pr0.2000.87.3.750 ◽

2000 ◽

Vol 87 (3) ◽

pp. 750-752 ◽

Cited By ~ 9

Author(s):

J. E. Hovens ◽

I. Bramsen ◽

H. M. van der Ploeg ◽

I. E. W. Reuling

Keyword(s):

Medical Students ◽

Life Events ◽

Self Report ◽

First Year ◽

Total N ◽

Male And Female ◽

Retest Reliability ◽

Time Periods ◽

Test Retest Reliability

Three groups of first-year male and female medical students (total N = 90) completed the Trauma and Life Events Self-report Inventory twice. Test-retest reliability for the three different time periods was .82, .89, and .75, respectively.

Download Full-text

Measuring Symptoms of Psychopathology in Zambian Orphans and Vulnerable Children: Scale Validation and Psychometric Evaluation

Assessment ◽

10.1177/1073191118780455 ◽

2018 ◽

Vol 27 (6) ◽

pp. 1335-1348 ◽

Cited By ~ 1

Author(s):

Sarah McIvor Murray ◽

Paul Bolton ◽

Jeremy C. Kane ◽

Daniel P. Lakin ◽

Stephanie Skavenski Van Wyk ◽

...

Keyword(s):

Psychosocial Problems ◽

Well Being ◽

Self Report ◽

Computer Assisted ◽

Symptom Scale ◽

Vulnerable Children ◽

Internal Reliability ◽

Retest Reliability ◽

Orphans And Vulnerable Children ◽

Test Retest Reliability

There is a paucity of validated mental health measures for assessing psychological well-being among HIV-affected youth. We sought to explore the psychometric properties and validity of the Achenbach Youth Self-Report and Child Posttraumatic Stress Disorder Symptom Scale among orphans and vulnerable children (OVC) living in Lusaka, Zambia. These scales were administered to 210 OVC aged 13 to 17 years via audio computer-assisted self-interview. Confirmatory factor analysis was used to assess scale structure, Cronbach’s alpha for internal consistency, and correlations between scales related to mental or psychosocial health for construct validity. A known-groups validation was conducted using local identifications of youth with and without significant psychosocial problems, and test–retest reliability was assessed. Scales exhibited good internal reliability (α > .80), adequate criterion validity (area under the curve > .70), and moderate test–retest reliability (.62-.68). Findings support the utility of these symptom scales for identifying OVC experiencing significant psychosocial problems in Zambia.

Download Full-text

Measurement of Social Engagement of Nursing Home Residents During an Exercise Program

Perspectives of the ASHA Special Interest Groups ◽

10.1044/2021_persp-20-00302 ◽

2021 ◽

pp. 1-9

Author(s):

Jean Neils-Strunjas ◽

K. Jason Crandall ◽

Brian Weiler ◽

Annika Gabbard ◽

Caroline Wood ◽

...

Keyword(s):

Health Care ◽

Nursing Home ◽

Social Engagement ◽

Nursing Home Residents ◽

Exercise Program ◽

Self Report ◽

Validity And Reliability ◽

Retest Reliability ◽

Bivariate Correlation ◽

Test Retest Reliability

Purpose The purpose of this article was to describe the validity and reliability of the Fun and Social Engagement Evaluation (FUSE) developed to evaluate and measure social engagement displayed by nursing home residents during Bingocize. The FUSE combines health care worker observation and a resident self-report measure to produce a score that represents a resident's total engagement. Method To describe validity, trained health care workers who implement Bingocize were surveyed about the items on the FUSE. Visual inspection of bar graphs of responses to survey questions were used to determine content validity. To assess reliability of the FUSE, nursing home residents were evaluated by trained research assistants. Test–retest reliability of the participant scores 1 week apart was determined with the bivariate correlation (Pearson product–moment correlation coefficient). Results For validity, the majority of survey respondents indicated that the behaviors were representative of nursing home residents during Bingocize. For reliability, there was moderate–strong test–retest reliability over 1 week ( r = .60). Interrater reliability between two raters observing eight participants across two sessions was significant, κ = .68 (95% CI [.504,.848]), p < .0001. Conclusion Results offer evidence that the FUSE is a valid and reliable method for determining social engagement during Bingocize.

Download Full-text

Anxiety Symptoms Questionnaire (ASQ): development and validation

General Psychiatry ◽

10.1136/gpsych-2019-100144 ◽

2019 ◽

Vol 32 (6) ◽

pp. e100144

Author(s):

Amanda Baker ◽

Naomi Simon ◽

Aparna Keshaviah ◽

Amy Farabaugh ◽

Thilo Deckersbach ◽

...

Keyword(s):

College Students ◽

Factor Analysis ◽

Anxiety Disorder ◽

Reliability And Validity ◽

Anxiety Symptoms ◽

Self Report ◽

Retest Reliability ◽

Control Subjects ◽

Clinical Control ◽

Test Retest Reliability

BackgroundThe Anxiety Symptoms Questionnaire (ASQ) is a brief self-report questionnaire which measures frequency and intensity of symptoms and was developed to improve assessment of anxiety symptoms in a clinical setting. We examined the reliability and validity of the ASQ in patients with anxiety disorders and/or depression, non-clinical control subjects and college students.Methods240 outpatients with generalised anxiety disorder, social anxiety disorder, panic disorder or major depressive disorder were administered the ASQ and additional questionnaires measuring depression and anxiety, as were 111 non-clinical control subjects and 487 college students. Factor analysis, Pearson’s correlation coefficients and logistic regression were used to assess reliability and validity. Test–retest reliability of the ASQ was measured using a subset who were re-administered the ASQ after 4 weeks.ResultsFactor analysis revealed measurement of a single dimension by the ASQ. Internal consistency and test–retest reliability were strong. The ASQ total score also significantly distinguished patients with an anxiety disorder from the clinical controls above and beyond the clinician-rated Hamilton Anxiety Scale.ConclusionsThe ASQ is a valid, reliable and effective self-rated measure of anxiety and may be a useful tool for screening and assessing anxiety symptoms in psychiatric as well as college settings.

Download Full-text

Test-Retest Reliability of the Holyoake Codependency Index with Australian Students

Psychological Reports ◽

10.2466/pr0.94.2.482-484 ◽

2004 ◽

Vol 94 (2) ◽

pp. 482-484 ◽

Cited By ~ 2

Author(s):

Greg E. Dear

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Internal Validity ◽

Self Report ◽

Full Scale Test ◽

Retest Reliability ◽

External Focus ◽

Scale Test ◽

Test Retest Reliability ◽

Report Measure

The Holyoake Codependency Index is a 13-item self-report measure of three aspects of codependency: External Focus, Self-sacrifice, and a sense of being overwhelmed by another person's problematic behavior (termed Reactivity). Previous studies have supported internal validity and the internal consistency and construct validity of the subscales. The present scores for 59 students indicate full scale test-retest reliability of .88 and for subscales (.76 to .82) over a 3-wk. interval.

Download Full-text