Response Inconsistency of Patient-Reported Symptoms as a Predictor of Discrepancy Between Patient and Clinician-Reported Depression Severity

Assessment ◽  
2016 ◽  
Vol 25 (7) ◽  
pp. 917-928 ◽  
Author(s):  
Judith M. Conijn ◽  
Wilco H. M. Emons ◽  
Bethan F. Page ◽  
Klaas Sijtsma ◽  
Willem Van der Does ◽  
...  

The aim of this study was to assess the extent to which discrepancy between self-reported and clinician-rated severity of depression are due to inconsistent self-reports. Response inconsistency threatens the validity of the test score. We used data from a large sample of outpatients ( N = 5,959) who completed the self-report Beck Depression Inventory–II (BDI-II) and the clinician-rated Montgomery–Åsberg Depression Rating Scale (MADRS). We used item response theory based person-fit analysis to quantify the inconsistency of the self-report item scores. Inconsistency was weakly positively related to patient–clinician discrepancy (i.e., higher BDI-II scores relative to MADRS scores). The mediating effect of response inconsistency in the relationship between discrepancy and demographic (e.g., ethnic origin) and clinical variables (e.g., cognitive problems) was negligible. The small direct and mediating effects of response inconsistency suggest that inaccurate patient self-reports are not a major cause of patient–clinician discrepancy in outpatient samples. Future research should investigate the role of clinician biases in explaining clinician–patient discrepancy.

Author(s):  
Alison Bliss

The landmark paper discussed in this chapter is a systematic review assessing the commonly used faces pain scales employed to aid children in the self-report of their pain intensity. The review provides a critical evaluation of the Faces Pain Scale, the Faces Pain Scale-Revised (FPS-R), the Oucher pain scale, and the Wong–Baker Faces Pain Rating Scale (WBFPRS). The reviewers found that the psychometric properties of the FPS-R supported its superiority for use in research. Although they found that children, and many staff, expressed a preference for the WBFPRS, the reviewers had major concerns about this scale confounding pain intensity with affect. They also noted the paucity of research in younger children, and concluded that future research should not focus on developing more pain scales for paediatric use but on examining the appropriate application of existing scales in a wider range of clinical settings.


2011 ◽  
Vol 27 (3) ◽  
pp. 164-170 ◽  
Author(s):  
Anna Sundström

This study evaluated the psychometric properties of a self-report scale for assessing perceived driver competence, labeled the Self-Efficacy Scale for Driver Competence (SSDC), using item response theory analyses. Two samples of Swedish driving-license examinees (n = 795; n = 714) completed two versions of the SSDC that were parallel in content. Prior work, using classical test theory analyses, has provided support for the validity and reliability of scores from the SSDC. This study investigated the measurement precision, item hierarchy, and differential functioning for males and females of the items in the SSDC as well as how the rating scale functions. The results confirmed the previous findings; that the SSDC demonstrates sound psychometric properties. In addition, the findings showed that measurement precision could be increased by adding items that tap higher self-efficacy levels. Moreover, the rating scale can be improved by reducing the number of categories or by providing each category with a label.


2019 ◽  
Author(s):  
Tyler L Renshaw

This brief report presents an analog test of the relative classification validity of three cutoff values (CVs; 16, 18, and 20) derived from responses to the self-report version of the Strengths and Difficulties Questionnaire: Total Difficulties Scale. Results from Bayesian t-tests, using several school-specific subjective well-being indicators as dependent variables, yielded evidence suggesting all CV models effectively differentiated between students with lower and higher levels of risk. Evidence also indicated that the lowest CV (16) was more effective than the higher CVs (18, 20) at identifying students with greater levels of risk, and that the higher CVs functioned comparably well. Implications for future research and practice are noted.


2018 ◽  
Vol 24 (3) ◽  
pp. 420-424
Author(s):  
Joseph Biederman ◽  
Maura Fitzgerald ◽  
Thomas J. Spencer ◽  
Lenard A. Adler ◽  
Jessica Abrams ◽  
...  

Objective: To investigate the informativeness of self-reports of ADHD symptoms in adults with ADHD in the clinical setting. Method: Subjects were clinically referred adults aged 19 years to 67 years of age of both sexes ( N = 54). All subjects were on stable doses of stimulant and were considered responders to treatment. ADHD symptoms were assessed using the ADHD Investigator Symptom Rating Scale (AISRS) and the ADHD Self-Report Scale (ASRS). Spearman’s rank correlations were used to assess the correlations between clinician-assessed ADHD and patients’ self-reports. Results: Spearman’s rank correlation analysis found evidence of a strong, positive association between total scores on the AISRS and the ASRS ( rs = .65, df = 52, p < .001). Conclusion: Results have important implications for the management and monitoring of treatment response in the clinical setting through patients’ self-report.


Assessment ◽  
2019 ◽  
Vol 27 (7) ◽  
pp. 1604-1618 ◽  
Author(s):  
Judith M. Conijn ◽  
Niels Smits ◽  
Esther E. Hartman

In psychological assessment of children, it is pivotal to establish from what age on self-reports can complement or replace informant reports. We introduce a psychometric approach to estimate the minimum age for a child to produce self-report data that is of similar quality as informant data. The approach makes use of statistical validity indicators such as person-fit and long-string indices, and can be readily applied to data commonly collected in psychometric studies of child measures. We evaluate and illustrate the approach, using self-report and informant-report data of the PedsQL, a pediatric health-related quality of life measure, from 651 child–mother pairs. To evaluate the approach, we tested various hypotheses about the validity of the self-report data, using the [Formula: see text] person-fit index as the validity indicator and the mother informant-data as a benchmark for validity. Results showed that [Formula: see text] discriminated between self-reports of younger and older children, between self-reports of children that completed the PedsQL alone or with a parent, and between self-reports and informant reports. We conclude that the validity-index approach has good potential for future applications. Future research should further evaluate the approach for different types of questionnaires (e.g., personality inventories) and using different validity indices (e.g., response-bias indices).


2018 ◽  
Vol 72 (6) ◽  
pp. 471-476 ◽  
Author(s):  
Arie Kapteyn ◽  
James Banks ◽  
Mark Hamer ◽  
James P Smith ◽  
Andrew Steptoe ◽  
...  

BackgroundPhysical activity (PA) is important for maintaining health, but there are fundamental unanswered questions on how best it should be measured.MethodsWe measured PA in the Netherlands (n=748), the USA (n=540) and England (n=254), both by a 7 day wrist-worn accelerometer and by self-reports. The self-reports included a global self-report on PA and a report on the frequency of vigorous, moderate and mild activity.ResultsThe self-reported data showed only minor differences across countries and across groups within countries (such as different age groups or working vs non-working respondents). The accelerometer data, however, showed large differences; the Dutch and English appeared to be much more physically active than Americans h (For instance, among respondents aged 50 years or older 38% of Americans are in the lowest activity quintile of the Dutch distribution). In addition, accelerometer data showed a sharp decline of PA with age, while no such pattern was observed in self-reports. The differences between objective measures and self-reports occurred for both types of self-reports.ConclusionIt is clear that self-reports and objective measures tell vastly different stories, suggesting that across countries people use different response scales when answering questions about how physically active they are.


2020 ◽  
pp. 1-S8
Author(s):  
John F. Edens ◽  
Shannon Toney Smith ◽  
Karolina Sörman ◽  
Shannon E. Kelley ◽  
Allison Rulseh ◽  
...  

Can the components of the triarchic model of psychopathy (i.e., boldness, meanness, disinhibition) be operationalized using the item pool comprising the Comprehensive Assessment of Psychopathic Personality (CAPP) model? To address this question, the authors first derived CAPP-based triarchic scales using standard item-selection procedures and then examined the external correlates of these provisional scales in three archival data sets: (a) U.S. jail inmates administered the institutional rating scale version of the CAPP and (b and c) prototypicality ratings of the CAPP traits provided by Swedish forensic mental health professionals and U.S. probation officers. Although most research on triarchic constructs has relied exclusively on self-report inventories, the results suggest that the CAPP model can be reorganized to reflect boldness, meanness, and disinhibition and that its institutional rating scale items can effectively quantify these constructs using interview and file review data. Implications for future research on the measurement and assessment of psychopathic traits are discussed.


1988 ◽  
Vol 11 (2) ◽  
pp. 115-124 ◽  
Author(s):  
Ellice Ann Forman

The effects of two types of environmental influences on the self-concept of LD students were examined: social support and school placement. The 51 children and adolescents who participated in the study were receiving LD services in self-contained classes or resource rooms, or had been diagnosed as learning disabled but were not yet receiving services. Social support and self-concept were assessed using two self-report measures developed by Harter (1985). Students with higher levels of perceived social support were found to score higher in general self-worth, athletic competence, scholastic competence, and behavioral conduct than students with fewer social supports. In addition, support from classmates was the most important predictor of high self-concept. School placement was not found to be related to self-concept. The findings of this study suggest that future research needs to examine the social contextual factors that may foster positive self-concepts in LD students.


2007 ◽  
Vol 101 (1) ◽  
pp. 291-301 ◽  
Author(s):  
Ana Luiza Camozzato ◽  
Maria Paz Hidalgo ◽  
Sônia Souza ◽  
Márcia L. F. Chaves

The association among items of the self-reported version of the Hamilton Depression Scale (Carroll Rating Scale), answered according to a memory of a maximally disturbing event experienced, and respondents' sex was examined in a nonclinical sample of 320 college students, 164 women ( M age = 21.7 yr., SD = 3.6) and 156 men ( M age = 23.5 yr., SD = 5.8). An assessment of sex bias was also evaluated. Multiple regression analysis showed that statements regarding unhappiness, urge to cry, dizziness and faintness, and waking in the middle of the night were significantly associated with women. Removal of these items from the Carroll Rating Scale Total scores eliminated the sex differences in depression rates. Items that displayed significant sex bias were those regarding behavior and emotions commonly attributed to women within the general population.


Sign in / Sign up

Export Citation Format

Share Document