Is There a Measurement Crisis in Disgust Research?

2020 ◽  
Author(s):  
Thomas Armstrong ◽  
Danica Wilbanks ◽  
Daniel Leong ◽  
Kean J. Hsu
Keyword(s):  
Mental Disorders ◽  
Clinical Psychology ◽  
Reliability And Validity ◽  
Self Report ◽  
Behavioral Therapies ◽  
Cognitive Behavioral Therapies ◽  
Societal Problems ◽  
Test Retest Reliability ◽  
Pathogen Avoidance ◽  
Corrective Information

Once a forgotten emotion, disgust is now studied in fields from evolutionary to clinical psychology. Although highly adaptive as a pathogen avoidance mechanism, disgust is prone to false positives. Indeed, several anxiety-related disorders involve excessive and irrational disgust. Furthermore, disgust resists corrective information, making it difficult to treat through cognitive-behavioral therapies. A deeper understanding of disgust could improve the treatment of mental disorders and other societal problems involving this peculiar emotion. However, researchers may need to improve the measurement of disgust to gain such insights. In this paper, we review psychology’s “measurement crisis” in the context of disgust. We suggest that self-report measures, though optimal in reliability, have compromised validity because the vernacular usage of disgust captures neighboring states of discomfort and disapproval. In addition to potential validity issues, we find that most non-self-report measures of disgust have questionable reliability. Internal consistency and test-retest reliability were rarely reported for psychophysiological and neural measures, but the information available suggests that these measures of disgust have poor reliability and may not support individual difference research crucial to clinical psychology. In light of this assessment, we provide several recommendations for improving the reliability and validity of disgust measurement, including renewed attention to theory.

scholarly journals Anxiety Symptoms Questionnaire (ASQ): development and validation

2019 ◽  
Vol 32 (6) ◽  
pp. e100144
Author(s):  
Amanda Baker ◽  
Naomi Simon ◽  
Aparna Keshaviah ◽  
Amy Farabaugh ◽  
Thilo Deckersbach ◽  
...  
Keyword(s):  
College Students ◽  
Factor Analysis ◽  
Anxiety Disorder ◽  
Reliability And Validity ◽  
Anxiety Symptoms ◽  
Self Report ◽  
Retest Reliability ◽  
Control Subjects ◽  
Clinical Control ◽  
Test Retest Reliability

BackgroundThe Anxiety Symptoms Questionnaire (ASQ) is a brief self-report questionnaire which measures frequency and intensity of symptoms and was developed to improve assessment of anxiety symptoms in a clinical setting. We examined the reliability and validity of the ASQ in patients with anxiety disorders and/or depression, non-clinical control subjects and college students.Methods240 outpatients with generalised anxiety disorder, social anxiety disorder, panic disorder or major depressive disorder were administered the ASQ and additional questionnaires measuring depression and anxiety, as were 111 non-clinical control subjects and 487 college students. Factor analysis, Pearson’s correlation coefficients and logistic regression were used to assess reliability and validity. Test–retest reliability of the ASQ was measured using a subset who were re-administered the ASQ after 4 weeks.ResultsFactor analysis revealed measurement of a single dimension by the ASQ. Internal consistency and test–retest reliability were strong. The ASQ total score also significantly distinguished patients with an anxiety disorder from the clinical controls above and beyond the clinician-rated Hamilton Anxiety Scale.ConclusionsThe ASQ is a valid, reliable and effective self-rated measure of anxiety and may be a useful tool for screening and assessing anxiety symptoms in psychiatric as well as college settings.

Measuring empathy: reliability and validity of the Empathy Quotient

2004 ◽  
Vol 34 (5) ◽  
pp. 911-920 ◽  
Author(s):  
E. J. LAWRENCE ◽  
P. SHAW ◽  
D. BAKER ◽  
S. BARON-COHEN ◽  
A. S. DAVID
Keyword(s):  
Emotional Reactivity ◽  
Reliability And Validity ◽  
Cognitive Empathy ◽  
Self Report ◽  
Reactivity Index ◽  
Empathy Quotient ◽  
Inference Test ◽  
Eyes Task ◽  
Test Retest Reliability ◽  
State Inference

Background. Empathy plays a key role in social understanding, but its empirical measurement has proved difficult. The Empathy Quotient (EQ) is a self-report scale designed to do just that. This series of four studies examined the reliability and validity of the EQ and determined its factor structure.Method. In Study 1, 53 people completed the EQ, Social Desirability Scale (SDS) and a non-verbal mental state inference test, the Eyes Task. In Study 2, a principal components analysis (PCA) was conducted on data from 110 healthy individuals and 62 people reporting depersonalisation (DPD). Approximately 1 year later, Study 3, involved the re-administration of the EQ (n=24) along with the Interpersonal Reactivity Index (IRI; n=28). In the last study, the EQ scores of those with DPD, a condition that includes a subjective lack of empathy, were examined in depth.Results. An association was found between the Eyes task and EQ, and only three EQ items correlated with the SDS. PCA revealed three factors: (1) ‘cognitive empathy’; (2) ‘emotional reactivity’, and (3) ‘social skills’. Test–retest reliability was good and moderate associations were found between the EQ and IRI subscales, suggesting concurrent validity. People with DPD did not show a global empathy deficit, but reported less social competence.Conclusions. The EQ is a valid, reliable scale and the different subscales may have clinical applications.

scholarly journals What Do People With Schizophrenia Do All Day? Ecological Momentary Assessment of Real-World Functioning in Schizophrenia

2019 ◽  
Author(s):  
Eric Granholm ◽  
Jason L Holden ◽  
Tanya Mikhael ◽  
Peter C Link ◽  
Joel Swendsen ◽  
...  
Keyword(s):  
Social Interactions ◽  
Real World ◽  
Ecological Momentary Assessment ◽  
Reliability And Validity ◽  
Supported Housing ◽  
Self Report ◽  
New Treatments ◽  
Test Retest Reliability ◽  
Ecological Momentary ◽  
Momentary Assessment

Abstract Schizophrenia is a major cause of disability worldwide. As new treatments for functioning are tested, the need grows to demonstrate real-world functioning gains. Ecological momentary assessment (EMA) may provide a more ecologically valid measure of functioning. In this study, smartphone-based EMA was used to signal participants with schizophrenia (N = 100) and controls (N = 71) 7 times a day for 7 days to respond to brief questionnaires about social interactions and functioning behaviors. Excellent adherence was found, with both groups completing an average of 85% of surveys and only 3% of participants with schizophrenia excluded for poor adherence. Four-week test–retest reliability was high (r = .83 for total productive behaviors). Relative to controls, participants with schizophrenia reported significantly less total productive activity (d = 1.2), fewer social interactions (d = 0.3), more nonproductive behaviors (d = 1.0; watching TV, resting), and more time at home (d = 0.8). Within the schizophrenia group, participants living independently showed better functioning on EMA relative to participants in supported housing (d = 0.8) and participants engaged in vocational activities showed better functioning than individuals not engaged in vocational activities (d = 0.55). Modest correlations were found between EMA and an in-lab self-report measure of functioning activities performed in the community, but not between EMA and measures of functional capacity or potential. This study demonstrated the feasibility, sensitivity reliability, and validity of EMA methods to assess functioning in schizophrenia. EMA provides a much-needed measure of what individuals with schizophrenia are actually doing in real-world contexts. These results also suggest that there may be important disjunctions between indices of abilities and actual real-world functioning.

scholarly journals Development and validation of continuity measures for inpatients receiving rehabilitation care

2018 ◽  
Vol 7 (4) ◽  
pp. 1
Author(s):  
Silvana L. Oliveira Sousa ◽  
Francesc Medina-Mirapeix ◽  
Pilar Escolar-Reina ◽  
Sean M. Collins ◽  
M. Carmen Lillo-Navarro
Keyword(s):  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Self Report ◽  
Satisfaction Scale ◽  
Cross Sectional ◽  
Rehabilitation Care ◽  
Individual Measure ◽  
Relational Management ◽  
Test Retest Reliability ◽  
Development And Validation

Objective: The main goal of this study was to exemplify the development of a measure of continuity of care (COC) from inpatients’ perspective. This measure is focused on several aspects related to physiotherapy.Methods: A cross-sectional self-report based psychometric study was carried out in a public hospital in southeast Spain. One hundred and fifty two patients with neurological and orthopaedic disorders who received rehabilitation care during stay at hospital were included in the study. A self-report questionnaire was used to examine experiences of patients related to the three types of COC, relational, management and informational continuity. The questionnaire also includes questions about sociodemographic characteristics, patient/therapist affiliation and trust with therapist. To examine reliability were used test-retest and internal consistency. For validation analysis, there were used convergent and known group strategies.Results: Of the 19 indicators included, 13 were selected to demonstrate adequate reliability and validity. From these indicators were generated three composite measures (Relational, management and COC index) and one individual measure (Informational continuity). Test-retest reliability indicated excellent agreement (intraclass correlation coefficient [ICC] > 0.75) for the three indexes. The range of Cronbach’s value was from 0.60 to 0.73. Total scores of all the indexes were moderately correlated with the satisfaction scale (r > 0.30). Regarding the known groups, all indexes scores were similar for men and woman. However, significant differences were found for management index and for relational index, based on trust with therapist and patient/therapist affiliation, respectively.Conclusions: The continuity self-reported measures is a valid and reliable method to assessing the COC in hospitalized patients receiving physiotherapy.

scholarly journals Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults

2015 ◽  
Vol 12 (5) ◽  
pp. 727-732 ◽  
Author(s):  
Keith P. Gennuso ◽  
Charles E. Matthews ◽  
Lisa H. Colbert
Keyword(s):  
Physical Activity ◽  
Older Adults ◽  
Sedentary Behavior ◽  
Linear Trend ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Self Report ◽  
Retest Reliability ◽  
Test Retest Reliability

Background:The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults.Methods:Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity.Results:Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = −0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r = .005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53).Conclusions:Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

Reliability and Validity of the Arthritis Hand Function Test in Adults with Osteoarthritis

1997 ◽  
Vol 17 (1) ◽  
pp. 55-66 ◽  
Author(s):  
Catherine Backman ◽  
Hazel Mackie
Keyword(s):  
Daily Living ◽  
Hand Function ◽  
Reliability And Validity ◽  
Self Report ◽  
Reliable Measure ◽  
Retest Reliability ◽  
Function Test ◽  
Valid Test ◽  
Test Retest Reliability ◽  
Physical Components

The Arthritis Hand Function Test (AHFT) has shown promise as a standardized, reliable measure of hand function in adults with rheumatoid arthritis in previous studies. This study adds to the development of the multi-item AHFT by evaluating its inter-rater and test-retest reliability in a sample of 26 adults (mean age, 67 years) with osteoarthritis. Further, because ability to perform activities of daily living (ADD is predicated on physical components such as hand function, the validity of the AHFT is examined by correlating the scores achieved by these subjects with their scores from self-report measures of physical ADL and instrumental ADL. Analysis indicates strong inter-rater reliability ( r= 0.99 or better for all AHFT items) and moderate to strong test-retest reliability (range, r= 0.74 to r=0.96). Moderate correlations for most AHFT items with physical ADL and instrumental ADL lend support to its development as a valid test of hand function.

scholarly journals Psychometric Properties of the Chinese version of the 20-item Prosopagnosia Index (PI20)

2021 ◽  
Vol 271 ◽  
pp. 01036
Author(s):  
Wen Sun ◽  
Yuzheng Wang ◽  
Jinyan Wang ◽  
Fei Luo
Keyword(s):  
Large Scale ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Chinese Version ◽  
Self Report ◽  
The Social ◽  
Empathy Quotient ◽  
Good Internal Consistency ◽  
Standardized Measurement ◽  
Test Retest Reliability

Prosopagnosia, also known as facial blindness, has attracted wide attention in the social field in recent years. However, it mainly depends on the self-report of the chief complaint in the actual diagnosis. In addition, there is a lack of standardized measurement basis, which brings a lot of inconvenience to the patients themselves and follow-up researchers. In this study, we tested the reliability and validity of the Chinese version of 20 - item prosopagnosia index (PI-20). 647 young people aged 18-45 filled in PI-20, the adult autistic quotient scale, the empathy quotient questionnaire, and completed the retest one month later. Results showed that the PI-20 has good internal consistency reliability, test-retest reliability, and has good validity. In addition, confirmatory factor analysis shows that the model can well fit the data of Chinese population and can be used for large-scale measurement. The Chinese version PI-20 is a reliable measurement for prosopagnosia.

Reliability and Validity of the Revised Psychopathy Checklist in Women Methadone Patients

Assessment ◽  
1996 ◽  
Vol 3 (2) ◽  
pp. 145-156 ◽  
Author(s):  
Megan J. Rutherford ◽  
John S. Cacciola ◽  
Arthur I. Alterman ◽  
James R. McKay
Keyword(s):  
Substance Abusers ◽  
Reliability And Validity ◽  
Self Report ◽  
Valid Measure ◽  
Psychopathy Checklist ◽  
Reliable Instrument ◽  
Methadone Patients ◽  
Test Retest Reliability ◽  
Relationship Of ◽  
The Relationship

The Revised Psychopathy Checklist (PCL-R) has been found to be a reliable and valid measure of psychopathy in men prisoners. More recently the PCL-R has been shown to be a reliable instrument in assessing psychopathy in men methadone patients. To date, only two studies have reported on the reliability of the PCL-R with women prisoners and no published studies address the question of the reliability and validity of the PCL-R with women substance abusers. This investigation examines the homogeneity and internal consistency of the PCL-R in a sample of 58 women methadone patients. Additionally, the 1-month test-retest reliability was examined along with the relationship of the PCL-R to other diagnostic and self-report measures. Results show that the PCL-R appears to be a reliable and valid measure of psychopathy in women methadone patients.

scholarly journals The Oxford Agoraphobic Avoidance Scale

2021 ◽  
pp. 1-11
Author(s):  
Sinead Lambe ◽  
Jessica C. Bird ◽  
Bao Sheng Loe ◽  
Laina Rosebrock ◽  
Thomas Kabir ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Objective Assessment ◽  
Reliability And Validity ◽  
Self Report ◽  
Social Evaluation ◽  
Internal Reliability ◽  
Retest Reliability ◽  
Item Endorsement ◽  
Test Retest Reliability

Abstract Background Agoraphobic avoidance of everyday situations is a common feature in many mental health disorders. Avoidance can be due to a variety of fears, including concerns about negative social evaluation, panicking, and harm from others. The result is inactivity and isolation. Behavioural avoidance tasks (BATs) provide an objective assessment of avoidance and in situ anxiety but are challenging to administer and lack standardisation. Our aim was to draw on the principles of BATs to develop a self-report measure of agoraphobia symptoms. Method The scale was developed with 194 patients with agoraphobia in the context of psychosis, 427 individuals in the general population with high levels of agoraphobia, and 1094 individuals with low levels of agoraphobia. Factor analysis, item response theory, and receiver operating characteristic analyses were used. Validity was assessed against a BAT, actigraphy data, and an existing agoraphobia measure. Test–retest reliability was assessed with 264 participants. Results An eight-item questionnaire with avoidance and distress response scales was developed. The avoidance and distress scales each had an excellent model fit and reliably assessed agoraphobic symptoms across the severity spectrum. All items were highly discriminative (avoidance: a = 1.24–5.43; distress: a = 1.60–5.48), indicating that small increases in agoraphobic symptoms led to a high probability of item endorsement. The scale demonstrated good internal reliability, test–retest reliability, and validity. Conclusions The Oxford Agoraphobic Avoidance Scale has excellent psychometric properties. Clinical cut-offs and score ranges are provided. This precise assessment tool may help focus attention on the clinically important problem of agoraphobic avoidance.

The Development and Validation of the Motives to Donate Scale

2017 ◽  
Vol 47 (2) ◽  
pp. 347-375 ◽  
Author(s):  
Sara Konrath ◽  
Femida Handy
Keyword(s):  
Factor Analysis ◽  
Reliability And Validity ◽  
Self Report ◽  
Internal Reliability ◽  
Public Benefits ◽  
Confirmatory Factor ◽  
Demographic Correlates ◽  
Tax Benefits ◽  
Test Retest Reliability ◽  
Development And Validation

In this article, we develop and validate a comprehensive self-report scale of why people make charitable donations, relying on a theoretical model of private versus public benefits to donors. In Study 1, we administered an initial pool of 54 items to a general adult sample online. An exploratory factor analysis supported six final factors in the Motives to Donate scale: Trust, Altruism, Social, Tax benefits, Egoism, and Constraints. We then verified this factor structure in a confirmatory factor analysis. Study 1 also examined the final 18-item scale’s demographic correlates and construct validity using the same sample. We found that the scale correlated in predictable ways with personality traits and motives to volunteer. In Study 2, we also found test–retest correlations between .67 and .80 after 2 weeks. Taken together, we provide initial evidence for the scale’s internal reliability, test–retest reliability, and validity, and we suggest future directions for research.

Sign in / Sign up

Export Citation Format

Share Document