scholarly journals Backfire effects after correcting misinformation are strongly associated with reliability

2021 ◽  
Author(s):  
Briony Swire-Thompson ◽  
Nicholas Miklaucic ◽  
John Wihbey ◽  
David Lazer ◽  
Joseph DeGutis
Keyword(s):  
Future Research ◽  
Potential Mechanism ◽  
Initial Belief ◽  
Truth Effect ◽  
Item Level ◽  
Perceived Importance ◽  
Test Retest Reliability ◽  
Backfire Effect ◽  
Corrective Information ◽  
Item Reliability

The backfire effect is when a correction increases belief in the very misconception it is attempting to correct, and it is often used as a reason not to correct misinformation. The current study aimed to test whether correcting misinformation increases belief more than a no-correction control. Furthermore, we aimed to examine whether item-level differences in backfire rates were associated with test-retest reliability or theoretically meaningful factors. These factors included worldview-related attributes, namely perceived importance and strength of pre-correction belief, and familiarity-related attributes, namely perceived novelty and the illusory truth effect. In two nearly identical experiments, we conducted a longitudinal pre/post design with N = 388 and 532 participants. Participants rated 21 misinformation items and were assigned to a correction condition or test-retest control. We found that no items backfired more in the correction condition compared to test-retest control or initial belief ratings. Item backfire rates were strongly negatively correlated with item reliability (⍴ = -.61 / -.73) and did not correlate with worldview-related attributes. Familiarity-related attributes were significantly correlated with backfire rate, though they did not consistently account for unique variance beyond reliability. While there have been previous papers highlighting the non-replicable nature of backfire effects, the current findings provide a potential mechanism for this poor replicability. It is crucial for future research into backfire effects to use reliable measures, report the reliability of their measures, and take reliability into account in analyses. Furthermore, fact-checkers and communicators should not avoid giving corrective information due to backfire concerns.

Development of the Fear of Intimacy Components Questionnaire (FICQ)

2015 ◽  
Vol 31 (4) ◽  
pp. 302-309 ◽  
Author(s):  
Maria Pedro Sobral ◽  
Maria Emília Costa
Keyword(s):  
Convergent Validity ◽  
Discriminant Validity ◽  
Two Dimensions ◽  
Dimensional Structure ◽  
Future Research ◽  
Fear Of Intimacy ◽  
Confirmatory Factor Analyses ◽  
New Instrument ◽  
Confirmatory Factor ◽  
Test Retest Reliability

Abstract. We developed a new instrument designed to measure fear of intimacy in romantic relationships. We suggest assessing fear of intimacy through two dimensions: self-revelation and dependence. The Fear of Intimacy Components Questionnaire (FICQ) was validated across three studies in which a 10-item solution systematically emerged. Consistently with a two component perspective, a two-factor solution fitted data the best: fear of losing the self (FLS) and fear of losing the other (FLO). Qualitative analyses verified content validity. Exploratory and confirmatory factor analyses tested the factor structure. Multigroup analyses supported the structural invariance across gender, age, and relationship status. Both factors showed adequate discriminant validity and internal consistency, and good 3-week period test-retest reliability. Associations between the FICQ and insecure attachment orientations demonstrated convergent validity. The association between the FICQ and relationship satisfaction above and beyond a preexisting measure offered criterion validity. By going beyond traditional self-revelation-focused conception of fear of intimacy, that is, by proposing a bi-dimensional structure to fear of intimacy, we believe that this new measure will contribute to future research on fear of intimacy.

Is There a Measurement Crisis in Disgust Research?

2020 ◽  
Author(s):  
Thomas Armstrong ◽  
Danica Wilbanks ◽  
Daniel Leong ◽  
Kean J. Hsu
Keyword(s):  
Mental Disorders ◽  
Clinical Psychology ◽  
Reliability And Validity ◽  
Self Report ◽  
Behavioral Therapies ◽  
Cognitive Behavioral Therapies ◽  
Societal Problems ◽  
Test Retest Reliability ◽  
Pathogen Avoidance ◽  
Corrective Information

Once a forgotten emotion, disgust is now studied in fields from evolutionary to clinical psychology. Although highly adaptive as a pathogen avoidance mechanism, disgust is prone to false positives. Indeed, several anxiety-related disorders involve excessive and irrational disgust. Furthermore, disgust resists corrective information, making it difficult to treat through cognitive-behavioral therapies. A deeper understanding of disgust could improve the treatment of mental disorders and other societal problems involving this peculiar emotion. However, researchers may need to improve the measurement of disgust to gain such insights. In this paper, we review psychology’s “measurement crisis” in the context of disgust. We suggest that self-report measures, though optimal in reliability, have compromised validity because the vernacular usage of disgust captures neighboring states of discomfort and disapproval. In addition to potential validity issues, we find that most non-self-report measures of disgust have questionable reliability. Internal consistency and test-retest reliability were rarely reported for psychophysiological and neural measures, but the information available suggests that these measures of disgust have poor reliability and may not support individual difference research crucial to clinical psychology. In light of this assessment, we provide several recommendations for improving the reliability and validity of disgust measurement, including renewed attention to theory.

scholarly journals Affective and cognitive components of students’ attitudes towards communication learning - validation of the Communication Skills Attitude Scale in a cohort of polish medical students

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Piotr Przymuszała ◽  
Magdalena Cerbin-Koczorowska ◽  
Patrycja Marciniak-Stępak ◽  
Łucja Zielińska-Tomczak ◽  
Martyna Piszczek ◽  
...  
Keyword(s):  
Medical Students ◽  
Communication Skills ◽  
Behavioral Control ◽  
Attitude Scale ◽  
Future Research ◽  
Perceived Behavioral Control ◽  
Negative Attitudes ◽  
Retest Reliability ◽  
Cognitive Components ◽  
Test Retest Reliability

Abstract Background The Communication Skills Attitude Scale (CSAS) is a recognized tool for assessment of attitudes towards communication learning. In the original version, it consists of 26 items divided on theoretical assumptions into two subscales: Positive and Negative Attitudes Scales. However, the evidence for its structure seems unsatisfactory, and a simple division into positive and negative attitudes may be insufficient to describe attitudes of medical students towards communication learning. Moreover, the existing evidence of the test-retest reliability of the CSAS seems limited. Consequently, this study aimed to provide more evidence on its psychometric properties while validating the CSAS questionnaire in a cohort of Polish medical students. Methods The CSAS was translated, adapted into Polish, and validated in a cohort of 389 Polish medical students. Statistical analysis involved, among others, parallel analysis to determine the number of factors, confirmatory factor analysis to compare the proposed model with theory-based ones, and test-retest reliability analysis. Results Conducted analysis revealed that in the examined population, the CSAS should rather consist of four than two subscales. Proposed four subscales addressed perceived outcomes of communication learning, positive and negative attitudes towards it (affective components), and factors motivating students to learn communication (a cognitive component of attitudes). Results of test-retest reliability were satisfactory for individual items and subscales. Conclusions This study presented a valid and reliable version of the Communication Skills Attitude Scale for Polish medical students and confirmed previous assumptions that CSAS may also be appropriate for assessment of affective and cognitive components of attitudes. Future research should, based on Ajzen’s Theory of Planned Behavior, make attempts to develop a tool assessing not only attitudes but also subjective norms and perceived behavioral control.

A Test-Retest Reliability Generalization Meta-Analysis of Judgments Via the Policy-Capturing Technique

2021 ◽  
pp. 109442812110115
Author(s):  
Ze Zhu ◽  
Alan J. Tomassetti ◽  
Reeshad S. Dalal ◽  
Shannon W. Schrader ◽  
Kevin Loo ◽  
...  
Keyword(s):  
Best Practice ◽  
Meta Analysis ◽  
Temporal Stability ◽  
Future Research ◽  
Policy Capturing ◽  
Reliability Estimate ◽  
Reliability Generalization ◽  
Retest Reliability ◽  
Reliability Estimates ◽  
Test Retest Reliability

Policy capturing is a widely used technique, but the temporal stability of policy-capturing judgments has long been a cause for concern. This article emphasizes the importance of reporting reliability, and in particular test-retest reliability, estimates in policy-capturing studies. We found that only 164 of 955 policy-capturing studies (i.e., 17.17%) reported a test-retest reliability estimate. We then conducted a reliability generalization meta-analysis on policy-capturing studies that did report test-retest reliability estimates—and we obtained an average reliability estimate of .78. We additionally examined 16 potential methodological and substantive antecedents to test-retest reliability (equivalent to moderators in validity generalization studies). We found that test-retest reliability was robust to variation in 14 of the 16 factors examined but that reliability was higher in paper-and-pencil studies than in web-based studies and was higher for behavioral intention judgments than for other (e.g., attitudinal and perceptual) judgments. We provide an agenda for future research. Finally, we provide several best-practice recommendations for researchers (and journal reviewers) with regard to (a) reporting test-retest reliability, (b) designing policy-capturing studies for appropriate reportage, and (c) properly interpreting test-retest reliability in policy-capturing studies.

scholarly journals The Reliability, Validity and Normative Scores of the Bene-Anthony Family Relations Test for Use With Arab Children

2021 ◽  
Vol 12 ◽  
Author(s):  
Abdrabo Soliman ◽  
Abdel-Salam G. Abdel-Salam ◽  
Mervat Ahmed
Keyword(s):  
Family Relations ◽  
Clinical Status ◽  
Psychological Disorder ◽  
Normative Values ◽  
Future Research ◽  
Retest Reliability ◽  
Arab Children ◽  
Starting Point ◽  
Test Retest Reliability ◽  
The Impact

Background: The Bene-Anthony Family Relations Test (BAFRT) is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic and back-translated to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children (n = 269) and children diagnosed with a psychological disorder (n = 125), all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area.

scholarly journals What’s important to you? Socioeconomic inequalities in the perceived importance of health compared to other life domains

2022 ◽  
Vol 22 (1) ◽  
Author(s):  
Sanne E. Verra ◽  
Maartje P. Poelman ◽  
Andrea L. Mudd ◽  
Emely de Vet ◽  
Sofie van Rongen ◽  
...  
Keyword(s):  
Low Income ◽  
Educational Level ◽  
Latent Class ◽  
Financial Strain ◽  
Future Research ◽  
Life Domains ◽  
Perceived Importance ◽  
Long Life ◽  
Higher Educational ◽  
Future Focus

Abstract Background Pressing issues, like financial concerns, may outweigh the importance people attach to health. This study tested whether health, compared to other life domains, was considered more important by people in high versus low socioeconomic positions, with future focus and financial strain as potential explanatory factors. Methods A cross-sectional survey was conducted in 2019 among N=1,330 Dutch adults. Participants rated the importance of two health-related domains (not being ill, living a long life) and seven other life domains (e.g., work, family) on a five-point scale. A latent class analysis grouped participants in classes with similar patterns of importance ratings. Differences in class membership according to socioeconomic position (indicated by income and education) were examined using structural equation modelling, with future focus and financial strain as mediators. Results Three classes were identified, which were defined as: neutralists, who found all domains neutral or unimportant (3.5% of the sample); hedonists, who found most domains important except living a long life, work, and religion (36.2%); and maximalists, who found nearly all domains important, including both health domains (60.3%). Of the neutralists, 38% considered not being ill important, and 30% considered living a long life important. For hedonists, this was 92% and 39%, respectively, and for maximalists this was 99% and 87%, respectively. Compared to belonging to the maximalists class, a low income predicted belonging to the neutralists, and a higher educational level and unemployment predicted belonging to the hedonists. No mediation pathways via future focus or financial strain were found. Conclusions Lower income groups were less likely to consider not being ill important. Those without paid employment and those with a higher educational level were less likely to consider living a long life important. Neither future focus nor financial strain explained these inequalities. Future research should investigate socioeconomic differences in conceptualisations of health, and if inequalities in the perceived importance of health are associated with inequalities in health. To support individuals dealing with challenging circumstances in daily life, health-promoting interventions could align to the life domains perceived important to reach their target group and to prevent widening socioeconomic health inequalities.

Elementary Teachers’ Knowledge and Use of Interventions and Barriers to Promoting Student Self-Determination

2010 ◽  
Vol 45 (3) ◽  
pp. 149-156 ◽  
Author(s):  
Hyun-Jeong Cho ◽  
Michael Wehmeyer ◽  
Neal Kingston
Keyword(s):  
Academic Achievement ◽  
No Child Left Behind ◽  
Elementary Teachers ◽  
Special Educators ◽  
Self Determination ◽  
Future Research ◽  
Student Academic Achievement ◽  
Left Behind ◽  
Education Improvement ◽  
Perceived Importance

The No Child Left Behind Act (2001) and the Individuals with Disabilities Education Improvement Act (2004) emphasize accountability to improve student academic achievement. Promoting self-determination has been proposed as a means to achieving this outcome. Elementary teachers in 30 states were surveyed to measure (a) their perceived importance of self-determination, (b) to what extent they teach it, and (c) the barriers that inhibit them from teaching it. Both general and special educators assigned considerable importance to self-determination instruction and reported at least occasionally providing such instruction. The authors found a lack of congruence between the value teachers place on promoting self-determination and the time they devote to teaching it. Limitations and implications are discussed, and suggestions for future research are offered.

Quality of Youth Sport Friendships: Measurement Development and Validation

1999 ◽  
Vol 21 (2) ◽  
pp. 145-166 ◽  
Author(s):  
Maureen R. Weiss ◽  
Alan L. Smith
Keyword(s):  
Psychosocial Development ◽  
Youth Sport ◽  
Friendship Quality ◽  
Measurement Development ◽  
Future Research ◽  
Quality Scale ◽  
Core Set ◽  
Test Retest Reliability ◽  
Development And Validation

The role of peers has been neglected in research on youth psychosocial development in sport. The purpose of the present study was to develop and validate a measure of youth sport friendship quality for the purpose of facilitating such research. Dimensions and higher order themes found in Weiss, Smith, and Theeboom’s (1996) qualitative study of sport friendships among children and adolescents, as well as a core set of items from previous research (Parker & Asher, 1993), were used to develop and refine items for a sport friendship quality scale. Over the course of three studies, content, factorial, and construct validity, as well as internal consistency and test-retest reliability, were demonstrated for the Sport Friendship Quality Scale (SFQS). Future research is recommended to examine the role of children’s sport friendship quality on psychosocial development in the physical domain.

Career Indecision Profile-65 Scores: Test–Retest Reliability and Measurement Equivalence in College and Noncollege Samples

2018 ◽  
Vol 27 (3) ◽  
pp. 510-526 ◽  
Author(s):  
Casey J. Zobell ◽  
Margaret M. Nauta ◽  
Matthew S. Hesson-McInnis
Keyword(s):  
Career Counseling ◽  
Measurement Equivalence ◽  
Career Indecision ◽  
Future Research ◽  
Confirmatory Factor Analyses ◽  
Student Sample ◽  
Retest Reliability ◽  
College Student Sample ◽  
Two Samples ◽  
Test Retest Reliability

The Career Indecision Profile-65 (CIP-65) is a relatively new measure of career indecision that appears to have promise for use in career counseling and research. We sought to expand the information available to those evaluating the CIP-65 for potential use by assessing its measurement equivalence in college ( N = 529) and noncollege ( N = 472) samples and its scores’ test–retest reliability in a subset of the college–student sample ( n = 107). Six-week test–retest reliability coefficients ranged from .58 (interpersonal conflicts) to .85 (choice/commitment anxiety) for the subscale scores. Confirmatory factor analyses revealed that the CIP-65’s four-factor structure fit the data well in both the college and noncollege samples. The CIP-65 scores were configurally invariant in the two samples, but we did not find support for metric invariance. We offer explanations for these findings, discuss implications for practice, and present ideas for future research.

The American Meritocracy Myth Stress: Scale Development and Initial Validation

2020 ◽  
Vol 49 (1) ◽  
pp. 80-105
Author(s):  
Yunkyoung Loh Garrison ◽  
Alexander Rice ◽  
William Ming Liu
Keyword(s):  
Factor Analysis ◽  
Social Class ◽  
Psychological Stress ◽  
Empirical Support ◽  
Hard Work ◽  
Future Research ◽  
Stress Scale ◽  
Class Mobility ◽  
The Social ◽  
Test Retest Reliability

The purpose of this study is to develop the American Meritocracy Myth Stress Scale (AMMSS), capable of assessing college students’ psychological stress within the context of the pervasive myth of meritocracy. This psychological stress stems from the association between their perceptions of their own hard work and social class mobility. Underpinned by the social class worldview model-revised, American meritocracy myth stress is conceptualized as the psychological stress that individuals experience when disequilibrium exists between the dominant and pervasive meritocracy ideology and their efforts to climb the social ladder through hard work. Three substudies were conducted for exploratory factor analysis (Study 1: n = 887); confirmatory factor analysis, validity, and measurement invariance (Study 2: n = 903); and 2-week test–retest reliability (Study 3: n = 37). The results of these studies provide empirical support for the AMMSS. We discuss implications for practice, advocacy, training, and future research.

Sign in / Sign up

Export Citation Format

Share Document