scholarly journals A Comparison of the Sensitivity of Four Indirect Evaluation Measures to Evaluative Information

Author(s):  
Yoav Bar-Anan ◽  
Brian A. Nosek

Indirect evaluation measures are used as a dependent measure to assess the impact of experimental interventions on shifting pre-existing attitudes or creating new attitudes. In four experiments (total N = 13,894), we compared the sensitivity of four indirect evaluation measures to evaluative information about two novel targets. Evaluative sensitivity was strongest for the Implicit Association Test (IAT). Other measures were more similar in their sensitivity, but the pattern, from stronger to the weakest was the Affect Misattribution Procedure (AMP), the Sorting Paired Features (SPF), and then Evaluative Priming task (EPT). To the extent that these findings are generalizable to related research applications, these results suggest that the measures differ in their research efficiency (power). For example, to achieve 80% power to detect the evaluative learning effect in the present studies, direct self-report would require 10 participants, the IAT 28 participants, the AMP 57, the SPF 79, and the EPT 131.

2017 ◽  
Author(s):  
Yoav Bar-Anan ◽  
Brian A. Nosek

Indirect evaluation measures are used as a dependent measure to assess the impact of experimental interventions on shifting pre-existing attitudes or creating new attitudes. In four experiments (total N = 13,894), we compared the sensitivity of four indirect evaluation measures to evaluative information about two novel targets. Evaluative sensitivity was strongest for the Implicit Association Test (IAT). Other measures were more similar in their sensitivity, but the pattern, from stronger to the weakest was the Affect Misattribution Procedure (AMP), the Sorting Paired Features (SPF), and then Evaluative Priming task (EPT). To the extent that these findings are generalizable to related research applications, these results suggest that the measures differ in their research efficiency (power). For example, to achieve 80% power to detect the evaluative learning effect in the present studies, direct self-report would require 10 participants, the IAT 28 participants, the AMP 57, the SPF 79, and the EPT 131.


2020 ◽  
Author(s):  
Tal Moran ◽  
Yoav Bar-Anan ◽  
Bar-Anan Lab ◽  
Tzipora Dror

Evaluative Conditioning (EC) effects refer to changes in the liking of a neutral (conditioned) stimulus (CS) due to pairing with an affective (unconditioned) stimulus (US). Some research found that EC effects are resistant to presentations of the CS without the US, whereas other studies found evidence for extinction effects. A recent study found extinction of EC only when participants rated the CS before and after the CS-only presentations, but not when CS evaluation was measured once or indirectly with the Evaluative Priming task. In two experiments (total N= 2,181), we found no evidence that indirectly measured evaluation is sensitive to extinction, using an indirect evaluation measure with high sensitivity – the Implicit Association Test. However, unlike previous research, we found that evaluation of any stimuli (and not only the CS) before the CS-only presentations decreases self-reported EC effects. Our results are compatible with the conclusion that the extinction of EC is limited to evaluation measured directly. We discuss the theoretical implications of these results, and conclude that the specific conditions (and mechanisms) that change the direct evaluative response are yet to be clarified.


2008 ◽  
Vol 24 (4) ◽  
pp. 226-236 ◽  
Author(s):  
Brian A. Nosek ◽  
Jeffrey J. Hansen

In an effort to remove a presumed confound of extrapersonal associations, Olson and Fazio (2004 ) introduced procedural modifications to attitude versions of the Implicit Association Test (IAT). We hypothesized that the procedural changes increased the likelihood that participants would explicitly evaluate the target concepts (e.g., rating Black and White faces as liked or disliked). Results of a mega-study covering 58 topics and six additional studies (Total N = 15,667) suggest that: (a) after personalizing, participants are more likely to explicitly evaluate target concepts instead of categorizing them according to the performance rules, (b) this effect appears to account for the personalized IAT’s enhanced correlations with self-report, (c) personalizing does not alter the relationship between the IAT and cultural knowledge, and (d) personalized and original procedures each capture unique attitude variation. These results provide an alternative interpretation of the impact of personalizing the IAT. Additional innovation may determine whether personalizing implicit cognition is viable.


2020 ◽  
pp. 014616722091663 ◽  
Author(s):  
Dario Cvencek ◽  
Andrew N. Meltzoff ◽  
Craig D. Maddox ◽  
Brian A. Nosek ◽  
Laurie A. Rudman ◽  
...  

This meta-analysis evaluated theoretical predictions from balanced identity theory (BIT) and evaluated the validity of zero points of Implicit Association Test (IAT) and self-report measures used to test these predictions. Twenty-one researchers contributed individual subject data from 36 experiments (total N = 12,773) that used both explicit and implicit measures of the social–cognitive constructs. The meta-analysis confirmed predictions of BIT’s balance–congruity principle and simultaneously validated interpretation of the IAT’s zero point as indicating absence of preference between two attitude objects. Statistical power afforded by the sample size enabled the first confirmations of balance–congruity predictions with self-report measures. Beyond these empirical results, the meta-analysis introduced a within-study statistical test of the balance–congruity principle, finding that it had greater efficiency than the previous best method. The meta-analysis’s full data set has been publicly archived to enable further studies of interrelations among attitudes, stereotypes, and identities.


2020 ◽  
pp. 014616722097770
Author(s):  
Pieter Van Dessel ◽  
Kate Ratliff ◽  
Skylar M. Brannon ◽  
Bertram Gawronski ◽  
Jan De Houwer

Research suggests that people sometimes perceive a relationship between stimuli when no such relationship exists (i.e., illusory correlation). Illusory-correlation effects are thought to play a central role in the formation of stereotypes and evaluations of minority versus majority groups, often leading to less favorable impressions of minorities. Extant theories differ in terms of whether they attribute illusory-correlation effects to processes operating during learning (belief formation) or measurement (belief expression), and whether different evaluation measures should be differentially sensitive to illusory-correlation effects. Past research found mixed evidence for dissociative effects of illusory-correlation manipulations on measures of implicit (i.e., automatic) and explicit (i.e., controlled) evaluation. Four high-powered studies obtained illusory-correlation effects on explicit evaluations, but not implicit evaluations probed with an Implicit Association Test, Evaluative Priming Task, and Affect Misattribution Procedure. The results are consistent with theories that attribute illusory-correlation effects to processes during belief expression.


2019 ◽  
Vol 11 (1) ◽  
pp. 56-63 ◽  
Author(s):  
Eva Fourakis ◽  
Jeremy Cone

A classic finding in the person perception literature is that information order is an important factor in the impressions we form of others. But how does order influence the formation of implicit evaluations? In three preregistered experiments including nearly 900 participants, we find evidence for a strong primacy effect even at the implicit level. This occurred on an affect misattribution procedure (Study 1), an evaluative priming task (Study 2), and an implicit association test (Study 3). These findings suggest that, just as explicit impressions are susceptible to primacy effects, so too are implicit ones. Implications for theories of evaluative conditioning and attitudes are discussed.


2016 ◽  
Author(s):  
Brian A. Nosek ◽  
Frederick L. Smyth

Recent theoretical and methodological innovations suggest a distinction between automatic and controlled evaluative processes. We report a construct validation investigation of the Implicit Association Test (IAT) as a measure of attitudes. In Study 1, a composite of 57 unique studies (total N=13,165), correlated two-factor (implicit and explicit attitudes) structural models fit the data better than single-factor (attitude) models for each of 57 different domains (e.g., cats-dogs). In Study 2, we distinguished attitude and method factors with a multitrait-multimethod design: N=287 participants were measured on both self-report and IAT for up to seven attitude domains. With systematic method variance accounted for, a correlated two-factor-per-attitude- contrast model was again superior to a single-factor-per-attitude specification. We conclude that these implicit and explicit measures assess related but distinct attitude constructs.


Author(s):  
Sarah Teige-Mocigemba ◽  
Manuel Becker ◽  
Jeffrey W. Sherman ◽  
Regina Reichardt ◽  
Karl Christoph Klauer

Abstract. The Affect Misattribution Procedure (AMP) has been forwarded as one of the most promising alternatives to the Implicit Association Test and the evaluative-priming task for measuring attitudes such as prejudice indirectly. We investigated whether the AMP is indeed able to detect an evaluative out-group bias. In contrast to recent conclusions about the robustness of AMP effects, six out of seven pilot studies indicated that participants did not show any prejudice effects in the AMP. Yet, these pilot studies were not fully conclusive with regard to our research question because they investigated different domains of prejudice, used small sample sizes, and employed a modified AMP version. In a preregistered, high-powered AMP study, we therefore examined whether the standard AMP does reveal prejudice against Turks, the biggest minority in Germany, and found a significant, albeit very small prejudice effect. We discuss possible reasons for the AMP’s weak sensitivity to evaluations in socially sensitive domains.


2014 ◽  
Vol 45 (6) ◽  
pp. 437-448 ◽  
Author(s):  
Colin Tucker Smith ◽  
Jan De Houwer

In two studies, participants read persuasive messages introduced by an attractive (Study 1) or likeable (Study 2) source before completing measures of implicit and explicit evaluations. The persuasive messages were in favor of an unfamiliar brand of facial soap (Study 1) and the implementation of comprehensive examinations at the participants’ university (Study 2). Results showed that persuasive messages had a stronger impact on an Implicit Association Test when the source was high in attractiveness or likeability (Study 1 and Study 2); responses on an Affect Misattribution Procedure, though in the predicted direction, were not significantly impacted by a source high in likeability (Study 2). These findings parallel those of numerous studies that, however, have looked almost exclusively at persuasion of explicit evaluations. They confirm that implicit evaluations can be changed through direct persuasive appeals and provide new information about the conditions under which persuasion of implicit evaluations can be found.


2018 ◽  
Vol 10 (2) ◽  
pp. 266-273 ◽  
Author(s):  
Pieter Van Dessel ◽  
Yang Ye ◽  
Jan De Houwer

It is often assumed that, once established, spontaneous or implicit evaluations are resistant to immediate change. Recent research contradicts this theoretical stance, showing that a person’s implicit evaluations of an attitude object can be changed rapidly in the face of new counterattitudinal information. Importantly, it remains unknown whether such changes can also occur for deep-rooted implicit evaluations of well-known attitude objects. We address this question by examining whether the acquisition of negative information changes implicit evaluations of a well-known positive historic figure: Mahatma Gandhi. We report three experiments showing rapid changes in implicit evaluations of Gandhi as measured with an affect misattribution procedure and evaluative priming task but not with an implicit association test (IAT). These findings suggest that implicit evaluations based on deep-rooted representations are subjective to rapid changes in the face of expectancy-violating information while pointing to limitations of the IAT for assessing such changes.


Sign in / Sign up

Export Citation Format

Share Document