scholarly journals Does honesty require time? Two preregistered replications of Experiment 2 of Shalvi, Eldar, and Bereby-Meyer (2012)

2019 ◽  
Author(s):  
Ine Van der Cruyssen ◽  
Jonathan D'hondt ◽  
Ewout Meijer ◽  
Bruno Verschuere

Shalvi, Eldar, and Bereby-Meyer (2012) found across two studies (each N = 72) that time-pressure increased cheating. These findings suggest that dishonesty comes naturally, while honesty requires overcoming the initial tendency to cheat. While statistically significant, a Bayesian reanalysis indicates that the original results had low evidential strength. In a replication attempt of their Experiment 2, time-pressure did not increase cheating (N = 428, rpb = 0.05, BF01 = 16.06). One important deviation from the original procedure, however, was the use of mass testing. In a second - direct - replication with small groups of participants, time pressure also did not increase cheating (N = 297, rpb = 0.03, BF01 = 9.59). These findings indicate that the original study may have overestimated the true effect of time pressure on cheating and/or the generality of the effect beyond the original context.

2020 ◽  
Vol 31 (4) ◽  
pp. 460-467 ◽  
Author(s):  
Ine Van der Cruyssen ◽  
Jonathan D’hondt ◽  
Ewout Meijer ◽  
Bruno Verschuere

Shalvi, Eldar, and Bereby-Meyer (2012) found across two studies ( N = 72 for each) that time pressure increased cheating. These findings suggest that dishonesty comes naturally, whereas honesty requires overcoming the initial tendency to cheat. Although the study’s results were statistically significant, a Bayesian reanalysis indicates that they had low evidential strength. In a direct replication attempt of Shalvi et al.’s Experiment 2, we found that time pressure did not increase cheating, N = 428, point biserial correlation ( rpb) = .05, Bayes factor (BF)01 = 16.06. One important deviation from the original procedure, however, was the use of mass testing. In a second direct replication with small groups of participants, we found that time pressure also did not increase cheating, N = 297, rpb = .03, BF01 = 9.59. These findings indicate that the original study may have overestimated the true effect of time pressure on cheating and the generality of the effect beyond the original context.


2007 ◽  
Vol 25 (2) ◽  
pp. 163-172 ◽  
Author(s):  
David Rawlings ◽  
Ann Locarnini

The Creativity Scale for Diverse Domains (CSDD) of Kaufman and Baer (2004), measures self-reported creativity in nine different domains, as well as “creativity in general.” The study reports a criterion validation of the scale, using small groups of professional scientists and artists, in addition to two groups of undergraduate students planning major studies in the arts/humanities or in science/mathematics. Similar patterns of inter-correlation between items, and a similar factor structure, were found to those reported in the original study. In support of the validity of the scale, professional scientists were clearly highest on items measuring creativity in science and mathematics; professional artists on items measuring creativity in art and general creativity. There were minimal differences between the student groups. The results provide substantial support for the usefulness of the CSDD when a short measure of creativity in different areas is sought.


2004 ◽  
Vol 18 (4) ◽  
pp. 265-278 ◽  
Author(s):  
Antonio Chirumbolo ◽  
Stefano Livi ◽  
Lucia Mannetti ◽  
Antonio Pierro ◽  
Arie W. Kruglanski

Three experiments investigated the consequences of the epistemic motivation toward closure on the emergence of creative interactions in small groups. In the first study, need for closure was manipulated via time pressure. Results showed that in groups under high need for closure (i.e. under time pressure) the percentage of creative acts during group discussion was reduced. The second study replicated this result using an individual differences operationalization of the need for closure. In the third study, groups composed of individuals high (versus low) in need for closure performed less creatively, and exhibited less ideational fluidity during group interaction. Moreover, it was demonstrated that conformity pressure mediates the negative relationship between dispositional need for closure and group creativity. Copyright © 2004 John Wiley & Sons, Ltd.


2021 ◽  
Author(s):  
Kelsey Lucca ◽  
Arthur Capelier-Mourguy ◽  
Krista Byers-Heinlein ◽  
Laura Cirelli ◽  
Rodrigo Dal Ben ◽  
...  

Evaluating others’ actions as praiseworthy or blameworthy is a fundamental aspect of human nature. A seminal study published in 2007 suggested that the ability to form social evaluations based on third-party interactions emerges within the first year of life, considerably earlier than previously thought (Hamlin, Wynn, & Bloom, 2007). In this study, infants demonstrated a preference for a character (i.e., a shape with eyes) who helped, over one who hindered, another character who tried but failed to climb a hill. This study sparked a new line of inquiry into infants’ social evaluations; however, numerous attempts to replicate the original findings yielded mixed results, with some reporting effects not reliably different from chance. These failed replications point to at least two possibilities: (1) the original study may have overestimated the true effect size of infants’ preference for helpers, or (2) key methodological or contextual differences from the original study may have compromised the replication attempts. Here we present a pre-registered, closely coordinated, multi-laboratory, standardized study aimed at replicating the helping/hindering finding using a well-controlled video version of the hill show. We intended to (1) provide a precise estimate of the true effect size of infants’ preference for helpers over hinderers, and (2) determine the degree to which infants’ preferences are based on social features of the Helper/Hinderer scenarios. XYZ labs participated in the study yielding a total sample size of XYZ infants between the ages of 5.5 and 10.5 months. Brief summary of results will be added after data collection.


Author(s):  
Michael Joseph Messina ◽  
Simon Teves ◽  
Giulia Wally Scurati ◽  
Marina Carulli ◽  
Francesco Ferrise

Abstract As the popularity of winter outdoor sports is increasing, a growing number of users are engaging in activities in uncontrolled terrain, thus training for avalanche rescue is more important than ever. Traditional training takes place through workshops and in field sessions, presenting limitations to the training availability, since they require time, organization and specific weather conditions. This is problematic since the use of transceivers to locate buried individuals is not trivial and requires practice. Virtual Reality (VR) training has shown to be effective in several fields, especially in the context of hazardous conditions and emergencies, which require decision making under time pressure and management of complex tools in uncontrolled or unsafe environments. Examples include disaster medicine, military operations, and other fields in which actions must be performed precisely in short time frame. In this work, we present the development of an immersive VR system for avalanche rescue training as a complementary tool to the traditional techniques in order to prepare the trainee for field training sessions. We discuss the definition of the system requirements, the design and implementation of the tool, and considerations regarding hardware and software. Finally, we discuss possible limitations and future development.


2018 ◽  
Author(s):  
Robbie Cornelis Maria van Aert

More and more scientific research gets published nowadays, asking for statistical methods that enable researchers to get an overview of the literature in a particular research field. For that purpose, meta-analysis methods were developed that can be used for statistically combining the effect sizes from independent primary studies on the same topic. My dissertation focuses on two issues that are crucial when conducting a meta-analysis: publication bias and heterogeneity in primary studies’ true effect sizes. Accurate estimation of both the meta-analytic effect size as well as the between-study variance in true effect size is crucial since the results of meta-analyses are often used for policy making. Publication bias distorts the results of a meta-analysis since it refers to situations where publication of a primary study depends on its results. We developed new meta-analysis methods, p-uniform and p-uniform*, which estimate effect sizes corrected for publication bias and also test for publication bias. Although the methods perform well in many conditions, these and the other existing methods are shown not to perform well when researchers use questionable research practices. Additionally, when publication bias is absent or limited, traditional methods that do not correct for publication bias outperform p¬-uniform and p-uniform*. Surprisingly, we found no strong evidence for the presence of publication bias in our pre-registered study on the presence of publication bias in a large-scale data set consisting of 83 meta-analyses and 499 systematic reviews published in the fields of psychology and medicine. We also developed two methods for meta-analyzing a statistically significant published original study and a replication of that study, which reflects a situation often encountered by researchers. One method is a frequentist whereas the other method is a Bayesian statistical method. Both methods are shown to perform better than traditional meta-analytic methods that do not take the statistical significance of the original study into account. Analytical studies of both methods also show that sometimes the original study is better discarded for optimal estimation of the true effect size. Finally, we developed a program for determining the required sample size in a replication analogous to power analysis in null hypothesis testing. Computing the required sample size with the method revealed that large sample sizes (approximately 650 participants) are required to be able to distinguish a zero from a small true effect.Finally, in the last two chapters we derived a new multi-step estimator for the between-study variance in primary studies’ true effect sizes, and examined the statistical properties of two methods (Q-profile and generalized Q-statistic method) to compute the confidence interval of the between-study variance in true effect size. We proved that the multi-step estimator converges to the Paule-Mandel estimator which is nowadays one of the recommended methods to estimate the between-study variance in true effect sizes. Two Monte-Carlo simulation studies showed that the coverage probabilities of Q-profile and generalized Q-statistic method can be substantially below the nominal coverage rate if the assumptions underlying the random-effects meta-analysis model were violated.


2020 ◽  
Vol 41 (3) ◽  
pp. 124-132
Author(s):  
Marc-André Bédard ◽  
Yann Le Corff

Abstract. This replication and extension of DeYoung, Quilty, Peterson, and Gray’s (2014) study aimed to assess the unique variance of each of the 10 aspects of the Big Five personality traits ( DeYoung, Quilty, & Peterson, 2007 ) associated with intelligence and its dimensions. Personality aspects and intelligence were assessed in a sample of French-Canadian adults from real-life assessment settings ( n = 213). Results showed that the Intellect aspect was independently associated with g, verbal, and nonverbal intelligence while its counterpart Openness was independently related to verbal intelligence only, thus replicating the results of the original study. Independent associations were also found between Withdrawal, Industriousness and Assertiveness aspects and verbal intelligence, as well as between Withdrawal and Politeness aspects and nonverbal intelligence. Possible explanations for these associations are discussed.


1996 ◽  
Vol 12 (1) ◽  
pp. 14-22
Author(s):  
R. Esteve ◽  
A. Godoy

The aim of the present paper was to test the effects of response mode (choice vs. judgment) on decision-making strategies when subjects were faced with the task of deciding the adequacy of a set of tests for a specific assessment situation. Compared with choice, judgment was predicted to lead to more information sought, more time spent on the task, a less variable pattern of search, and a greater amount of interdimensional search. Three variables hypothesized as potential moderators of the response mode effects are also studied: time pressure, information load and decision importance. Using an information board, 300 subjects made decisions (choices and judgments) on tests for a concrete assessment situation, under high or low time pressure, high or low information load, and high or low decision importance. Response mode produced strong effects on all measures of decision behavior except for pattern of search. Moderator effects occurred for time pressure and information load.


2008 ◽  
Vol 29 (4) ◽  
pp. 205-216 ◽  
Author(s):  
Stefan Krumm ◽  
Lothar Schmidt-Atzert ◽  
Kurt Michalczyk ◽  
Vanessa Danthiir

Mental speed (MS) and sustained attention (SA) are theoretically distinct constructs. However, tests of MS are very similar to SA tests that use time pressure as an impeding condition. The performance in such tasks largely relies on the participants’ speed of task processing (i.e., how quickly and correctly one can perform the simple cognitive tasks). The present study examined whether SA and MS are empirically the same or different constructs. To this end, 24 paper-pencil and computerized tests were administered to 199 students. SA turned out to be highly related to MS task classes: substitution and perceptual speed. Furthermore, SA showed a very close relationship with the paper-pencil MS factor. The correlation between SA and computerized speed was considerably lower but still high. In a higher-order general speed factor model, SA had the highest loading on the higher-order factor; the higher-order factor explained 88% of SA variance. It is argued that SA (as operationalized with tests using time pressure as an impeding condition) and MS cannot be differentiated, at the level of broad constructs. Implications for neuropsychological assessment and future research are discussed.


Sign in / Sign up

Export Citation Format

Share Document