The Replication Process

2021 ◽  
pp. 133-151
Author(s):  
R. Barker Bausell

While replication of research is the ultimate arbitrator of reproducibility, the process is a bit more complex than it appears. And, like any empirical study, a replication can itself be wrong. However, replications are the best tool available for determining reproducibility if (a) they employ sufficient statistical power; (b) they follow the original study procedures as closely as possible (sans any questionable research practices present therein); (c) their investigators are able to obtain the necessary information, advice, and materials from the original authors; and (d) the replication protocol is preregistered. The chapter describes different types of replications, such as exact (seldom possible for experimental research), direct (the recommended approach, which involves employing the same methodological procedures, outcome variables, and statistical approaches as the original study), conceptual (not recommended since they customarily presume the original results to be correct and are conducted to determine the extent to which said results can be extended), self (primarily useful for the original investigators to convince themselves of the validity of a finding via a replication of an original study to ensure that its results are reproducible), and partial (seldom necessary but useful when there is no alternative, such as when all of the procedures cannot be duplicated for ethical reasons).

Author(s):  
Laura Mieth ◽  
Raoul Bell ◽  
Axel Buchner

Abstract. This registered report aims at replicating the so-called “mnemonic time-travel” effect. Aksentijevic, Brandt, Tsakanikos, and Thorpe (2019) reported that memory was improved when their participants experienced backward motion before a memory test in comparison to when they experienced forward motion or no motion. This finding was interpreted as suggesting that backward motion brought individuals back to the moment of encoding. In the original study, the mnemonic time-travel effect was robustly found with various types of backward motion (real, simulated, and imagined). Such a spectacular finding calls for a preregistered replication. To determine the robustness of the effect, we performed a close replication of Experiment 4 of Aksentijevic et al. in which the mnemonic time-travel effect was most pronounced. Despite sufficient statistical power to detect an even considerably smaller effect than the one reported by Aksentijevic et al., we found no significant differences among the different motion conditions. The present results thus disconfirm the idea that experiencing backward motion improves memory which suggests that the empirical robustness of the mnemonic time travel effect should be further scrutinized before any conclusions about mnemonic space and time can be drawn.


2019 ◽  
Vol 227 (4) ◽  
pp. 261-279 ◽  
Author(s):  
Frank Renkewitz ◽  
Melanie Keiner

Abstract. Publication biases and questionable research practices are assumed to be two of the main causes of low replication rates. Both of these problems lead to severely inflated effect size estimates in meta-analyses. Methodologists have proposed a number of statistical tools to detect such bias in meta-analytic results. We present an evaluation of the performance of six of these tools. To assess the Type I error rate and the statistical power of these methods, we simulated a large variety of literatures that differed with regard to true effect size, heterogeneity, number of available primary studies, and sample sizes of these primary studies; furthermore, simulated studies were subjected to different degrees of publication bias. Our results show that across all simulated conditions, no method consistently outperformed the others. Additionally, all methods performed poorly when true effect sizes were heterogeneous or primary studies had a small chance of being published, irrespective of their results. This suggests that in many actual meta-analyses in psychology, bias will remain undiscovered no matter which detection method is used.


2015 ◽  
Author(s):  
Sheung-Chi Chow ◽  
Tai-Yuen Hon ◽  
Wing-Keung Wong ◽  
Kai Yin Woo

Author(s):  
Steven Bernstein

This commentary discusses three challenges for the promising and ambitious research agenda outlined in the volume. First, it interrogates the volume’s attempts to differentiate political communities of legitimation, which may vary widely in composition, power, and relevance across institutions and geographies, with important implications not only for who matters, but also for what gets legitimated, and with what consequences. Second, it examines avenues to overcome possible trade-offs from gains in empirical tractability achieved through the volume’s focus on actor beliefs and strategies. One such trade-off is less attention to evolving norms and cultural factors that may underpin actors’ expectations about what legitimacy requires. Third, it addresses the challenge of theory building that can link legitimacy sources, (de)legitimation practices, audiences, and consequences of legitimacy across different types of institutions.


2010 ◽  
Vol 41 (3) ◽  
pp. 325-344 ◽  
Author(s):  
Jacky Swan ◽  
Harry Scarbrough ◽  
Sue Newell

Many different types of organizations use projects to accomplish specific tasks, especially tasks that involve innovation and change. However, there are often problems associated with both learning within projects and learning transfer from projects to the wider organization. Previous research suggests that these problems vary according to the organizational context, in particular the extent to which the organization is centred on the delivery of projects. Also, the link between project-based learning and organizational learning may be far from seamless, and may require the deployment of a range of learning mechanisms to be effective. In this article we explore and explain these problems through an empirical study which examined project-based learning across different organizational contexts. This study highlights the limitations of learning mechanisms based on reflection and codification. It suggests that firms generally only learn from projects, if at all, via the accumulation of experience amongst groups and individuals. The study suggests, however, that the accumulation of experience is most pronounced in organizational contexts which are project centred and where project management capabilities are well developed. In contrast, in organizations where projects are more varied and occasional, the struggle to exploit the highly heterogeneous forms of learning created within projects is greater.


2011 ◽  
Vol 391-392 ◽  
pp. 60-64
Author(s):  
Fang Yi Long ◽  
Sheng Li Wu ◽  
Juan Zhu ◽  
Yuan Du ◽  
Guo Liang Zhang

The bonding intensity of four kinds of ores from Brazil, Australia and South Africa is researched in this study, and the influence factors are analyzed. The results show that, the ores of different types have apparently differences in bonding intensity, ores from Brazil and South Africa have high bonding intensity, while ores from Australia have low bonding intensity; The foundation of generation of effective liquid is adequate liquid phase fluidity and the lower porosity of core ore; The ratio of porosity of core ore and the index of liquid phase fluidity has negative correlation with the bonding intensity.


1981 ◽  
Vol 2 (3) ◽  
pp. 287-296 ◽  
Author(s):  
Peter H. Grinyer ◽  
Masoud Yasai-Ardekani

Problems associated with the use of Aston psychometrically based measures are evalu ated in the light of experience gained in and the findings of an empirical study of 45 electrical engineering companies in the UK in which the Aston methodology was used. It is shown that (a) the unidimensionality of multi-item measures must be clearly established if loss of information is to be avoided, (b) scales constructed by aggregation of a number of subscales suggested by factor analysis should not be given general labels beyond the description of subscales included in the final scale, and (c) abbreviated scales based on the original study may only reflect sample-specific relationships and may not be used as proxies of original scales in the study of other samples. The objectivity of factor analysis is also addressed.


Author(s):  
Алексей Григорьевич Шипулин

Статья посвящена исследованию влияния вторичных образов различного типа на перевод художественного текста. Результаты эксперимента подтверждают ведущую роль предметных образов для нахождения адекватных решений. Также показано наличие умеренной обратной корреляции между уровнем образного мышления в целом и количеством неадекватных трансформаций в переводе. Выявлено негативное влияние на результаты перевода низкого пространственного воображения. The article aims to investigate the influence of different types of secondary mental images on literary text translation. Our experimental data confirm a stone role of object imagery for finding adequate translation solutions, as well as suggest a moderate negative correlation between individual imagery scores and the number of inadequate translation solutions. A low level of spatial imagery may negatively affect the translator’s choices.


Sign in / Sign up

Export Citation Format

Share Document