scholarly journals Australian and Italian Psychologists’ View of Replication

2021 ◽  
Vol 4 (3) ◽  
pp. 251524592110392
Author(s):  
Franca Agnoli ◽  
Hannah Fraser ◽  
Felix Singleton Thorn ◽  
Fiona Fidler
Keyword(s):  
Experimental Method ◽  
Academic Research ◽  
Research Community ◽  
Replication Study ◽  
Actual Rate ◽  
Psychology Research ◽  
Psychological Literature ◽  
Replication Studies ◽  
Median Estimate

Solutions to the crisis in confidence in the psychological literature have been proposed in many recent articles, including increased publication of replication studies, a solution that requires engagement by the psychology research community. We surveyed Australian and Italian academic research psychologists about the meaning and role of replication in psychology. When asked what they consider to be a replication study, nearly all participants (98% of Australians and 96% of Italians) selected options that correspond to a direct replication. Only 14% of Australians and 8% of Italians selected any options that included changing the experimental method. Majorities of psychologists from both countries agreed that replications are very important, that more replications should be done, that more resources should be allocated to them, and that they should be published more often. Majorities of psychologists from both countries reported that they or their students sometimes or often replicate studies, yet they also reported having no replication studies published in the prior 5 years. When asked to estimate the percentage of published studies in psychology that are replications, both Australians (with a median estimate of 13%) and Italians (with a median estimate of 20%) substantially overestimated the actual rate. When asked what constitute the main obstacles to replications, difficulty publishing replications was the most frequently cited obstacle, coupled with the high value given to innovative or novel research and the low value given to replication studies.

scholarly journals Australian and Italian Psychologists’ View of Replication

2020 ◽  
Author(s):  
Fiona Fidler ◽  
Hannah Fraser ◽  
Felix Singleton Thorn ◽  
Franca Agnoli
Keyword(s):  
Experimental Method ◽  
Academic Research ◽  
Research Community ◽  
Actual Rate ◽  
Psychology Research ◽  
Replication Studies ◽  
The Past ◽  
Median Estimate ◽  
Psychology Literature

Many recent articles have proposed solutions to the crisis in confidence in the psychology literature, including increased publication of replication studies, a solution that requires engagement by the psychology research community. We surveyed Australian and Italian academic research psychologists about the meaning and role of replication in psychology. When asked what they consider to be a replication study, nearly all participants (98% of Australians and 96% of Italians) selected options that correspond to a direct replication. Only 14% of Australians and 8% of Italians selected any options that included changing the experimental method. Majorities of psychologists from both countries agreed that replications are very important, more replications should be done, more resources should be allocated to them, and they should be published more often. Majorities of psychologists from both countries reported that they or their students sometimes or often replicate studies, yet they also reported having no replication studies published the past 5 years. When asked to estimate the percentage of published studies in psychology that are replications, both Australians (with a median estimate of 13%) and Italians (with a median estimate of 20%) substantially overestimated the actual rate. When asked what constitute the main obstacles to replications, difficulty publishing replications was the most frequently cited obstacle, coupled with the high value given to innovative or novel research and the low value given to replication studies.

Vai Sambar! American Meaning Making in Afro-Brazilian Dance

2008 ◽  
Vol 40 (S1) ◽  
pp. 49-58
Author(s):  
Jessica Damon
Keyword(s):  
Personal Experience ◽  
Cultural Context ◽  
Meaning Making ◽  
Academic Research ◽  
Research Community ◽  
The Political ◽  
White Community ◽  
Afro Brazilian

This paper describes the interaction between an American community of dancers and the wave of Afro-Brazilian influence that entered that community. Through personal experience, academic research, community observation, and conversations, the author examines the role of samba and the religious dances of the orixds within a suburban white community, highlighting how meaning is changed and constructed based on cultural context. The author emphasizes how women in this community responded to the political, social, and sexual implications of a non-native dance form, and how their resulting self-identification as a community was transformed. The essay questions how Americans can locate themselves within the greater cultural context of samba and other Afro-Brazilian dance forms, not simply as cultural outsiders but as women deeply connected to the unique American reality of these practices.

scholarly journals Making our “meta-hypotheses” clear: heterogeneity and the role of direct replications in science

2021 ◽  
Vol 11 (2) ◽  
Author(s):  
Eirik Strømland
Keyword(s):  
Early Phase ◽  
Scientific Literature ◽  
Replication Study ◽  
Effect Sizes ◽  
Mature Stage ◽  
Initial Finding ◽  
Replication Studies ◽  
Homogeneity Assumption ◽  
Scientific Status

AbstractThis paper argues that some of the discussion around meta-scientific issues can be viewed as an argument over different “meta-hypotheses” – assumptions made about how different hypotheses in a scientific literature relate to each other. I argue that, currently, such meta-hypotheses are typically left unstated except in methodological papers and that the consequence of this practice is that it is hard to determine what can be learned from a direct replication study. I argue in favor of a procedure dubbed the “limited homogeneity assumption” – assuming very little heterogeneity of effect sizes when a literature is initiated but switching to an assumption of heterogeneity once an initial finding has been successfully replicated in a direct replication study. Until that has happened, we do not allow the literature to proceed to a mature stage. This procedure will elevate the scientific status of direct replication studies in science. Following this procedure, a well-designed direct replication study is a means of falsifying an overall claim in an early phase of a literature and thus sets up a hurdle against the canonization of false facts in the behavioral sciences.

On everyday academic research

2017 ◽  
pp. 98-134 ◽  
Author(s):  
J. Tirole
Keyword(s):  
Common Good ◽  
Academic Research ◽  
Research Quality ◽  
Economic Research ◽  
Relevant Research ◽  
The Common ◽  
Verification Of Models ◽  
Science And Research

In the fourth chapter of the book “The economy of the common good”, the nature of economics as a science and research practices in their theoretical and empirical aspects are discussed. The author considers the processes of modeling, empirical verification of models and evaluation of research quality. In addition, the features of economic cognition and the role of mathematics in economic research are analyzed, including the example of relevant research in game theory and information theory.

An Analysis of Professional Competence Indicator Possession among U.S. Accounting Faculty

2016 ◽  
Vol 32 (2) ◽  
pp. 17-38 ◽  
Author(s):  
Kenneth J. Smith ◽  
David J. Emerson
Keyword(s):  
Student Performance ◽  
Professional Competence ◽  
Academic Research ◽  
Practical Experience ◽  
Accounting Faculty ◽  
Accounting Practice ◽  
Cpa Exam ◽  
Primary Focus ◽  
New Generation

ABSTRACT Recently there has been much discourse regarding the existence, extent, causes, and consequences of a purported divide between accounting practice and academia. The crux of this issue relates to the charge that many new-generation faculty have a primary focus on academic research, but lack significant practical experience or certification, and the related claim that students may lack the requisite skills upon graduation. This study addresses these concerns by examining the incidence and trend in the possession of practice credentials, experience, and other activities among accounting faculty who graduated between 1994 and 2013. We evaluate how differences in institutional focus, possession of a practice credential, and proportion of credentialed faculty manifest in research propensities, current business experience, and student performance on the CPA exam. We identify a downward trend in practice credential possession that is more pronounced at research-oriented institutions. We further find significant differences in experience and publication activity across levels of both institutional focus and possession of a practice credential. We also find that students from research-oriented universities, schools with separate AACSB accounting accreditation, and those with a higher percentage credentialed faculty perform better on the CPA exam. Other results and the role of adjunct faculty in bridging this alleged divide are also examined.

Conceptual Analysis Rebooted

2017 ◽  
Author(s):  
Edouard Machery
Keyword(s):  
Experimental Method ◽  
Conceptual Analysis ◽  
Philosophical Tradition ◽  
Traditional Use ◽  
Philosophical Significance ◽  
Conceptual Engineering ◽  
Method Of Cases

Chapter 7 proposes a new, naturalistic characterization of conceptual analysis, defends its philosophical significance, and shows that usual concerns with conceptual analysis do not apply to this revamped version. So understood, conceptual analysis encompasses both a descriptive project and a normative project, similar to explication or to conceptual engineering. Chapter 7 also defends the philosophical significance of this novel form of conceptual analysis and its continuity with the role of conceptual analysis in the philosophical tradition. Furthermore, naturalized conceptual analysis often requires empirical tools to be pursued successfully, and an experimental method of cases 2.0 should often replace the traditional use of cases in philosophy.

Getting out of the Field

2017 ◽  
Author(s):  
Jeasik Cho
Keyword(s):  
Qualitative Research ◽  
Academic Research ◽  
Scientific Research ◽  
Research Community

This chapter provides a review of the book, which explores how to conceptually understand and practically evaluate the quality of qualitative research. Despite the fact that there are few scholarly pieces regarding qualitative research, the depth and creativity that the pioneering researchers have demonstrated are profound, and the extent to which they cover not only the broad quality of qualitative research but also most of the specific qualities expected by many different kinds of qualitative research is incredible. This chapter summarizes the major topics of this book. Final remarks on this exciting, creative, but difficult topic are preceded by the following summary: Fortunately, There are commonly agreed, bold standards for evaluating the goodness of qualitative research in the academic research community. These standards are a part of what is generally called “scientific research.”

Evaluating Qualitative Research

2017 ◽  
Author(s):  
Jeasik Cho
Keyword(s):  
Qualitative Research ◽  
Large Scale ◽  
Academic Research ◽  
Research Community ◽  
Assessment Tools ◽  
Journal Articles ◽  
Journal Editors ◽  
The Past ◽  
Grant Proposals

This book provides the qualitative research community with some insight on how to evaluate the quality of qualitative research. This topic has gained little attention during the past few decades. We, qualitative researchers, read journal articles, serve on masters’ and doctoral committees, and also make decisions on whether conference proposals, manuscripts, or large-scale grant proposals should be accepted or rejected. It is assumed that various perspectives or criteria, depending on various paradigms, theories, or fields of discipline, have been used in assessing the quality of qualitative research. Nonetheless, until now, no textbook has been specifically devoted to exploring theories, practices, and reflections associated with the evaluation of qualitative research. This book constructs a typology of evaluating qualitative research, examines actual information from websites and qualitative journal editors, and reflects on some challenges that are currently encountered by the qualitative research community. Many different kinds of journals’ review guidelines and available assessment tools are collected and analyzed. Consequently, core criteria that stand out among these evaluation tools are presented. Readers are invited to join the author to confidently proclaim: “Fortunately, there are commonly agreed, bold standards for evaluating the goodness of qualitative research in the academic research community. These standards are a part of what is generally called ‘scientific research.’ ”

A Brief Statement on the Future of Public Scholarship and the Research Methods Landscape

2019 ◽  
pp. 700-707
Author(s):  
Patricia Leavy
Keyword(s):  
Research Methods ◽  
Teaching Practices ◽  
Knowledge Building ◽  
Research Community ◽  
The State ◽  
Public Scholarship ◽  
Institutional Structures ◽  
The Future ◽  
Book Editor

The book editor offers some final comments about the state of the field and promise for the future. Leavy suggests researchers consider using the language of “shapes” to talk about the forms their research takes and to highlight the ongoing role of the research community in shaping knowledge-building practices. She reviews the challenges and rewards of taking your work public. Leavy concludes by noting that institutional structures need to evolve their rewards criteria in order to meet the demands of practicing contemporary research and suggests that professors update their teaching practices to bring the audiences of research into the forefront of discussions of methodology.

scholarly journals Accuracy of Households’ Dwelling Valuations, Housing Demand and Mortgage Decisions: Israeli Case

2021 ◽  
Author(s):  
Alla Koblyakova ◽  
Larisa Fleishman ◽  
Orly Furman
Keyword(s):  
Academic Research ◽  
House Price ◽  
Housing Demand ◽  
Empirical Estimation ◽  
Cross Sectional ◽  
Price Expectations ◽  
Housing Services ◽  
House Price Expectations ◽  
Supply Side Factors

AbstractHousing policy, as well as academic research, are increasingly concerned with the role of bias in subjective dwelling valuations as a proximate measure of households’ house price expectations and their relationship with housing demand. This paper contributes to this area of study by exploring the possibility of simultaneous relationships between households’ price expectations and incentive to maximise the size of housing services demanded also accounting for the supply side factors and regional perspective. The empirical estimation takes the form of a system of a two simultaneous equations model applying two stage least squares estimation technique. Cross sectional estimations utilise data extracted from the Israeli Longitudinal Panel Survey (LPS) data. Applying the best available proxy for households’ price expectations, calculated as the ratio between subjective dwelling valuations (LPS) and the estimated market value of the same properties, research has identified the interrelated factors that simultaneously influence householders’ price expectations and housing demand. Results offer conceptual and empirical advantages, highlighting the imperfect nature of the housing market, as reflected by the inseparability of bias in subjective valuations and housing decisions.

Sign in / Sign up

Export Citation Format

Share Document