scholarly journals Reexamining the Effect of Gustatory Disgust on Moral Judgment: A Multilab Direct Replication of Eskine, Kacinik, and Prinz (2011)

2020 ◽  
Vol 3 (1) ◽  
pp. 3-23
Author(s):  
Eric Ghelfi ◽  
Cody D. Christopherson ◽  
Heather L. Urry ◽  
Richie L. Lenne ◽  
Nicole Legate ◽  
...  
Keyword(s):  
Large Scale ◽  
Bayes Factor ◽  
Mixed Effects ◽  
Original Study ◽  
The Other ◽  
Taste Perception ◽  
Effect Sizes ◽  
Linear Mixed Effects ◽  
Meta Analyses ◽  
Moral Wrongness

Eskine, Kacinik, and Prinz’s (2011) influential experiment demonstrated that gustatory disgust triggers a heightened sense of moral wrongness. We report a large-scale multisite direct replication of this study conducted by labs in the Collaborative Replications and Education Project. Subjects in each sample were randomly assigned to one of three beverage conditions: bitter (disgusting), control (neutral), or sweet. Then, subjects made a series of judgments about the moral wrongness of the behavior depicted in six vignettes. In the original study ( N = 57), drinking the bitter beverage led to higher ratings of moral wrongness than did drinking the control or sweet beverage; a contrast between the bitter condition and the other two conditions was significant among conservative ( n = 19) but not liberal ( n = 25) subjects. In the current project, random-effects meta-analyses across all subjects ( N = 1,137, k = 11 studies), conservative subjects ( n = 142, k = 5), and liberal subjects ( n = 635, k = 9) revealed standardized overall effect sizes across replications that were smaller than reported in the original study. Some were in the opposite of the predicted direction; all had 95% confidence intervals containing zero, and all were smaller than the effect size the original authors could have meaningfully detected. Results of linear mixed-effects regressions revealed that drinking the bitter beverage led to higher ratings of moral wrongness than did drinking the control beverage but not the sweet beverage. Bayes factor tests revealed greater relative support for the null than for the replication hypothesis. The overall pattern provides little to no support for the theory that physical disgust via taste perception harshens judgments of moral wrongness.

scholarly journals Reexamining the effect of gustatory disgust on moral judgment: A multi-lab direct replication of Eskine, Kacinik, and Prinz (2011)

2018 ◽  
Author(s):  
Eric Ghelfi ◽  
Cody D Christopherson ◽  
Heather L. Urry ◽  
Richie L Lenne ◽  
Nicole Legate ◽  
...  
Keyword(s):  
Large Scale ◽  
Bayes Factor ◽  
Mixed Effects ◽  
Original Study ◽  
Taste Perception ◽  
Effect Sizes ◽  
Linear Mixed Effects ◽  
Standardized Effect Sizes ◽  
Meta Analyses ◽  
Moral Wrongness

Eskine, Kacinik, and Prinz’s (2011) influential experiment demonstrated that gustatory disgust triggers a heightened sense of moral wrongness. We report a large-scale multi-site direct replication of this study conducted by participants in the Collaborative Replications and Education Project. Participants in each sample were randomly assigned to one of three beverage conditions: bitter/disgusting, control, or sweet. Then, participants made a series of judgments indicating the moral wrongness of the behavior depicted in each of six vignettes. In the original study (N = 57), drinking the bitter beverage led to higher ratings of moral wrongness than drinking the control and sweet beverages; a beverage contrast was significant among conservative (N = 19) but not liberal (N = 25) participants. In this report, random effects meta-analyses across all participants (N = 1,137 in k = 11 studies), conservative participants (N = 142, k = 5), and liberal participants (N = 635, k = 9) revealed standardized effect sizes that were smaller than reported in the original study. Some were in the opposite of the predicted direction, all had 95% confidence intervals containing zero, and most were smaller than the effect size the original authors could meaningfully detect. In linear mixed-effects regressions, drinking the bitter beverage led to higher ratings of moral wrongness than drinking the control beverage but not the sweet beverage. Bayes Factor tests reveal greater relative support for the null hypothesis. The overall pattern provides little to no support for the theory that physical disgust via taste perception harshens judgments of moral wrongness.

scholarly journals Dissertation R.C.M. van Aert

2018 ◽  
Author(s):  
Robbie Cornelis Maria van Aert
Keyword(s):  
Publication Bias ◽  
Effect Size ◽  
Meta Analysis ◽  
Original Study ◽  
The Other ◽  
Effect Sizes ◽  
True Effect Size ◽  
True Effect ◽  
Meta Analyses ◽  
Q Statistic

More and more scientific research gets published nowadays, asking for statistical methods that enable researchers to get an overview of the literature in a particular research field. For that purpose, meta-analysis methods were developed that can be used for statistically combining the effect sizes from independent primary studies on the same topic. My dissertation focuses on two issues that are crucial when conducting a meta-analysis: publication bias and heterogeneity in primary studies’ true effect sizes. Accurate estimation of both the meta-analytic effect size as well as the between-study variance in true effect size is crucial since the results of meta-analyses are often used for policy making. Publication bias distorts the results of a meta-analysis since it refers to situations where publication of a primary study depends on its results. We developed new meta-analysis methods, p-uniform and p-uniform*, which estimate effect sizes corrected for publication bias and also test for publication bias. Although the methods perform well in many conditions, these and the other existing methods are shown not to perform well when researchers use questionable research practices. Additionally, when publication bias is absent or limited, traditional methods that do not correct for publication bias outperform p¬-uniform and p-uniform*. Surprisingly, we found no strong evidence for the presence of publication bias in our pre-registered study on the presence of publication bias in a large-scale data set consisting of 83 meta-analyses and 499 systematic reviews published in the fields of psychology and medicine. We also developed two methods for meta-analyzing a statistically significant published original study and a replication of that study, which reflects a situation often encountered by researchers. One method is a frequentist whereas the other method is a Bayesian statistical method. Both methods are shown to perform better than traditional meta-analytic methods that do not take the statistical significance of the original study into account. Analytical studies of both methods also show that sometimes the original study is better discarded for optimal estimation of the true effect size. Finally, we developed a program for determining the required sample size in a replication analogous to power analysis in null hypothesis testing. Computing the required sample size with the method revealed that large sample sizes (approximately 650 participants) are required to be able to distinguish a zero from a small true effect.Finally, in the last two chapters we derived a new multi-step estimator for the between-study variance in primary studies’ true effect sizes, and examined the statistical properties of two methods (Q-profile and generalized Q-statistic method) to compute the confidence interval of the between-study variance in true effect size. We proved that the multi-step estimator converges to the Paule-Mandel estimator which is nowadays one of the recommended methods to estimate the between-study variance in true effect sizes. Two Monte-Carlo simulation studies showed that the coverage probabilities of Q-profile and generalized Q-statistic method can be substantially below the nominal coverage rate if the assumptions underlying the random-effects meta-analysis model were violated.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

scholarly journals Publication Bias in Meta-Analyses from Psychology and Medicine: A Meta-Meta-Analysis

2017 ◽  
Author(s):  
Robbie Cornelis Maria van Aert ◽  
Jelte M. Wicherts ◽  
Marcel A. L. M. van Assen
Keyword(s):  
Publication Bias ◽  
Systematic Reviews ◽  
Large Scale ◽  
Effect Sizes ◽  
Psychological Bulletin ◽  
Data Set ◽  
Monte Carlo Simulation Study ◽  
True Effect Size ◽  
Meta Analyses ◽  
Psychology And Medicine

Publication bias is a substantial problem for the credibility of research in general and of meta-analyses in particular, as it yields overestimated effects and may suggest the existence of non-existing effects. Although there is consensus that publication bias exists, how strongly it affects different scientific literatures is currently less well-known. We examined evidence of publication bias in a large-scale data set of primary studies that were included in 83 meta-analyses published in Psychological Bulletin (representing meta-analyses from psychology) and 499 systematic reviews from the Cochrane Database of Systematic Reviews (CDSR; representing meta-analyses from medicine). Publication bias was assessed on all homogeneous subsets (3.8% of all subsets of meta-analyses published in Psychological Bulletin) of primary studies included in meta-analyses, because publication bias methods do not have good statistical properties if the true effect size is heterogeneous. The Monte-Carlo simulation study revealed that the creation of homogeneous subsets resulted in challenging conditions for publication bias methods since the number of effect sizes in a subset was rather small (median number of effect sizes equaled 6). No evidence of bias was obtained using the publication bias tests. Overestimation was minimal but statistically significant, providing evidence of publication bias that appeared to be similar in both fields. These and other findings, in combination with the small percentages of statistically significant primary effect sizes (28.9% and 18.9% for subsets published in Psychological Bulletin and CDSR), led to the conclusion that evidence for publication bias in the studied homogeneous subsets is weak, but suggestive of mild publication bias in both psychology and medicine.

scholarly journals Morphometricity as a measure of the neuroanatomical signature of a trait

2016 ◽  
Vol 113 (39) ◽  
pp. E5749-E5756 ◽  
Author(s):  
Mert R. Sabuncu ◽  
Tian Ge ◽  
Avram J. Holmes ◽  
Jordan W. Smoller ◽  
Randy L. Buckner ◽  
...  
Keyword(s):  
Large Scale ◽  
Anatomical Variation ◽  
Brain Mri ◽  
Mixed Effects ◽  
Brain Morphology ◽  
Linear Mixed Effects Model ◽  
Linear Mixed Effects ◽  
Behavioral Traits ◽  
Clinical Diagnoses ◽  
Mri Scans

Complex physiological and behavioral traits, including neurological and psychiatric disorders, often associate with distributed anatomical variation. This paper introduces a global metric, called morphometricity, as a measure of the anatomical signature of different traits. Morphometricity is defined as the proportion of phenotypic variation that can be explained by macroscopic brain morphology. We estimate morphometricity via a linear mixed-effects model that uses an anatomical similarity matrix computed based on measurements derived from structural brain MRI scans. We examined over 3,800 unique MRI scans from nine large-scale studies to estimate the morphometricity of a range of phenotypes, including clinical diagnoses such as Alzheimer’s disease, and nonclinical traits such as measures of cognition. Our results demonstrate that morphometricity can provide novel insights about the neuroanatomical correlates of a diverse set of traits, revealing associations that might not be detectable through traditional statistical techniques.

scholarly journals Effects of Spacing on Sentence Reading in Chinese

2021 ◽  
Vol 12 ◽  
Author(s):  
Gaisha Oralova ◽  
Victor Kuperman
Keyword(s):  
Regression Models ◽  
Native Speaker ◽  
Mixed Effects ◽  
The Other ◽  
Word Boundary ◽  
Linear Mixed Effects ◽  
Sentence Reading ◽  
Word Boundaries ◽  
Theories Of Reading ◽  
Chinese Writing

Given that Chinese writing conventions lack inter-word spacing, understanding whether and how readers of Chinese segment regular unspaced Chinese writing into words is an important question for theories of reading. This study examined the processing outcomes of introducing spaces to written Chinese sentences in varying positions based on native speaker consensus. The measure of consensus for every character transition in our stimuli sentences was the percent of raters who placed a word boundary in that position. The eye movements of native readers of Chinese were recorded while they silently read original unspaced sentences and their experimentally manipulated counterparts for comprehension. We introduced two types of spaced sentences: one with spaces inserted at every probable word boundary (heavily spaced), and another with spaces placed only at highly probable word boundaries (lightly spaced). Linear mixed-effects regression models showed that heavily spaced sentences took identical time to read as unspaced ones despite the shortened fixation times on individual words (Experiment 1). On the other hand, reading times for lightly spaced sentences and words were shorter than those for unspaced ones (Experiment 2). Thus, spaces proved to be advantageous but only when introduced at highly probable word boundaries. We discuss methodological and theoretical implications of these findings.

scholarly journals Comparing Meta-Analyses and Pre-Registered Multiple Labs Replication Projects

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
Large Scale ◽  
Research Evidence ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Selective Reporting ◽  
Behavioral Sciences ◽  
Scientific Results ◽  
Meta Analyses

Many researchers rely on meta-analysis to summarize research evidence. However, recent replication projects in the behavioral sciences suggest that effect sizes of original studies are overestimated, and this overestimation is typically attributed to publication bias and selective reporting of scientific results. As the validity of meta-analyses depends on the primary studies, there is a concern that systematic overestimation of effect sizes may translate into biased meta-analytic effect sizes. We compare the results of meta-analyses to large-scale pre-registered replications in psychology carried out at multiple labs. The multiple labs replications provide relatively precisely estimated effect sizes, which do not suffer from publication bias or selective reporting. Searching the literature, 17 meta-analyses – spanning more than 1,200 effect sizes and more than 370,000 participants - on the same topics as multiple labs replications are identified. We find that the meta-analytic effect sizes are significantly different from the replication effect sizes for 12 out of the 17 meta-replication pairs. These differences are systematic and on average meta-analytic effect sizes are about three times as large as the replication effect sizes.

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Birlikte Yaşama Kültürü Çerçevesinde Avrupa Birliği ve Türkiye Politikaları: Suriyelilere Yönelik Tutumun Sultanbeyli Örneği Üzerinden Değerlendirilmesi

2017 ◽  
Vol 4 (1) ◽  
pp. 41-61
Author(s):  
Pelin Sönmez ◽  
Abulfaz Süleymanov
Keyword(s):  
Civil Wars ◽  
Large Scale ◽  
Social Acceptance ◽  
Point Of View ◽  
The Other ◽  
Syrian Refugees ◽  
The European Union ◽  
International Protection ◽  
Legal Structure ◽  
Turkish People

Türkiye, Cumhuriyet tarihinin en yoğun zorunlu göç dalgasını 2011 yılından bu yana süren Suriye Savaşı ile yaşamaktadır. Suriye vatandaşlarının geçici koruma statüsü altında Türkiye toplumuna her açıdan entegrasyonları günümüzün ve geleceğin politika öncelikleri arasında düşünülmelidir. Öte yandan ülkeye kabul edilen sığınmacıların kendi kültürel kimliğini kaybetmeden içinde yaşadığı ev sahibi topluma uyumu, ortak yaşam kültürünün gelişmesi açısından önem arz etmektedir. Bu makalede, "misafir" olarak kabul edilen Suriyeli vatandaşların Türk toplumunca kabul edilmeleri ve dışlanma risklerinin azaltılmasına yönelik devlet politikaları ortaya konularak, üye ve aday ülkelere göçmenlerin dışlanmasını önlemek için Avrupa Birliği (AB) tarafından sunulan hukuki yapı ve kamu hizmeti inisiyatifleri incelenmekte, birlikte yaşam kültürü çerçevesinde Suriyeli vatandaşlara yönelik  toplumsal kabul düzeyleri ele alınmaktadır. Çalışma iki ana bölümden oluşmaktadır: göçmen ve sığınmacılara karşı toplumsal dışlanmayı engellemek için benimsenen yasa ve uygulamaların etkisi ve İstanbul-Sultanbeyli bölgesinde Suriyeli sığınmacılarla ilgili toplumsal algı çalışmasının sonuçları. Bölgede ikamet eden Suriyelilere yönelik toplumsal kabul düzeyinin yüksek olduğu görülürken, halkın Suriyelileri kendilerine  kültürel ve dini olarak yakın hissetmesi toplumsal kabul düzeyini olumlu etkilemektedir. ABSTRACT IN ENGLISHAn evaluation of the European Union and Turkish policies regarding the culture of living togetherThis article aims to determine the level of social acceptance towards Syrians within the context of cohabitation culture by evaluating EU’s legal structure and public service initiatives in order to prevent Syrian refugees from being excluded in member and candidate countries and by revealing government policies on acceptance of Syrians as “guest” by Turkish society and minimizing the exclusion risks of them. This article consists of two main parts, one of which is based on the effects of law and practices preventing refugees and asylum seekers from social exclusion, and the other is on the results of social perception on Syrians in Sultanbeyli district of Istanbul. At the end of 5-years taking in Syrian War, it is obvious that most of more than 3 million Syrian with unregistered ones in Turkey are “here to stay”. From this point of view, the primary scope of policies should be specified in order to remove side effects of refugee phenomenon seen as weighty matter by bottoming out the exclusion towards those people. To avoid possible large-scale conflicts or civil wars in the future, the struggle with exclusion phenomenon plays a crucial role regarding Turkey’s sociological situation and developing policies. In the meaning of forming a model for Turkey, a subtitle in this article is about public services for European-wide legal acquis and practices carried out since 1970s in order to prevent any exclusion from the society. On the other hand, other subtitles are about legal infrastructure and practices like Common European Asylum and Immigration Policies presented in 2005, and Law on Foreigners and International Protection introduced in 2013. In the last part of the article, the results of a field survey carried out in a district of Istanbul were used to analyze the exclusion towards refugees in Turkey. A face-to-face survey was randomly conducted with 200 settled refugees in Sultanbeyli district of Istanbul, and their perceptions towards Syrian people under temporary protection were evaluated. According to the results, the level of acceptance for Syrians living in this district seems relatively high. The fact that Turkish people living in the same district feel close to Syrian refugees culturally and religiously affect their perception in a positive way: however, it is strikingly seen and understood that local residents cop an attitude on the refugees’ becoming Turkish citizens.

Sign in / Sign up

Export Citation Format

Share Document