scholarly journals When high reliability does not signal reliable detection of experimental effects

2020 ◽  
Author(s):  
Selena Wang ◽  
Paul De Boeck
Keyword(s):  
Measurement Error ◽  
Latent Variable ◽  
Large Scale ◽  
High Reliability ◽  
Negative Relationship ◽  
Ego Depletion ◽  
Measurement Quality ◽  
Depletion Effect ◽  
Replication Research ◽  
The Impact

The replication crisis has led to a renewed discussion about the impacts of measurement quality on the precision of psychology research. High measurement quality is associated with low measurement error, yet the relationship between reliability and measurement error is not yet well understood. In this study, we attempt to understand the role of reliability in the replication research through its relationship with power. We outline a latent variable framework to understand this nuanced relationship through their equations. We find that, under the influence of the latent variable variance, reliability and power can be negatively associated. We proceed to demonstrate the impact of this relationship between reliability and power in replication research by imitating different scenarios of large-scale replications. We find negative correlations between reliability and power when there are sizable differences in the latent variable variance and negligible differences in the other parameters across studies. Finally, we apply our conclusions to the data from replications of the ego depletion effect (Hagger et al., 2016) and the replications of the grammatical aspect effect (Eerland et al., 2016). The applications show that a negative relationship between reliability and power is a realistic possibility, which eliminates doubts one might have about the applicability of our results to the applied work.

scholarly journals Do exhausted primary school students cheat more? A randomized field experiment

PLoS ONE ◽  
2021 ◽  
Vol 16 (12) ◽  
pp. e0260141
Author(s):  
Tamás Keller ◽  
Hubert János Kiss
Keyword(s):  
Field Experiment ◽  
Large Scale ◽  
Real Life ◽  
Ego Depletion ◽  
Self Control ◽  
Future Research ◽  
School Students ◽  
Scientific Debate ◽  
Cheating Behavior ◽  
Depletion Effect

Motivated by the two-decade-long scientific debate over the existence of the ego-depletion effect, our paper contributes to exploring the scope conditions of ego-depletion theory. Specifically, in a randomized experiment, we depleted students’ self-control with a cognitively demanding task that required students’ effort. We measured the effect of depleted self-control on a subsequent task that required self-control to not engage in fraudulent cheating behavior—measured with an incentivized dice-roll task—and tested ego-depletion in a large-scale preregistered field experiment that was similar to real-life situations. We hypothesized that treated students would cheat more. The data confirms the hypothesis and provides causal evidence of the ego-depletion effect. Our results provide new insights into the scope conditions of ego-depletion theory, contribute methodological information for future research, and offer practical guidance for educational policy.

scholarly journals Systemic failures and organizational risk management in algorithmic trading: Normal accidents and high reliability in financial markets

2021 ◽  
pp. 030631272110485
Author(s):  
Bo Hee Min ◽  
Christian Borch
Keyword(s):  
Large Scale ◽  
High Reliability ◽  
Algorithmic Trading ◽  
Tight Coupling ◽  
Market Participants ◽  
Documentary Sources ◽  
Complex Interactions ◽  
Systemic Risks ◽  
Market Instability ◽  
The Impact

This article examines algorithmic trading and some key failures and risks associated with it, including so-called algorithmic ‘flash crashes’. Drawing on documentary sources, 189 interviews with market participants, and fieldwork conducted at an algorithmic trading firm, we argue that automated markets are characterized by tight coupling and complex interactions, which render them prone to large-scale technological accidents, according to Perrow’s normal accident theory. We suggest that the implementation of ideas from research into high-reliability organizations offers a way for trading firms to curb some of the technological risk associated with algorithmic trading. Paradoxically, however, certain systemic conditions in markets can allow individual firms’ high-reliability practices to exacerbate market instability, rather than reduce it. We therefore conclude that in order to make automated markets more stable (and curb the impact of failures), it is important to both widely implement reliability-enhancing practices in trading firms and address the systemic risks that follow from the tight coupling and complex interactions of markets.

scholarly journals Baseline and stress-induced corticosterone levels across birds and reptiles do not reflect urbanization levels

2020 ◽  
Vol 8 (1) ◽  
Author(s):  
Allison S Injaian ◽  
Clinton D Francis ◽  
Jenny Q Ouyang ◽  
Davide M Dominoni ◽  
Jeremy W Donald ◽  
...  
Keyword(s):  
Environmental Change ◽  
Human Population ◽  
Large Scale ◽  
Human Impacts ◽  
Negative Relationship ◽  
Anthropogenic Noise ◽  
Anthropogenic Factors ◽  
Life History Stage ◽  
Baseline Corticosterone ◽  
The Impact

Abstract Rates of human-induced environmental change continue increasing with human population size, potentially altering animal physiology and negatively affecting wildlife. Researchers often use glucocorticoid concentrations (hormones that can be associated with stressors) to gauge the impact of anthropogenic factors (e.g. urbanization, noise and light pollution). Yet, no general relationships between human-induced environmental change and glucocorticoids have emerged. Given the number of recent studies reporting baseline and stress-induced corticosterone (the primary glucocorticoid in birds and reptiles) concentrations worldwide, it is now possible to conduct large-scale comparative analyses to test for general associations between disturbance and baseline and stress-induced corticosterone across species. Additionally, we can control for factors that may influence context, such as life history stage, environmental conditions and urban adaptability of a species. Here, we take a phylogenetically informed approach and use data from HormoneBase to test if baseline and stress-induced corticosterone are valid indicators of exposure to human footprint index, human population density, anthropogenic noise and artificial light at night in birds and reptiles. Our results show a negative relationship between anthropogenic noise and baseline corticosterone for birds characterized as urban avoiders. While our results potentially indicate that urban avoiders are more sensitive to noise than other species, overall our study suggests that the relationship between human-induced environmental change and corticosterone varies across species and contexts; we found no general relationship between human impacts and baseline and stress-induced corticosterone in birds, nor baseline corticosterone in reptiles. Therefore, it should not be assumed that high or low levels of exposure to human-induced environmental change are associated with high or low corticosterone levels, respectively, or that closely related species, or even individuals, will respond similarly. Moving forward, measuring alternative physiological traits alongside reproductive success, health and survival may provide context to better understand the potential negative effects of human-induced environmental change.

scholarly journals Approximate Measurement Invariance of Willingness to Sacrifice for the Environment Across 30 Countries: The Importance of Prior Distributions and Their Visualization

2021 ◽  
Vol 12 ◽  
Author(s):  
Ingrid Arts ◽  
Qixiang Fang ◽  
Rens van de Schoot ◽  
Katharina Meitinger
Keyword(s):  
Measurement Invariance ◽  
Latent Variable ◽  
Large Scale ◽  
Rank Order ◽  
Assessment Procedure ◽  
Climate And Environmental Change ◽  
Willingness To Sacrifice ◽  
Political Communities ◽  
The Impact ◽  
Approximate Measurement

Nationwide opinions and international attitudes toward climate and environmental change are receiving increasing attention in both scientific and political communities. An often used way to measure these attitudes is by large-scale social surveys. However, the assumption for a valid country comparison, measurement invariance, is often not met, especially when a large number of countries are being compared. This makes a ranking of countries by the mean of a latent variable potentially unstable, and may lead to untrustworthy conclusions. Recently, more liberal approaches to assessing measurement invariance have been proposed, such as the alignment method in combination with Bayesian approximate measurement invariance. However, the effect of prior variances on the assessment procedure and substantive conclusions is often not well understood. In this article, we tested for measurement invariance of the latent variable “willingness to sacrifice for the environment” using Maximum Likelihood Multigroup Confirmatory Factor Analysis and Bayesian approximate measurement invariance, both with and without alignment optimization. For the Bayesian models, we used multiple priors to assess the impact on the rank order stability of countries. The results are visualized in such a way that the effect of different prior variances and models on group means and rankings becomes clear. We show that even when models appear to be a good fit to the data, there might still be an unwanted impact on the rank ordering of countries. From the results, we can conclude that people in Switzerland and South Korea are most motivated to sacrifice for the environment, while people in Latvia are less motivated to sacrifice for the environment.

The Ego Could Be Depleted, Providing Initial Exertion Is Depleting

2017 ◽  
Vol 48 (4) ◽  
pp. 242-245 ◽  
Author(s):  
Junhua Dang ◽  
Ying Liu ◽  
Xiaoping Liu ◽  
Lihua Mao
Keyword(s):  
Stroop Task ◽  
Meta Analysis ◽  
Ego Depletion ◽  
Current Experiment ◽  
The Past ◽  
Depletion Effect

Abstract. The ego depletion effect has been examined by over 300 independent studies during the past two decades. Despite its pervasive influence, recently this effect has been severely challenged and asserted to be a fake. Based on an up-to-date meta-analysis that examined the effectiveness of each frequently used depleting task, we preregistered the current experiment with the aim to examine whether there would be an ego depletion effect when the Stroop task is used as the depleting task. The results demonstrated a significant ego depletion effect. The current research highlights the importance of the depleting task’s effectiveness. That is to say, the “ego” could be “depleted,” but only when initial exertion is “depleting.”

The Limits of Ego Depletion

2019 ◽  
Vol 50 (5-6) ◽  
pp. 292-304 ◽  
Author(s):  
Mario Wenzel ◽  
Marina Lind ◽  
Zarah Rowland ◽  
Daniela Zahn ◽  
Thomas Kubiak
Keyword(s):  
Research Agenda ◽  
Statistical Power ◽  
Interindividual Variability ◽  
Ego Depletion ◽  
Crossover Design ◽  
Effect Sizes ◽  
Future Research ◽  
Future Research Agenda ◽  
Depletion Effect ◽  
Within Subjects

Abstract. Evidence on the existence of the ego depletion phenomena as well as the size of the effects and potential moderators and mediators are ambiguous. Building on a crossover design that enables superior statistical power within a single study, we investigated the robustness of the ego depletion effect between and within subjects and moderating and mediating influences of the ego depletion manipulation checks. Our results, based on a sample of 187 participants, demonstrated that (a) the between- and within-subject ego depletion effects only had negligible effect sizes and that there was (b) large interindividual variability that (c) could not be explained by differences in ego depletion manipulation checks. We discuss the implications of these results and outline a future research agenda.

Impact of COVID-19 on Nuclear Medicine in Germany, Austria and Switzerland: An International Survey in April 2020

2020 ◽  
Vol 59 (04) ◽  
pp. 294-299 ◽  
Author(s):  
Lutz S. Freudenberg ◽  
Ulf Dittmer ◽  
Ken Herrmann
Keyword(s):  
Nuclear Medicine ◽  
Health Systems ◽  
Personal Protective Equipment ◽  
Large Scale ◽  
Diagnostic Procedures ◽  
Protective Equipment ◽  
Current Crisis ◽  
Web Based ◽  
Public Versus Private ◽  
The Impact

Abstract Introduction Preparations of health systems to accommodate large number of severely ill COVID-19 patients in March/April 2020 has a significant impact on nuclear medicine departments. Materials and Methods A web-based questionnaire was designed to differentiate the impact of the pandemic on inpatient and outpatient nuclear medicine operations and on public versus private health systems, respectively. Questions were addressing the following issues: impact on nuclear medicine diagnostics and therapy, use of recommendations, personal protective equipment, and organizational adaptations. The survey was available for 6 days and closed on April 20, 2020. Results 113 complete responses were recorded. Nearly all participants (97 %) report a decline of nuclear medicine diagnostic procedures. The mean reduction in the last three weeks for PET/CT, scintigraphies of bone, myocardium, lung thyroid, sentinel lymph-node are –14.4 %, –47.2 %, –47.5 %, –40.7 %, –58.4 %, and –25.2 % respectively. Furthermore, 76 % of the participants report a reduction in therapies especially for benign thyroid disease (-41.8 %) and radiosynoviorthesis (–53.8 %) while tumor therapies remained mainly stable. 48 % of the participants report a shortage of personal protective equipment. Conclusions Nuclear medicine services are notably reduced 3 weeks after the SARS-CoV-2 pandemic reached Germany, Austria and Switzerland on a large scale. We must be aware that the current crisis will also have a significant economic impact on the healthcare system. As the survey cannot adapt to daily dynamic changes in priorities, it serves as a first snapshot requiring follow-up studies and comparisons with other countries and regions.

Dampak Kebijakan Moneter Pada Output Di Negara-Negara ASEAN Tahun 1980-2014

2017 ◽  
Vol 4 (1) ◽  
pp. 58-70
Author(s):  
Nur Widiastuti
Keyword(s):  
Monetary Policy ◽  
Interest Rate ◽  
Fixed Effects ◽  
Empirical Studies ◽  
Negative Relationship ◽  
Least Square ◽  
Fixed Effects Model ◽  
State Data ◽  
Ordinary Least Square ◽  
The Impact

The Impact of monetary Policy on Ouput is an ambiguous. The results of previous empirical studies indicate that the impact can be a positive or negative relationship. The purpose of this study is to investigate the impact of monetary policy on Output more detail. The variables to estimatate monetery poicy are used state and board interest rate andrate. This research is conducted by Ordinary Least Square or Instrumental Variabel, method for 5 countries ASEAN. The state data are estimated for the period of 1980 – 2014. Based on the results, it can be concluded that the impact of monetary policy on Output shown are varied.Keyword: Monetary Policy, Output, Panel Data, Fixed Effects Model

Risk Attitude and Corporate Investment under Output Market Uncertainty: Evidence from The Mekong River Delta, Vietnam

2016 ◽  
pp. 59-70
Author(s):  
Ninh Le Khuong ◽  
Nghiem Le Tan ◽  
Tho Huynh Huu
Keyword(s):  
Negative Relationship ◽  
Risk Attitude ◽  
Business Strategies ◽  
Risk Averse ◽  
Market Uncertainty ◽  
Firm Investment ◽  
Output Market ◽  
The Impact ◽  
The Relationship

This paper aims to detect the impact of firm managers’ risk attitude on the relationship between the degree of output market uncertainty and firm investment. The findings show that there is a negative relationship between these two aspects for risk-averse managers while there is a positive relationship for risk-loving ones, since they have different utility functions. Based on the findings, this paper proposes recommendations for firm managers to take into account when making investment decisions and long-term business strategies as well.

Sign in / Sign up

Export Citation Format

Share Document