Alternative Research Designs

ABSTRACTDespite a plethora of theoretical frameworks, IR scholars have struggled with the question of how observers assess resolve. We make two important contributions in this direction. Conceptually, we develop an integrative framework that unites otherwise disconnected theories, viewing them as a set of heuristics actors use to simplify information-rich environments. Methodologically, we employ a conjoint experiment that provides empirical traction impossible to obtain using alternative research designs. We find that ordinary citizens are ‘intuitive deterrence theorists’ who focus to a great extent on capabilities, stakes, signals and past actions in judging resolve. We also find that observers see democracies as less resolved than autocracies (not more), casting doubt on key propositions of democratic credibility theory. Finally, a conceptual replication shows that a group of elite decision makers converge with the US public in how they interpret costly signals, and in viewing democracies as less resolved than autocracies.

Download Full-text

Traditional and Alternative Research Designs and Methods in Clinical Pediatric Psychopharmacology

Journal of the American Academy of Child & Adolescent Psychiatry ◽

10.1097/00004583-199610000-00016 ◽

1996 ◽

Vol 35 (10) ◽

pp. 1292-1303 ◽

Cited By ~ 23

Author(s):

MAURIZIO FAVA

Keyword(s):

Clinical Pediatric ◽

Research Designs ◽

Alternative Research

Download Full-text

When Natural Experiments Are Neither Natural nor Experiments

American Political Science Review ◽

10.1017/s0003055411000542 ◽

2012 ◽

Vol 106 (1) ◽

pp. 35-57 ◽

Cited By ~ 88

Author(s):

JASJEET S. SEKHON ◽

ROCÍO TITIUNIK

Keyword(s):

Social Sciences ◽

Unbiased Estimate ◽

Causal Effect ◽

Natural Experiments ◽

Treatment Control ◽

Causal Inferences ◽

The Social ◽

Research Designs ◽

Alternative Research ◽

Conceptual Difficulties

Natural experiments help to overcome some of the obstacles researchers face when making causal inferences in the social sciences. However, even when natural interventions are randomly assigned, some of the treatment–control comparisons made available by natural experiments may not be valid. We offer a framework for clarifying the issues involved, which are subtle and often overlooked. We illustrate our framework by examining four different natural experiments used in the literature. In each case, random assignment of the intervention is not sufficient to provide an unbiased estimate of the causal effect. Additional assumptions are required that are problematic. For some examples, we propose alternative research designs that avoid these conceptual difficulties.

Download Full-text

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

American Political Science Review ◽

10.1017/s0003055411000414 ◽

2011 ◽

Vol 105 (4) ◽

pp. 765-789 ◽

Cited By ~ 579

Author(s):

KOSUKE IMAI ◽

LUKE KEELE ◽

DUSTIN TINGLEY ◽

TEPPEI YAMAMOTO

Keyword(s):

Observational Studies ◽

Media Framing ◽

Incumbency Advantage ◽

Mediation Effects ◽

Causal Mechanisms ◽

Fundamental Goal ◽

Research Designs ◽

Alternative Research ◽

Standard Designs ◽

Intermediate Variables

Identifying causal mechanisms is a fundamental goal of social science. Researchers seek to study not only whether one variable affects another but also how such a causal relationship arises. Yet commonly used statistical methods for identifying causal mechanisms rely upon untestable assumptions and are often inappropriate even under those assumptions. Randomizing treatment and intermediate variables is also insufficient. Despite these difficulties, the study of causal mechanisms is too important to abandon. We make three contributions to improve research on causal mechanisms. First, we present a minimum set of assumptions required under standard designs of experimental and observational studies and develop a general algorithm for estimating causal mediation effects. Second, we provide a method for assessing the sensitivity of conclusions to potential violations of a key assumption. Third, we offer alternative research designs for identifying causal mechanisms under weaker assumptions. The proposed approach is illustrated using media framing experiments and incumbency advantage studies.

Download Full-text

A Future for Observational Epidemiology: Clarity, Credibility, Transparency

10.31219/osf.io/sqpxw ◽

2019 ◽

Author(s):

Sam Harper

Keyword(s):

Observational Studies ◽

Health Interventions ◽

Causal Effects ◽

Reproducible Research ◽

Bias Analysis ◽

Replication Studies ◽

Research Designs ◽

Alternative Research ◽

Quantitative Bias Analysis ◽

Research Standards

Observational studies are ambiguous, difficult, and necessary for epidemiology. Presently there are concerns that the evidence produced by most observational studies in epidemiology is not credible and contributes to research waste. I argue that observational epidemiology could be improved by focusing greater attention on: 1) defining questions that make clear whether the inferential goal is descriptive or causal; 2) greater utilization of quantitative bias analysis and alternative research designs that aim to decrease the strength of assumptions needed to estimate causal effects; and 3) promoting, experimenting, and perhaps institutionalizing reproducible research standards as well as replication studies to evaluate the fragility of study findings in epidemiology. Greater clarity, credibility, and transparency in observational epidemiology will help to provide reliable evidence that can serve as a basis for making decisions about clinical or population health interventions.

Download Full-text

UK Research Ethics Committee’s review of the global first SARS-CoV-2 human infection challenge studies

Journal of Medical Ethics ◽

10.1136/medethics-2021-107709 ◽

2021 ◽

pp. medethics-2021-107709

Author(s):

Hugh Davies

Keyword(s):

Research Ethics ◽

Human Infection ◽

Good Faith ◽

Ethical Review ◽

Wrong Decision ◽

Who Criteria ◽

Research Designs ◽

Alternative Research ◽

Research Questions ◽

The Uk

This paper describes the UK Research Ethics Committee’s (REC) preparations and review of the global first SARS-CoV-2 human infection challenge studies. To frame our review, we used the WHO guidance and our UK Health Research Authority ethical review framework. The WHO criteria covered most issues we were concerned about, but we would recommend one further criterion directing RECs to consider alternative research designs. Could research questions be equally well answered by less intrusive studies? The committee met virtually, ensuring broad representation across the UK nations and also ensuring applicants could attend easily. We worked in collaboration with the applicants but while we recognise that such proximity might raise the accusation of ‘collusion’, we made every effort to maintain ‘moral distance’ and all decisions were made by the committee alone. Prior existing processes and policy facilitated training and review but even with this preparation, review took time and this could have hindered a rapid response to the emergency. Review for the various follow-on studies will now be speedier and once the pandemic has subsided, our group could be reconvened in future emergencies. In conclusion, we have tried to make decisions in good faith. We know there is controversy and disagreement and reasonable people may feel we have made the wrong decision. A more detailed analysis, built on the WHO guidance, is provided in online supplemental material.

Download Full-text

Motor Development Research: Designs, Analyses, and Future Directions

Journal of Motor Learning and Development ◽

10.1123/jmld.2018-0029 ◽

2020 ◽

Vol 8 (2) ◽

pp. 410-437 ◽

Cited By ~ 1

Author(s):

Nancy Getchell ◽

Nadja Schott ◽

Ali Brian

Keyword(s):

Motor Development ◽

Motor Behavior ◽

Developmental Change ◽

Development Research ◽

Cross Sectional ◽

Future Directions ◽

Research Designs ◽

Experimental Approaches ◽

Human Motor ◽

Alternative Research

Throughout this special issue, different authors have discussed diverse aspects of past, present, and future motor development research. In such research, understanding how people move involves much more than studying motor behavior in individuals of different ages. Rather, empirical designs should embed some element of past, present, and future motor behavior into research questions, designs, methodologies, and interpretations. In this article, we provide an overview on the process of asking movement-related developmental questions and designing appropriate research studies that will answer them to provide a foundation for both new and returning investigators interested in studying human motor development. We compare descriptive and experimental approaches as well as longitudinal, cross-sectional, and alternative research designs, followed by a discussion of common statistical analyses suited for these designs. Through this discussion, we offer suggestions for the most appropriate ways in which to study developmental change. We finish with our thoughts on future directions for investigational methods within motor development research.

Download Full-text

XBRL Adoption and Bank Loan Contracting: Early Evidence

Journal of Information Systems ◽

10.2308/isys-51688 ◽

2017 ◽

Vol 32 (2) ◽

pp. 47-69 ◽

Cited By ~ 12

Author(s):

Gary Chen ◽

Jeong-Bon Kim ◽

Jee-Hae Lim ◽

Jie Zhou

Keyword(s):

Financial Reporting ◽

Lower Cost ◽

Bank Loans ◽

Bank Loan ◽

Difference In Differences ◽

Business Reporting ◽

Loan Contracting ◽

Research Designs ◽

Alternative Research ◽

Loan Spreads

ABSTRACT We examine how the adoption of the eXtensible Business Reporting Language (XBRL) for financial reporting impacts the pricing of bank loans. Using a sample of loans granted to U.S. borrowers from 2007–2013, we find that the adoption of XBRL is associated with a reduction in loan spreads. We further find that the reduction in loan spreads is greater for borrowers who have information that is inherently costlier to process. Results from a difference-in-differences specification along with other alternative research designs provide similar inferences. Subsequent to XBRL adoption, we further show that loan spreads are lower for firms that use more standardized XBRL tags and greater for those that use more extension elements. Overall, our results are consistent with the view that the XBRL mandate brings about an environment that enables lenders to gather and process information in a timelier manner and at a lower cost. JEL Classifications: M41; K22.

Download Full-text