scholarly journals Aligning sampling and case selection in quantitative-qualitative research designs: Establishing generalizability limits in mixed-method studies

Ethnography ◽  
2017 ◽  
Vol 19 (2) ◽  
pp. 227-253 ◽  
Author(s):  
Bryan L Sykes ◽  
Anjuli Verma ◽  
Black Hawk Hancock

Quantitative researchers increasingly draw on ethnographic research that may not be generalizable to inform and interpret results from statistical analyses; at the same time, while generalizability is not always an ethnographic research goal, the integration of quantitative data by ethnographic researchers to buttress findings on processes and mechanisms has also become common. Despite the burgeoning use of dual designs in research, there has been little empirical assessment of whether the themes, narratives, and ideal types derived from qualitative fieldwork are broadly generalizable in a manner consistent with estimates obtained from quantitative analyses. We draw on simulated and real-world data to assess the bias associated with failing to align samples across qualitative and quantitative methodologies. Our findings demonstrate that significant bias exists in mixed-methods studies when sampling is incongruent within research designs. We propose three solutions to limit bias in mixed-methods research.

2020 ◽  
Vol 5 (12) ◽  
pp. e002938
Author(s):  
Austin Carter ◽  
Nadia Akseer ◽  
Kevin Ho ◽  
Oliver Rothschild ◽  
Niranjan Bose ◽  
...  

This paper introduces a framework for conducting and disseminating mixed methods research on positive outlier countries that successfully improved their health outcomes and systems. We provide guidance on identifying exemplar countries, assembling multidisciplinary teams, collecting and synthesising pre-existing evidence, undertaking qualitative and quantitative analyses, and preparing dissemination products for various target audiences. Through a range of ongoing research studies, we illustrate application of each step of the framework while highlighting key considerations and lessons learnt. We hope uptake of this comprehensive framework by diverse stakeholders will increase the availability and utilisation of rigorous and comparable insights from global health success stories.


2019 ◽  
Vol 14 (2) ◽  
pp. 145-163 ◽  
Author(s):  
Marcia Gail Headley ◽  
Vicki L. Plano Clark

Many research problems in social science involve multilevel phenomena. However, discussions about multilevel research designs are limited in the mixed methods (MM) literature. Building on early writings in the field, this methodological discussion advances a refined definition of a multilevel MM research design. The refinement emerges from a review of qualitative and quantitative conceptions of multilevel research designs and an analysis of a literature-based definition of a multilevel MM research design. To illustrate the application of the refined definition, we present an exemplar of a multilevel MM study aimed at explaining cultural, behavioral, and neurobiological aspects of literacy for mathematics. This comprehensive and versatile definition advances the field by offering guidance for designing and conducting innovative multilevel MM studies.


2018 ◽  
Vol 61 (2) ◽  
pp. 314-334 ◽  
Author(s):  
Black Hawk Hancock ◽  
Bryan L. Sykes ◽  
Anjuli Verma

Amid ongoing controversies in ethnography concerning representation, reproducibility, and generalizability, social scientific scholarship has increasingly taken a mixed-methods turn. While studies that blend qualitative and quantitative data promise to enhance the validity of representations of social worlds under analysis, they cannot escape contending with foundational dilemmas of scientific translation, integration, and commensurability across methodological paradigms. Recent debates have ignited a new line of inquiry about the integration of multiple methods in ethnography. In this paper, we argue that “cameo appearances”—the summoning of either qualitative or quantitative analyses in separate, purely mono-method studies—amounts to a form of methodological tokenism under the guise of methodological pluralism. We articulate sampling design, enhanced training, and curriculum development as crucial for arbitrating these debates as mixed-methods research emerges as a distinct innovation in twenty-first-century ethnography.


2010 ◽  
pp. 19-34
Author(s):  
Graham Scambler

This paper starts by characterizing conventional notions of quantitative ‘versus' qualitative research and considers their potential displacement by ‘mixed-methods' research. The claim that mixed-methods research is necessarily an advance on its predecessors is critiqued. Using a critical realist approach favouring retroductive and abductive rather than inductive and deductive research strategies, it is suggested that the theoretical dimension implicit in all research is too often neglected. It is further contended that ‘making a case' empirically amounts to much the same things as ‘making a case' theoretically. More ‘metareflection' is commended. Brief references is made to the literature on health inequalities to add some flesh to the bones of the argument.


2020 ◽  
Vol 12 (2) ◽  
pp. 153-165
Author(s):  
Mandy M. Archibald ◽  
Anthony J. Onwuegbuzie

Integration—or the meaningful bringing together of different data sets, sampling strategies, research designs, analytic procedures, inferences, or the like—is considered by many to be the hallmark characteristic of mixed methods research. Poetry, with its innate capacity for leveraging human creativity, and like arts-based research more generally, which can provide holistic and complexity-based perspectives through various approaches to data collection, analysis, and representation, can offer something of interest to dialogue on integration in mixed methods research. Therefore, in this editorial, we discuss and promote the use of poetry in mixed methods research. We contend that the complexities and mean-making parallelisms between poetry and mixed methods research render them relevant partners in a quest to complete the hermeneutic circle whose origin represents experiences, phenomena, information, and/or the like. We advance the notion that including poetic representation facilitates the mixed methods research process as a dynamic, iterative, interactive, synergistic, integrative, holistic, embodied, creative, artistic, and transformational meaning-making process that opens up a new epistemological, theoretical, and methodological space. We refer to this as the fourth space, where the quantitative, qualitative, mixed methods, and poetic research traditions intersect to enable different and deeper levels of meaning making to occur. We end our editorial with a poetic representation driven by a word count analysis of our editorial and that synthesizes our thoughts regarding the intersection of poetry and mixed methods research within this fourth space—a representation that we have entitled, “Dear Article.”


2019 ◽  
Vol 21 (1) ◽  
pp. 26-32 ◽  
Author(s):  
Jeff Riddell ◽  
Alisha Brown ◽  
Lynne Robins ◽  
Rafae Nauman ◽  
Jeanette Yang ◽  
...  

Introduction: Twitter is growing in popularity and influence among emergency physicians (EP), with over 2200 self-identified EP users. As Twitter’s popularity has increased among EPs so too has its influence. While there has been debate about the value of Twitter as an effective educational delivery tool, little attention has been paid to the nature of the conversation occurring on Twitter. We aim to describe how influential EPs use Twitter by characterizing the language, purpose, frequencies, content, and degree of engagement of their tweets. Methods: We performed a mixed-methods analysis following a combined content analysis approach. We conducted qualitative and quantitative analyses of a sample of tweets from the 61 most influential EPs on Twitter. We present descriptive tweet characteristics and noteworthy themes. Results: We analyzed 1375 unique tweets from 57 unique users, representing 93% of the influential Twitter EPs. A majority of tweets (1104/1375, 80%) elicited some response in the form of retweets, likes, or replies, demonstrating community engagement. The qualitative analysis identified 15 distinct categories of tweets. Conclusion: Influential EPs on Twitter were engaged in largely medical conversations in which most messages generated some form of interaction. They shared resources and opinions while also building social rapport in a community of practice. This data can help EPs make informed decisions about social media engagement.


2020 ◽  
pp. 155868982095323
Author(s):  
Maureen R. Waller ◽  
Lenna Nepomnyaschy ◽  
Daniel P. Miller ◽  
Meaghan Mingo

Despite growing interest in longitudinal mixed methods research designs, more strategies for analyzing and integrating these data are needed. This article contributes to the field of mixed methods research by presenting a novel narrative approach to data analysis in longitudinal studies. Our approach involves the transformation of longitudinal survey data from the Fragile Families and Child Wellbeing Study into narrative case histories. We use qualitative interviews from participants in an embedded study to select survey variables for data transformation and to explain unexpected survey outcomes. Our analysis shows how multiple factors converge to enable or constrain fathers’ involvement with children in five different fathering trajectories, and how the narrative frames of some disadvantaged fathers may facilitate their sustained involvement.


Sign in / Sign up

Export Citation Format

Share Document