scholarly journals A Conceptual Framework for Critical Appraisal in Systematic Mixed Studies Reviews

2018 ◽  
Vol 13 (4) ◽  
pp. 446-460 ◽  
Author(s):  
Quan Nha Hong ◽  
Pierre Pluye

The past decade has been rich with methodological advancements in systematic reviews, several of which were inspired by the literature on mixed methods research. Systematic mixed studies reviews—that is, reviews combining qualitative and quantitative evidence—are increasingly popular as they can provide a better understanding of complex phenomena and interventions. However, they raise new challenges, especially regarding how to perform critical appraisal of the included studies that vary regarding the methodologies used. To address this challenge, conceptually clarifying critical appraisal is necessary. To this end, this article provides a framework for critical appraisal in systematic mixed studies reviews. This framework is an essential first step toward providing clear guidance on how to perform critical appraisal.

Author(s):  
Joseph E. Gaugler ◽  
Colleen M. Peterson ◽  
Lauren L. Mitchell ◽  
Jessica Finlay ◽  
Eric Jutkowitz

Mixed methods research consists of collecting and analyzing qualitative and quantitative data within a singular study. The “methods” of mixed methods research vary, but the ultimate goal is to provide greater understanding and explanation via the integration of qualitative and quantitative data. Mixed methods studies have the potential to advance our understanding of complex phenomena over time in adult development and aging (e.g., depression following the death of a spouse), but the utility of this approach depends on its application. The authors systematically searched the literature (CINHAL, Embase, Ovid/Medline, PubMed, PsychInfo, and ProQuest) to identify longitudinal mixed methods studies focused on aging. They identified 6,351 articles published between 1994 and 2017, of which 174 met the inclusion criteria. The majority of mixed methods studies reported on the evaluation of interventions or educational programs. Non-interventional studies tended to report on experiences related to the progression of various health conditions, the needs and experiences of caregivers, and the lived experiences of older adults. About half (n = 81) of the mixed methods studies followed a sequential explanatory design where a qualitative component followed quantitative evaluation, and most of these studies achieved “integration” by comparing qualitative and quantitative data in Results sections. There was considerable heterogeneity across studies in terms of overall design (randomized trials, program evaluations, cohort studies, and case studies). As a whole, the literature suffered from key limitations, including a lack of reporting on sample selection methodology and mixed methods design characteristics. To maximize the value of mixed methods in adult development in aging research, investigators should conform to recommended guidelines (e.g., depict participant study flow and use recommended notation) and consider more sophisticated mixed methods applications to advance the state of the art.


2020 ◽  
Vol 5 (12) ◽  
pp. e002938
Author(s):  
Austin Carter ◽  
Nadia Akseer ◽  
Kevin Ho ◽  
Oliver Rothschild ◽  
Niranjan Bose ◽  
...  

This paper introduces a framework for conducting and disseminating mixed methods research on positive outlier countries that successfully improved their health outcomes and systems. We provide guidance on identifying exemplar countries, assembling multidisciplinary teams, collecting and synthesising pre-existing evidence, undertaking qualitative and quantitative analyses, and preparing dissemination products for various target audiences. Through a range of ongoing research studies, we illustrate application of each step of the framework while highlighting key considerations and lessons learnt. We hope uptake of this comprehensive framework by diverse stakeholders will increase the availability and utilisation of rigorous and comparable insights from global health success stories.


2021 ◽  
pp. 263208432098437
Author(s):  
Ahtisham Younas ◽  
Shahzad Inayat ◽  
Amara Sundus

Mixed methods reviews offer an excellent approach to synthesizing qualitative and quantitative evidence to generate more robust implications for practice, research, and policymaking. There are limited guidance and practical examples concerning the methods for adequately synthesizing qualitative and quantitative research findings in mixed reviews. This paper aims to illustrate the application and use of joint displays for qualitative and quantitative synthesis in mixed methods reviews. We used joint displays to synthesize and integrate qualitative and quantitative research findings in a segregated mixed methods review about male nursing students' challenges and experiences. In total, 36 qualitative, six quantitative, and one mixed-methods study was appraised and synthesized in the review. First, the qualitative and quantitative findings were analyzed and synthesized separately. The synthesized findings were integrated through tabular and visual joint displays at two levels of integration. At the first level, a statistics theme display was developed to compare the synthesized qualitative and quantitative findings and the number of studies from which the findings were generated. At the second level, the synthesized qualitative and quantitative findings supported by each other were integrated to identify confirmed, discordant, and expanded inferences using generalizing theme display. The use of two displays allowed in a robust and comprehensive synthesis of studies. Joint displays could serve as an excellent method for rigorous and transparent synthesis of qualitative and quantitative findings and the generation of adequate and relevant inferences in mixed methods reviews.


2010 ◽  
pp. 19-34
Author(s):  
Graham Scambler

This paper starts by characterizing conventional notions of quantitative ‘versus' qualitative research and considers their potential displacement by ‘mixed-methods' research. The claim that mixed-methods research is necessarily an advance on its predecessors is critiqued. Using a critical realist approach favouring retroductive and abductive rather than inductive and deductive research strategies, it is suggested that the theoretical dimension implicit in all research is too often neglected. It is further contended that ‘making a case' empirically amounts to much the same things as ‘making a case' theoretically. More ‘metareflection' is commended. Brief references is made to the literature on health inequalities to add some flesh to the bones of the argument.


2020 ◽  
pp. 95-121
Author(s):  
Amir Manzoor

Mixed methods research is becoming an increasingly popular approach in the discipline fields of sociology, psychology, education and health sciences. Calls for the integration of quantitative and qualitative research methods have been advanced in these fields. A key feature of mixed methods research is its methodological pluralism, which frequently results in research which provides broader perspectives than those offered by mono-method designs. The central premise of mixed methods is that the use of quantitative and qualitative approaches in combination provides a better understanding of research problems and complex phenomena than either approach alone. The purpose of this chapter is to review designs of mixed methods research. The study surveys the common designs of mixed methods research and examine the main characteristics of each in terms of purposes, strengths, and issues, and posits suggestions on the application of these designs.


Author(s):  
Amir Manzoor

Mixed methods research is becoming an increasingly popular approach in the discipline fields of sociology, psychology, education and health sciences. Calls for the integration of quantitative and qualitative research methods have been advanced in these fields. A key feature of mixed methods research is its methodological pluralism, which frequently results in research which provides broader perspectives than those offered by mono-method designs. The central premise of mixed methods is that the use of quantitative and qualitative approaches in combination provides a better understanding of research problems and complex phenomena than either approach alone. The purpose of this chapter is to review designs of mixed methods research. The study surveys the common designs of mixed methods research and examine the main characteristics of each in terms of purposes, strengths, and issues, and posits suggestions on the application of these designs.


Author(s):  
Amir Manzoor

Mixed methods research is becoming an increasingly popular approach in the discipline fields of sociology, psychology, education and health sciences. Calls for the integration of quantitative and qualitative research methods have been advanced in these fields. A key feature of mixed methods research is its methodological pluralism, which frequently results in research which provides broader perspectives than those offered by mono-method designs. The central premise of mixed methods is that the use of quantitative and qualitative approaches in combination provides a better understanding of research problems and complex phenomena than either approach alone. The purpose of this chapter is to review designs of mixed methods research. The study surveys the common designs of mixed methods research and examine the main characteristics of each in terms of purposes, strengths, and issues, and posits suggestions on the application of these designs.


2016 ◽  
Vol 23 (9) ◽  
pp. 764-769 ◽  
Author(s):  
Liam J Caffery ◽  
Melinda Martin-Khan ◽  
Victoria Wade

Mixed methods research is important to health services research because the integrated qualitative and quantitative investigation can give a more comprehensive understanding of complex interventions such as telehealth than can a single-method study. Further, mixed methods research is applicable to translational research and program evaluation. Study designs relevant to telehealth research are described and supported by examples. Quality assessment tools, frameworks to assist in the reporting and review of mixed methods research, and related methodologies are also discussed.


Sign in / Sign up

Export Citation Format

Share Document