Assessing the Quality of Mixed Methods Research: Toward a Comprehensive Framework

This paper introduces a framework for conducting and disseminating mixed methods research on positive outlier countries that successfully improved their health outcomes and systems. We provide guidance on identifying exemplar countries, assembling multidisciplinary teams, collecting and synthesising pre-existing evidence, undertaking qualitative and quantitative analyses, and preparing dissemination products for various target audiences. Through a range of ongoing research studies, we illustrate application of each step of the framework while highlighting key considerations and lessons learnt. We hope uptake of this comprehensive framework by diverse stakeholders will increase the availability and utilisation of rigorous and comparable insights from global health success stories.

Download Full-text

Quality of reporting in chiropractic mixed methods research: a methodological review protocol

Chiropractic & Manual Therapies ◽

10.1186/s12998-021-00395-0 ◽

2021 ◽

Vol 29 (1) ◽

Author(s):

Peter C. Emary ◽

Kent J. Stuber ◽

Lawrence Mbuagbaw ◽

Mark Oremus ◽

Paul S. Nolet ◽

...

Keyword(s):

Mixed Methods ◽

Mixed Methods Research ◽

Quantitative Methods ◽

Data Extraction ◽

Reporting Quality ◽

Health Care Research ◽

Quality Of Reporting ◽

Methodological Review ◽

Chiropractic Research

Abstract Background Mixed methods designs are increasingly used in health care research to enrich findings. However, little is known about the frequency of use of this methodology in chiropractic research, or the quality of reporting among chiropractic studies using mixed methods. Objective To quantify the use and quality of mixed methods in chiropractic research, and explore the association of study characteristics (e.g., authorship, expertise, journal impact factor, country and year of publication) with reporting quality. Methods We will conduct a systematic search of MEDLINE, EMBASE, CINAHL, and the Index to Chiropractic Literature to identify all chiropractic mixed methods studies published from inception of each database to December 31, 2020. Articles reporting the use of both qualitative and quantitative methods, or mixed qualitative methods, will be included. Pairs of reviewers will perform article screening, data extraction, risk of bias with the Mixed Methods Appraisal Tool (MMAT), and appraisal of reporting quality using the Good Reporting of A Mixed Methods Study (GRAMMS) guideline. We will explore the correlation between GRAMMS and MMAT scores, and construct generalized estimating equations to explore factors associated with reporting quality. Discussion This will be the first methodological review to examine the reporting quality of published mixed methods studies involving chiropractic research. The results of our review will inform opportunities to improve reporting in chiropractic mixed methods studies. Our results will be disseminated in a peer-reviewed publication and presented publicly at conferences and as part of a doctoral thesis.

Download Full-text

7 Quality of Inferences in Mixed Methods Research: Calling for an Integrative Framework

Advances in Mixed Methods Research ◽

10.4135/9780857024329.d10 ◽

2014 ◽

pp. 101-119 ◽

Cited By ~ 5

Keyword(s):

Mixed Methods ◽

Mixed Methods Research ◽

Integrative Framework

Download Full-text

Quality Reporting of Mixed Methods Research in Tourism-Related Studies

African Journal of Hospitality, Tourism and Leisure ◽

10.46222/ajhtl.19770720.193 ◽

2021 ◽

Vol 10 (10(6)) ◽

pp. 1794-1810

Author(s):

CH Van Heerden

Keyword(s):

Mixed Methods ◽

Mixed Methods Research ◽

Reporting Quality ◽

International Standards ◽

Future Research ◽

Quality Of Reporting ◽

Data Set ◽

Postgraduate Students ◽

Quality Reporting

The aim of this study is to gain scientific insight into internationally-accepted criteria for quality reporting of mixed methods research (MMR). Articles published post-2012 in a particular journal, which referred to “mixed methods” and “tourism”, and reported that qualitative and quantitative data were collected, were drawn from Google Scholar and Scopus. The reporting quality of these studies was analysed according to the GRAMMS framework (Good Reporting of a Mixed Methods Study). Most of the articles in the data set did not report on all the elements embedded in GRAMMS. It must not be seen as a reflection of the quality of the MMR design itself, nor is the study flawed. It indicates gaps in the reporting of important MMR elements that could be addressed in future research. Exemplars were identified that could serve as case studies for researchers in terms of the quality of reporting on MMR. Editorial boards should adopt guidelines on how MMR could be presented in articles submitted to their journals. These guidelines could assist authors in preparing their articles to conform to international standards on the reporting of MMR studies. Peer reviewers should use the guidelines to judge the quality of reporting on MMR methodology in articles under review. This study could also serve as a future reference for researchers, postgraduate students and supervisors who aim to incorporate MMR in their research.

Download Full-text

The Quality of ‘Good’ Mixed Methods Research: Development and Discussion of an Orientation Framework

Triangulation und Mixed-Methods - Studien zur Schul- und Bildungsforschung ◽

10.1007/978-3-658-24225-1_4 ◽

2019 ◽

pp. 63-99

Author(s):

Matthias Völcker

Keyword(s):

Mixed Methods ◽

Mixed Methods Research ◽

Research Development

Download Full-text

Using mixed-methods research to study the quality of life of coeliac women

Journal of Clinical Nursing ◽

10.1111/jocn.13584 ◽

2016 ◽

Vol 26 (7-8) ◽

pp. 1119-1130 ◽

Cited By ~ 1

Author(s):

Julián Rodríguez Almagro ◽

Antonio Hernández Martínez ◽

María Carmen Solano Ruiz ◽

José Siles González

Keyword(s):

Quality Of Life ◽

Mixed Methods ◽

Mixed Methods Research

Download Full-text

Operationalizing and Conceptualizing Quality in Mixed Methods Research: A Multiple Case Study of the Disciplines of Education, Nursing, Psychology, and Sociology

Journal of Mixed Methods Research ◽

10.1177/1558689817751774 ◽

2018 ◽

Vol 13 (4) ◽

pp. 424-445 ◽

Cited By ~ 6

Author(s):

Sergi Fàbregues ◽

Marie-Hélène Paré ◽

Julio Meneses

Keyword(s):

Mixed Methods ◽

Mixed Methods Research ◽

Multiple Case Study ◽

Quality Criteria ◽

The Other ◽

Multiple Case ◽

Qualitative Multiple Case Study ◽

Education Nursing

The purpose of this qualitative multiple case study is to describe and compare how researchers in the education, nursing, psychology, and sociology disciplines operationalize and conceptualize the quality of mixed methods research (MMR). An international sample of 44 MMR researchers representing these four disciplines were interviewed. The study findings point to (a) two perspectives from which the quality of MMR is understood, one contingent and flexible and the other universal and fixed; (b) a relationship between these two perspectives and the participants’ discipline; and (c) a similar occurrence, both in terms of nature and frequency, of the MMR quality criteria most mentioned by the participants across disciplines. Implications of the findings for the field of MMR are discussed.

Download Full-text

A Methodological Review of Mixed Methods Research in Palliative and End-of-Life Care (2014–2019)

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph17113853 ◽

2020 ◽

Vol 17 (11) ◽

pp. 3853

Author(s):

Sergi Fàbregues ◽

Quan Nha Hong ◽

Elsa Lucia Escalante-Barrios ◽

Timothy C. Guetterman ◽

Julio Meneses ◽

...

Keyword(s):

Palliative Care ◽

Mixed Methods ◽

End Of Life ◽

Mixed Methods Research ◽

Reporting Quality ◽

Mixed Methods Study ◽

Quality Of Reporting ◽

Methodological Review ◽

Convergent Design

Mixed methods research has been increasingly recognized as a useful approach for describing and explaining complex issues in palliative care and end-of-life research. However, little is known about the use of this methodology in the field and the ways in which mixed methods studies have been reported. The purpose of this methodological review was to examine the characteristics, methodological features and reporting quality of mixed methods articles published in palliative care research. The authors screened all articles published in eight journals specialized in palliative care between January 2014 and April 2019. Those that reported a mixed methods study (n = 159) were included. The Good Reporting of a Mixed Methods Study (GRAMMS) criteria were used to assess reporting quality. Findings showed that 57.9% of the identified studies used a convergent design and 82.4% mentioned complementarity as their main purpose for using a mixed methods approach. The reporting quality of the articles generally showed a need for improvement as authors usually did not describe the type of mixed methods design used and provided little detail on the integration of quantitative and qualitative methods. Based on the findings, recommendations are made to improve the quality of reporting of mixed methods articles in palliative care.

Download Full-text

“Fit and Fabulous”: Mixed-Methods Research on Processes, Perceptions, and Outcomes of a Yearlong Gym Program With Assisted-Living Residents

Journal of Aging and Physical Activity ◽

10.1123/japa.2012-0278 ◽

2014 ◽

Vol 22 (2) ◽

pp. 212-225 ◽

Cited By ~ 1

Author(s):

Mary Ann Kluge ◽

Michelle LeCompte ◽

Lisa Ramel

Keyword(s):

Mixed Methods ◽

Assisted Living ◽

Mixed Methods Research ◽

Lower Body ◽

Active Time ◽

Body Strength ◽

Trained Staff ◽

Lower Body Strength ◽

Resource Support

This study’s mixed-methods design sought to understand how to encourage assisted-living (AL) residents to initiate and continue exercise in a gym setting. Ten residents participated in this yearlong program. Processes developed and perceived benefits were understood through interviews and observations. Changes in active time, lower body strength, and workload were evaluated using direct measures. Findings indicated that AL residents regularly used exercise machines (mean participation = 53.8%) and increased active time and lower body strength (p= .02) when adequately prepared and supported. Participants prioritized gym time and developed pride and ownership in the program. They described themselves as exercisers and developed a sense of belonging to their new home. Friendships with one another, staff, and university partners were nurtured in the gym setting. When provided space, equipment, trained staff, and additional resource support, AL residents’ quality of life and life satisfaction were enhanced in several domains.

Download Full-text

Sex and Relationships Education for Special Educational Needs - An exploration of the quality of provision

10.31124/advance.12826382.v1 ◽

2020 ◽

Author(s):

Paul Bray

Keyword(s):

Mixed Methods ◽

Critical Theory ◽

Mixed Methods Research ◽

Code Of Conduct ◽

Ethical Code ◽

Special Educational Needs ◽

New Paradigm ◽

Ex Post ◽

Ex Post Facto

Mixed methods research; a new paradigm Positivist - Quantitative *Pupil progress and assessment/attainment data. *Parental ‘check list’.*Questionnaires.Anti- positivist - Interpretive Historical and documentary research Retrospective ex post facto research - Qualitative *Informal Interviews.*Literature review (including policy and curriculum guidance).Anti- positivist - Participatory - Qualitative *Presentations. *Observation. *Informal discussions. *SRE ‘group’ sessions.Anti- positivist - Investigative research - Qualitative *Observation. *Informal discussion.*SRE group work. *Parental workshops.Anti- positivist - Pragmatism - Qualitative *Mixed Methods approach Critical theory - Critical pedagogical - Ideology *Reflection on SRE for SEN *Schemes of Work and quality of SRE provision. Critical theory - Reflective - Action research *Observation. *Informal discussions. *Pupil session discussions. *Assessments - planning ahead. *After course assessments – planning ahead. *Informal Interviews. I am confident that permission, where needed, had been gained and that the rights of everyone taking part were upheld. I do not believe that there are any other ethical concerns to be addressed within this particular research study. Other guidelines that were followed were; Government Office for Science (2007) Rigour, Respect and Responsibility: A Universal Ethical Code for Scientists. http://www.bis.gov.uk/assets/BISPartners/GoScience/Docs/U/universal-ethical-code-scientists.pdf Research Councils UK (2009) RCUK Policy and Code of Conduct on the Governance of Good Research Conduct: Integrity, Clarity and Good Management. http://www.rcuk.ac.uk/documents/reviews/grc/grcpoldraft.pdf [last accessed 10/01/12]. ESRC’s (2010) Framework for Research Ethics, to which the AHRC also refers. http://www.esrcsocietytoday.ac.uk/_images/Framework_for_Research_Ethics_tcm8-4586.pdf The University of St Mark & St John’s ethics policy. <div> </div>

Download Full-text