scholarly journals Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study

2019 ◽  
Vol 111 ◽  
pp. 49-59.e1 ◽  
Author(s):  
Quan Nha Hong ◽  
Pierre Pluye ◽  
Sergi Fàbregues ◽  
Gillian Bartlett ◽  
Felicity Boardman ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Content Validity ◽  
Delphi Study ◽  
Appraisal Tool

VP26 A Critical Appraisal Tool For Systematic Mixed Studies Reviews

2018 ◽  
Vol 34 (S1) ◽  
pp. 166-166 ◽  
Author(s):  
Quan Nha Hong ◽  
Pierre Pluye ◽  
Sergi Fàbregues ◽  
Gillian Bartlett ◽  
Felicity Boardman ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Delphi Study ◽  
Critical Appraisal ◽  
Included Study ◽  
The Core ◽  
Critical Appraisal Tool ◽  
Study Designs ◽  
Clinical Problems ◽  
Appraisal Tool

Introduction:Systematic mixed studies reviews are a type of systematic review that combine qualitative, quantitative and mixed methods studies. They are gaining in popularity due to their potential for providing in-depth answers to complex clinical problems and practical concerns. However, several challenges are encountered in systematic mixed studies reviews because of the heterogeneity of included study designs. One of these challenges is related to the quality appraisal of included studies. To address this challenge, a critical appraisal tool for assessing the quality of quantitative, qualitative and mixed methods studies was developed in 2007: the Mixed Methods Appraisal Tool (MMAT). The aim of this project was to strengthen the content validity of the MMAT.Methods:A new version of the MMAT was developed using the results from a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts (n = 73) to identify the core relevant criteria to include in the MMAT.Results:The results of this project and the new version of the MMAT will be presented. The MMAT has three main characteristics. First, it can be used for different study designs since it includes criteria for qualitative, quantitative and mixed methods studies. Second, the MMAT focuses on the core relevant methodological criteria and has five criteria per category of study. Third, it includes specific criteria for assessing mixed methods studies.Conclusions:Currently, there exists over 500 critical appraisal tools, making the task of selecting the proper tools for use in systematic mixed studies reviews more difficult. The MMAT offers an alternative solution by proposing a unique tool that can appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more time efficient assessment.

scholarly journals Development and Content Validity of the Physical Activity Questionnaire-Young Children (PAQ-YC) to Assess Physical Activity in Children between 5 and 7 Years

Healthcare ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 655
Author(s):  
Marta Amor-Barbosa ◽  
Montserrat Girabent-Farrés ◽  
Ferran Rosés-Noguer ◽  
Anna Ortega-Martínez ◽  
Almudena Medina-Rincón ◽  
...  
Keyword(s):  
Physical Activity ◽  
Physical Education ◽  
Young Children ◽  
Content Validity ◽  
Delphi Study ◽  
Critical Period ◽  
Consensus Criterion ◽  
Physical Activity Questionnaire ◽  
Healthy Habits ◽  
Activity Questionnaire

Childhood is a critical period in the development and consolidation of healthy habits, such as the practice of physical activity (PA). It is essential to have valid instruments to measure PA from an early age. The aim of this study was to design and evaluate the content validity of the Physical Activity Questionnaire-Young Children (PAQ-YC) to measure the PA level in children aged 5–7 years. The first version of the questionnaire was tested by a 2-round Delphi study. It was established as a consensus criterion that the relative interquartile range (RIR) and/or the coefficient of variation (CV) were ≤20%. The most significant discrepancies in the Delphi survey (n = 11–13) were observed for items about hours of Physical Education or similar activities at school (item 7: RIR = 20, CV = 38.73) and for items about participation in Physical Education (item 8: RIR = 25, CV = 15.45). The cognitive interviews (n = 5) confirmed the version agreed by the experts. The results show that the PAQ-YC presents adequate content validity in terms of relevance, comprehensiveness and comprehensibility.

scholarly journals Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Reema Harrison ◽  
Benjamin Jones ◽  
Peter Gardner ◽  
Rebecca Lawton
Keyword(s):  
Health Services Research ◽  
Health Services ◽  
Literature Review ◽  
Quality Assessment ◽  
Systematic Reviews ◽  
Content Validity ◽  
Reporting Quality ◽  
Services Research ◽  
Appraisal Tool

Abstract Background In the context of the volume of mixed- and multi-methods studies in health services research, the present study sought to develop an appraisal tool to determine the methodological and reporting quality of such studies when included in systematic reviews. Evaluative evidence regarding the design and use of our existing Quality Assessment Tool for Studies with Diverse Designs (QATSDD) was synthesised to enhance and refine it for application across health services research. Methods Secondary data were collected through a literature review of all articles identified using Google Scholar that had cited the QATSDD tool from its inception in 2012 to December 2019. First authors of all papers that had cited the QATSDD (n=197) were also invited to provide further evaluative data via a qualitative online survey. Evaluative findings from the survey and literature review were synthesised narratively and these data used to identify areas requiring refinement. The refined tool was subject to inter-rater reliability, face and content validity analyses. Results Key limitations of the QATSDD tool identified related to a lack of clarity regarding scope of use of the tool and in the ease of application of criteria beyond experimental psychological research. The Quality Appraisal for Diverse Studies (QuADS) tool emerged as a revised tool to address the limitations of the QATSDD. The QuADS tool demonstrated substantial inter-rater reliability (k=0.66), face and content validity for application in systematic reviews with mixed, or multi-methods health services research. Conclusion Our findings highlight the perceived value of appraisal tools to determine the methodological and reporting quality of studies in reviews that include heterogeneous studies. The QuADS tool demonstrates strong reliability and ease of use for application to multi or mixed-methods health services research.

scholarly journals Development of an instrument for measuring adolescent health compromising behaviours among rural students: a Delphi study

2020 ◽  
Vol 8 (1) ◽  
pp. 154
Author(s):  
Kasturi Mandal ◽  
Pankaj K. Mandal
Keyword(s):  
Adolescent Health ◽  
Content Validity ◽  
Delphi Study ◽  
Rural Students ◽  
Nominal Data ◽  
Extensive Experience ◽  
Behavioral Determinants ◽  
Adolescent Students ◽  
Unhealthy Eating ◽  
Delphi Procedure

Background: There is an increasing trend of health compromising behaviors in adolescents worldwide. As behavioral determinants are extremely culture specific, person specific and as such least instruments have been developed in West Bengal. The aim of this study was to develop a specific instrument with strong content validity for measuring adolescent health compromising behavior of adolescent students of rural area.Methods: Face and content validity were evaluated in three round Delphi procedure by a panel of 15 experts who had extensive experience and knowledge of adolescent health compromising behavior. To ensure good cultural fit of the instrument with the rural context, modified Delphi procedure conducted among five stakeholders: medical and nursing, psychologist, sociologist, education experts, and parents. Reliability testing done among 100 students through test retest method with one-week interval.Results: A 85 questions-based instrument was developed reflecting 5 areas of health compromising behaviors; physical inactivity, sedentary behavior, unhealthy eating, poor dental hygiene, tobacco use and their multi-dimensional correlates. After round 3 Delphi, the final instrument had overall S–CVI/Ave of 99.05% and found to be reliable as evident by Pearson product moment correlation coefficient (r) for the scoring questions ranged from 0.72 to 0.84 and Cohen’s kappa coefficient (k) for nominal data, ranged from 0.8-1.Conclusions: The instrument has similarities as well as differences compared with instruments of Western origin. The instrument was valid and reliable and can be applied in both research and practice for measuring adolescent health compromising behaviors.

REVIEW

2014 ◽  
Vol 18 (09) ◽  
pp. 58-63 ◽  
Keyword(s):  
Mixed Methods ◽  
Content Validity ◽  
Data Science ◽  
Value Added ◽  
A Value

Mixed Methods for Establishing Content Validity: A Value-Added Approach? Data Science Driving Innovation.

scholarly journals Perspectives of parents and nurses on the content validity of the Family Empowerment Scale for parents of children with a chronic condition: A mixed‐methods study

2018 ◽  
Vol 45 (1) ◽  
pp. 111-120 ◽  
Author(s):  
Elisabeth W. Segers ◽  
Agnes Hoogen ◽  
Irene C. Eerden ◽  
Thora Hafsteinsdóttir ◽  
Marjolijn Ketelaar
Keyword(s):  
Mixed Methods ◽  
Content Validity ◽  
Chronic Condition ◽  
Mixed Methods Study ◽  
Family Empowerment ◽  
The Family

Using Mixed Methods Research as a Tool for Developing an Indigenous Cultural Values Instrument in Malaysia

2019 ◽  
Vol 14 (3) ◽  
pp. 403-424
Author(s):  
Mehdi Taghipoorreyneh ◽  
Ernest C. de Run
Keyword(s):  
Mixed Methods ◽  
Cultural Values ◽  
Research Design ◽  
Correspondence Analysis ◽  
Field Test ◽  
Delphi Study ◽  
Mixed Methods Research ◽  
Indigenous Culture ◽  
Validity And Reliability ◽  
Rigorous Method

The purpose of this article is to illustrate how mixed methods research can be applied as a rigorous method for developing a quantitative instrument responsive to an indigenous culture in Malaysia. In a sequential research design, a three-round Delphi study was conducted to integrate open-ended and free-listing data, and to generate a list of items. The items were subjected to a field test to ensure reliability. A correspondence analysis of scale was employed to examine the validity of the instrument. This research contributes to mixed methods by illustrating the value of Delphi groups as part of a mixed methods research design and the utility of mixed methods research in advancing the validity and reliability of an indigenous cultural values instrument.

scholarly journals COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study

2018 ◽  
Vol 27 (5) ◽  
pp. 1159-1170 ◽  
Author(s):  
C. B. Terwee ◽  
C. A. C. Prinsen ◽  
A. Chiarotto ◽  
M. J. Westerman ◽  
D. L. Patrick ◽  
...  
Keyword(s):  
Outcome Measures ◽  
Content Validity ◽  
Delphi Study ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Patient Reported

Systematic mixed studies reviews: Updating results on the reliability and efficiency of the mixed methods appraisal tool

2015 ◽  
Vol 52 (1) ◽  
pp. 500-501 ◽  
Author(s):  
Rafaella Queiroga Souto ◽  
Vladimir Khanassov ◽  
Quan Nha Hong ◽  
Paula L. Bush ◽  
Isabelle Vedel ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Appraisal Tool
Sign in / Sign up

Export Citation Format

Share Document