scholarly journals Beyond Interviews and Focus Groups: Mapping New Ways to Integrate Innovative Qualitative Methods into Randomised Controlled Trials of Complex Public Health Interventions

2018 ◽  
Author(s):  
Katherine Davis ◽  
Nicole Minckas ◽  
Virginia Bond ◽  
Cari Jo Clark ◽  
Tim Colbourn ◽  
...  

Abstract Background: Randomised controlled trials (RCTs) are widely used for establishing evidence of the effectiveness of interventions, yet public health interventions are often complex, posing specific challenges for RCTs. While there is increasing recognition that qualitative methods can and should be integrated into RCTs, few frameworks and practical guidance highlight which qualitative methods should be integrated and for what purposes. As a result, qualitative methods are often poorly or haphazardly integrated into existing trials and researchers rely heavily on standard interviews and focus group discussions. To improve current practice, we propose a framework for innovative qualitative research methods that can help address the challenges of RCTs for complex public health interventions. Methods: We used a stepped approach to develop a practical framework for researchers, which included: (1) a systematic review of the innovative qualitative methods mentioned in the health literature, (2) in-depth interviews with 23 academics from different methodological backgrounds working on RCTs of public health interventions in 11 different countries, and (3) framework development and group consensus-building process. Results: The findings are presented according to the CONSORT Statement categories for ease of use. The main challenges of RCTs for public health interventions are identified alongside each of the CONSORT categories and potential innovative qualitative methods that overcome each challenge are listed as part of a Framework for the Integration of Innovative Qualitative Methods into RCTs of Complex Health Interventions. Innovative qualitative methods raised in the interviews and discussed in detail include: rapid ethnographic appraisals, document analysis, diary methods, interactive voice responses and SMS, community mapping, spiral walks, public randomisation, pair interviews, visual participatory analysis, among others. Conclusions: The findings of this study point to the usefulness of observational and participatory methods for trials of complex public health interventions, offering a novel contribution to the broader literature about the need for mixed methods approaches. Integrating a diverse toolkit of qualitative methods can enable appropriate adjustments during RCTs, which in turn create more sustainable and effective interventions. However, this will require a cultural shift including the adoption of method-neutral research approaches, transdisciplinary collaborations, and a shift in publishing regimes.

2019 ◽  
Author(s):  
Katy Davis ◽  
Nicole Minckas ◽  
Virginia Bond ◽  
Cari Jo Clark ◽  
Tim Colbourn ◽  
...  

Abstract Background: Randomised controlled trials (RCTs) are widely used for establishing evidence of the effectiveness of interventions, yet public health interventions are often complex, posing specific challenges for RCTs. While there is increasing recognition that qualitative methods can and should be integrated into RCTs, few frameworks and practical guidance highlight which qualitative methods should be integrated and for what purposes. As a result, qualitative methods are often poorly or haphazardly integrated into existing trials, and researchers rely heavily on interviews and focus group discussions. To improve current practice, we propose a framework for innovative qualitative research methods that can help address the challenges of RCTs for complex public health interventions. Methods: We used a stepped approach to develop a practical framework for researchers. This included: (1) a systematic review of the innovative qualitative methods mentioned in the health literature; (2) in-depth interviews with 23 academics from different methodological backgrounds working on RCTs of public health interventions in 11 different countries; and (3) a framework development and group consensus-building process. Results: The findings are presented according to the CONSORT Statement categories for ease of use. We identify the main challenges of RCTs for public health interventions alongside each of the CONSORT categories and potential innovative qualitative methods that overcome each challenge are listed as part of a Framework for the Integration of Innovative Qualitative Methods into RCTs of Complex Health Interventions. Innovative qualitative methods described in the interviews include: rapid ethnographic appraisals, document analysis, diary methods, interactive voice responses and SMS, community mapping, spiral walks, pair interviews and visual participatory analysis. Conclusions: The findings of this study point to the usefulness of observational and participatory methods for trials of complex public health interventions, offering a novel contribution to the broader literature about the need for mixed methods approaches. Integrating a diverse toolkit of qualitative methods can enable appropriate adjustments to the intervention and/ or process of data collection during RCTs, which in turn can create more sustainable and effective interventions. However, such integration will require a cultural shift towards the adoption of method-neutral research approaches, transdisciplinary collaborations, and publishing regimes.


2019 ◽  
Author(s):  
Katy Davis ◽  
Nicole Minckas ◽  
Virginia Bond ◽  
Cari Jo Clark ◽  
Tim Colbourn ◽  
...  

Abstract Background: Randomised controlled trials (RCTs) are widely used for establishing evidence of the effectiveness of interventions, yet public health interventions are often complex, posing specific challenges for RCTs. While there is increasing recognition that qualitative methods can and should be integrated into RCTs, few frameworks and practical guidance highlight which qualitative methods should be integrated and for what purposes. As a result, qualitative methods are often poorly or haphazardly integrated into existing trials, and researchers rely heavily on interviews and focus group discussions. To improve current practice, we propose a framework for innovative qualitative research methods that can help address the challenges of RCTs for complex public health interventions. Methods: We used a stepped approach to develop a practical framework for researchers. This included: (1) a systematic review of the innovative qualitative methods mentioned in the health literature; (2) in-depth interviews with 23 academics from different methodological backgrounds working on RCTs of public health interventions in 11 different countries; and (3) a framework development and group consensus-building process. Results: The findings are presented according to the CONSORT Statement categories for ease of use. We identify the main challenges of RCTs for public health interventions alongside each of the CONSORT categories and potential innovative qualitative methods that overcome each challenge are listed as part of a Framework for the Integration of Innovative Qualitative Methods into RCTs of Complex Health Interventions. Innovative qualitative methods described in the interviews include: rapid ethnographic appraisals, document analysis, diary methods, interactive voice responses and SMS, community mapping, spiral walks, pair interviews and visual participatory analysis. Conclusions: The findings of this study point to the usefulness of observational and participatory methods for trials of complex public health interventions, offering a novel contribution to the broader literature about the need for mixed methods approaches. Integrating a diverse toolkit of qualitative methods can enable appropriate adjustments to the intervention and/ or process of data collection during RCTs, which in turn can create more sustainable and effective interventions. However, such integration will require a cultural shift towards the adoption of method-neutral research approaches, transdisciplinary collaborations, and publishing regimes.


PLoS ONE ◽  
2016 ◽  
Vol 11 (7) ◽  
pp. e0158612 ◽  
Author(s):  
Eva van der Meij ◽  
Johannes R. Anema ◽  
René H. J. Otten ◽  
Judith A. F. Huirne ◽  
Frederieke G. Schaafsma

2017 ◽  
Vol 35 (2) ◽  
pp. 100-106 ◽  
Author(s):  
Jingchun Zeng ◽  
Guohua Lin ◽  
Lixia Li ◽  
Liming Lu ◽  
Chuyun Chen ◽  
...  

Objectives To evaluate the completeness of reporting of randomised controlled trials (RCTs) of acupuncture for post-stroke rehabilitation in order to provide information to facilitate transparent and more complete reporting of acupuncture RCTs in this field. Methods Multiple databases were searched from their inception through September 2015. Quality of reporting for included papers was assessed against a subset of criteria adapted from the Consolidated Standards for Reporting Trials (CONSORT) 2010 statement and the Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines. Each item was scored 1 if it was reported, or 0 if it was not clearly stated. Descriptive statistical analysis was performed. Cohen's κ-statistics were calculated to assess agreement between the two reviewers. Results A total of 87 RCTs were included in the full text. Based on CONSORT, good reporting was evident for items “Randomised’ in the title or abstract’, ‘Participants’, ‘Statistical methods’, ‘Recruitment’, ‘Baseline data’, and ‘Outcomes and estimation’, with positive rates >80%. However, the quality of reporting for the items ‘Trial design’, ‘Outcomes’, ‘Sample size’, ‘Allocation concealment’, ‘Implementation’, ‘Blinding’, ‘Flow chart’, ‘Intent-to-treat analysis’, and ‘Ancillary analyses’ was very poor with positive rates <10%. Based on STRICTA, the items ‘Number of needle insertions per subject per session’, ‘Responses sought’, and ‘Needle type’ had poor reporting with positive rates <50%. Substantial agreement was observed for most items and good agreement was observed for some items. Conclusions The reporting quality of RCTs in acupuncture for post-stroke rehabilitation is unsatisfactory and needs improvement.


Sign in / Sign up

Export Citation Format

Share Document