Essential Ingredients and Innovations in the Design and Analysis of Group-Randomized Trials

2020 ◽  
Vol 41 (1) ◽  
pp. 1-19 ◽  
Author(s):  
David M. Murray ◽  
Monica Taljaard ◽  
Elizabeth L. Turner ◽  
Stephanie M. George

This article reviews the essential ingredients and innovations in the design and analysis of group-randomized trials. The methods literature for these trials has grown steadily since they were introduced to the biomedical research community in the late 1970s, and we summarize those developments. We review, in addition to the group-randomized trial, methods for two closely related designs, the individually randomized group treatment trial and the stepped-wedge group-randomized trial. After describing the essential ingredients for these designs, we review the most important developments in the evolution of their methods using a new bibliometric tool developed at the National Institutes of Health. We then discuss the questions to be considered when selecting from among these designs or selecting the traditional randomized controlled trial. We close with a review of current methods for the analysis of data from these designs, a case study to illustrate each design, and a brief summary.


2022 ◽  
pp. 174077452110634
Author(s):  
David M Murray

Background. This article identifies the most influential methods reports for group-randomized trials and related designs published through 2020. Many interventions are delivered to participants in real or virtual groups or in groups defined by a shared interventionist so that there is an expectation for positive correlation among observations taken on participants in the same group. These interventions are typically evaluated using a group- or cluster-randomized trial, an individually randomized group treatment trial, or a stepped wedge group- or cluster-randomized trial. These trials face methodological issues beyond those encountered in the more familiar individually randomized controlled trial. Methods. PubMed was searched to identify candidate methods reports; that search was supplemented by reports known to the author. Candidate reports were reviewed by the author to include only those focused on the designs of interest. Citation counts and the relative citation ratio, a new bibliometric tool developed at the National Institutes of Health, were used to identify influential reports. The relative citation ratio measures influence at the article level by comparing the citation rate of the reference article to the citation rates of the articles cited by other articles that also cite the reference article. Results. In total, 1043 reports were identified that were published through 2020. However, 55 were deemed to be the most influential based on their relative citation ratio or their citation count using criteria specific to each of the three designs, with 32 group-randomized trial reports, 7 individually randomized group treatment trial reports, and 16 stepped wedge group-randomized trial reports. Many of the influential reports were early publications that drew attention to the issues that distinguish these designs from the more familiar individually randomized controlled trial. Others were textbooks that covered a wide range of issues for these designs. Others were “first reports” on analytic methods appropriate for a specific type of data (e.g. binary data, ordinal data), for features commonly encountered in these studies (e.g. unequal cluster size, attrition), or for important variations in study design (e.g. repeated measures, cohort versus cross-section). Many presented methods for sample size calculations. Others described how these designs could be applied to a new area (e.g. dissemination and implementation research). Among the reports with the highest relative citation ratios were the CONSORT statements for each design. Conclusions. Collectively, the influential reports address topics of great interest to investigators who might consider using one of these designs and need guidance on selecting the most appropriate design for their research question and on the best methods for design, analysis, and sample size.



2016 ◽  
Vol 27 (9) ◽  
pp. 2569-2580 ◽  
Author(s):  
Yang Shi ◽  
Ji-Hyun Lee

Group randomized trial design is common in cancer prevention and health promotion research with intervention development. Several methods have been developed to handle the design and analytical issues for group randomized trial including the intraclass correlation coefficient. The widely used methods for the sample size calculation for the group randomized trial assume equal sizes across groups. In practice this assumption often fails and group randomized trial studies suffer from considerably lower statistical power than as planned. A few studies have developed sample size calculation methods for unequal group sizes, but most of them are limited to continuous outcomes. In this study, we develop a method for sample size calculation for group randomized trial studies with unequal group sizes based on Monte Carlo simulation in the mixed effect model framework. This approach incorporates the variation of group sizes and can be applied to group randomized trials with different types of outcomes. Further, it is easy to implement and can be applied to most commonly used group randomized trial designs such as pre-and-post cross-sectional and cohort study designs. We demonstrate the application of the proposed approach to two-arm group randomized trial studies with continuous and binary outcomes through simulations and analysis of a real group randomized trial dataset.





2021 ◽  
Vol 10 (10) ◽  
pp. 2215
Author(s):  
Karina Limburg ◽  
Katharina Radziej ◽  
Heribert Sattel ◽  
Peter Henningsen ◽  
Marianne Dieterich ◽  
...  

We tested the efficacy of an integrative psychotherapeutic group treatment (IPGT) in reducing vertigo/dizziness-related impairment along with depression, anxiety, and somatization by conducting a randomized controlled superiority trial comparing IPGT to self-help groups moderated by a clinical psychologist (SHG). Adult patients with functional vertigo and dizziness symptoms were randomly allocated to either the IPGT or SHG as active control group. Outcomes were assessed at baseline (t0), after treatment lasting 16 weeks (t1), and 12 months after treatment (t2). A total of 81 patients were assigned to IPGT and 78 patients were assigned to SHG. Vertigo-related impairment was reduced in both conditions (IPGT: t0–t1: d = 1.10, t0–t2: d = 1.06; SHG: t0–t1: d = 0.86, t0–t2: d = 1.29), showing the efficiency of both IPGT and SHG. Clinically relevant improvements were also obtained for depression in both groups. Linear mixed model analyses revealed no differences between groups for all outcomes (effect of group for the primary outcome: b = −1.15, SE = 2.13, t = −0.54, p = 0.59). Attrition rates were higher in SHG (52.6%) than in IPGT (28.4%). Both conditions improved primary and secondary outcomes while IPGT was better accepted by patients than SHG. Trial registration: ClinicalTrials.gov, Identifier: NCT02320851.



Trials ◽  
2021 ◽  
Vol 22 (1) ◽  
Author(s):  
J. Dubreucq ◽  
M. Faraldo ◽  
M. Abbes ◽  
B. Ycart ◽  
H. Richard-Lepouriel ◽  
...  

Abstract Background Self-stigma is highly prevalent in serious mental illness (SMI) and is associated with poorer clinical and functional outcomes. Narrative enhancement and cognitive therapy (NECT) is a group-based intervention combining psychoeducation, cognitive restructuring and story-telling exercises to reduce self-stigma and its impact on recovery-related outcomes. Despite evidence of its effectiveness on self-stigma in schizophrenia-related disorders, it is unclear whether NECT can impact social functioning. Methods This is a 12-centre stepped-wedge cluster randomized controlled trial of NECT effectiveness on social functioning in SMI, compared to treatment as usual. One hundred and twenty participants diagnosed with schizophrenia, bipolar disorder or borderline personality disorder will be recruited across the 12 sites. The 12 centres participating to the study will be randomized into two groups: one group (group 1) receiving the intervention at the beginning of the study (T0) and one group (group 2) being a control group for the first 6 months and receiving the intervention after (T1). Outcomes will be compared in both groups at T0 and T1, and 6-month and 12-month outcomes for groups 1 and 2 will be measured without a control group at T2 (to evaluate the stability of the effects over time). Evaluations will be conducted by assessors blind to treatment allocation. The primary outcome is personal and social performance compared across randomization groups. Secondary outcomes include self-stigma, self-esteem, wellbeing, quality of life, illness severity, depressive symptoms and personal recovery. Discussion NECT is a promising intervention for reducing self-stigma and improving recovery-related outcomes in SMI. If shown to be effective in this trial, it is likely that NECT will be implemented in psychiatric rehabilitation services with subsequent implications for routine clinical practice. Trial registration ClinicalTrials.gov NCT03972735. Trial registration date 31 May 2019.



2016 ◽  
Vol 41 (4) ◽  
pp. 357-388 ◽  
Author(s):  
Elizabeth A. Stuart ◽  
Anna Rhodes

Background: Given increasing concerns about the relevance of research to policy and practice, there is growing interest in assessing and enhancing the external validity of randomized trials: determining how useful a given randomized trial is for informing a policy question for a specific target population. Objectives: This article highlights recent advances in assessing and enhancing external validity, with a focus on the data needed to make ex post statistical adjustments to enhance the applicability of experimental findings to populations potentially different from their study sample. Research design: We use a case study to illustrate how to generalize treatment effect estimates from a randomized trial sample to a target population, in particular comparing the sample of children in a randomized trial of a supplemental program for Head Start centers (the Research-Based, Developmentally Informed study) to the national population of children eligible for Head Start, as represented in the Head Start Impact Study. Results: For this case study, common data elements between the trial sample and population were limited, making reliable generalization from the trial sample to the population challenging. Conclusions: To answer important questions about external validity, more publicly available data are needed. In addition, future studies should make an effort to collect measures similar to those in other data sets. Measure comparability between population data sets and randomized trials that use samples of convenience will greatly enhance the range of research and policy relevant questions that can be answered.



Sign in / Sign up

Export Citation Format

Share Document