scholarly journals Multiverse to inform neurological research: an example using recovery outcome of neglect

Author(s):  
Margaret J. Moore ◽  
Nele Demeyere

Abstract Objective Multiverse analysis provides an ideal tool for understanding how inherent, yet ultimately arbitrary methodological choices impact the conclusions of individual studies. With this investigation, we aimed to demonstrate the utility of multiverse analysis for evaluating generalisability and identifying potential sources of bias within studies employing neurological populations. Methods Multiverse analysis was used to evaluate the robustness of the relationship between post-stroke visuospatial neglect and poor long-term recovery outcome within a sample of 1113 (age = 72.5, 45.1% female) stroke survivors. A total of 25,600 t-test comparisons were run across 400 different patient groups defined using various combinations of valid inclusion criteria based on lesion location, stroke type, assessment time, neglect impairment definition, and scoring criteria across 16 standardised outcome measures. Results Overall, 33.9% of conducted comparisons yielded significant results. 99.9% of these significant results fell below the null specification curve, indicating a highly robust relationship between neglect and poor recovery outcome. However, the strength of this effect was not constant across all comparison groups. Comparisons which included < 100 participants, pre-selected patients based on lesion type, or failed to account for allocentric neglect impairment were found to yield average effect sizes which differed substantially. Similarly, average effect sizes differed across various outcome measures with the strongest average effect in comparisons involving an activities of daily living measure and the weakest in comparisons employing a depression subscale. Conclusions This investigation demonstrates the utility of multiverse analysis techniques for evaluating effect robustness and identifying potential sources of bias within neurological research.

2021 ◽  
Author(s):  
Margaret J Moore ◽  
Nele Demeyere

AbstractObjectiveMultiverse analysis provides an ideal tool for understanding how inherent, yet ultimately arbitrary methodological choices impact the conclusions of individual studies. With this investigation we aimed to demonstrate the utility of multiverse analysis for evaluating generalisability and identifying potential sources of bias within studies employing neurological populations.MethodMultiverse analysis was used to evaluate the robustness of the relationship between post-stroke visuospatial neglect and poor long term recovery outcome within a sample of 1113 (age =72.5, 45.1% female) stroke survivors. A total of 25,600 t-test comparisons were run across 400 different patient groups defined using various combinations of valid inclusion criteria based on lesion location, stroke type, assessment time, neglect impairment definition, and scoring criteria across 16 standardised outcome measures.ResultsOverall, 33.9% of conducted comparisons yielded significant results. 99.9% of these significant results fell below the null specification curve, indicating a highly robust relationship between neglect and poor recovery outcome. However, the strength of this effect was not constant across all comparison groups. Comparisons which included <100 participants, pre-selected patients based on lesion type, or failed to account for allocentric neglect impairment were found to yield average effect sizes which differed substantially. Similarly, average effect sizes differed across various outcome measures with the strongest average effect in comparisons involving an activities of daily living measure and the weakest in comparisons employing a depression subscale.ConclusionsThis investigation demonstrates the utility of multiverse analysis techniques for evaluating effect robustness and identifying potential sources of bias within neurological research.


Hand Therapy ◽  
2021 ◽  
pp. 175899832110333
Author(s):  
Zhiqing Chen

Introduction Triangular fibrocartilage complex (TFCC) injuries are associated with distal radioulnar joint (DRUJ) instability and impaired wrist proprioception. Sensorimotor training of extensor carpi ulnaris (ECU) and pronator quadratus (PQ) can enhance DRUJ stability. With limited evidence on effectiveness of TFCC sensorimotor rehabilitation, this study aimed to evaluate the effects and feasibility of a novel wrist sensorimotor rehabilitation program (WSRP) for TFCC injuries. Methods Patients diagnosed with TFCC injuries were recruited from May 2018 to January 2020 at an outpatient hand clinic in Singapore General Hospital. There are four stages in WSRP: (1) pain control, (2) muscle re-education and joint awareness, (3) neuromuscular rehabilitation, and (4) movement normalization and function. WSRP also incorporated dart throwing motion and proprioceptive neuromuscular facilitation. Outcome measures included grip strength measured with grip dynamometer, numerical pain rating scale, joint position sense (JPS) measurement, weight bearing measured with the ‘push-off’ test, and wrist function reported on the Patient Rated Wrist Hand Evaluation. Results Ten patients completed the WSRP. Mean changes were compared with minimal clinically important differences (MCID) for outcomes. All patients achieved MCID on pain, 70% of patients achieved MCID on grip strength, weight bearing and wrist function. Paired t-tests and Cohen’s D for outcome measures were calculated. There were large effect sizes of 2.47, 1.35, and 2.81 for function, grip strength and pain respectively, and moderate effect sizes of 0.72 and 0.39 for axial loading and JPS respectively. Discussion WSRP presents a potential treatment approach in TFCC rehabilitation. There is a need for future prospective clinical trials with control groups.


2019 ◽  
Vol 48 (2) ◽  
pp. 185-202
Author(s):  
Miguel Robichaud ◽  
France Talbot ◽  
Nickolai Titov ◽  
Blake F. Dear ◽  
Heather D. Hadjistavropoulos ◽  
...  

AbstractBackground:Despite its established efficacy, access to internet-delivered CBT (iCBT) remains limited in a number of countries. Translating existing programs and using a minimally monitored model of delivery may facilitate its dissemination across countries.Aims:This randomized control trial aims to evaluate the efficacy of an iCBT transdiagnostic program translated from English to French and offered in Canada using a minimally monitored delivery model for the treatment of anxiety and depression.Method:Sixty-three French speakers recruited in Canada were randomized to iCBT or a waiting-list. A French translation of an established program, the Wellbeing Course, was offered over 8 weeks using a minimally monitored delivery model. Primary outcome measures were the Generalized Anxiety Disorder-7 (GAD-7) and the Patient Health Questionnaire-9 (PHQ-9), which were obtained pre-treatment, post-treatment and at 3-month follow-up.Results:Mixed-effects models revealed that participants in the treatment group had significantly lower PHQ-9 and GAD-7 scores post-treatment than controls with small between-groups effect sizes (d = 0.34 and 0.37, respectively). Within-group effect sizes on primary outcome measures were larger in the treatment than control group. Clinical recovery rates on the PHQ-9 and GAD-7 were significantly higher among the treatment group (40 and 56%, respectively) than the controls (13 and 16%, respectively).Conclusions:The provision of a translated iCBT program using a minimally monitored delivery model may improve patients’ access to treatment of anxiety and depression across countries. This may be an optimal first step in improving access to iCBT before sufficient resources can be secured to implement a wider range of iCBT services.


2018 ◽  
Vol 49 (5) ◽  
pp. 831-850 ◽  
Author(s):  
Paul H. P. Hanel ◽  
Uwe Wolfradt ◽  
Gabriel Lins de Holanda Coelho ◽  
Lukas J. Wolf ◽  
Roosevelt Vilar ◽  
...  

People often make inferences about the values of other people in their families, cities, and countries, but there are reasons to expect systematic biases in these inferences. Across four studies ( N = 1,763), we examined people’s perceptions of the values of their families, fellow citizens of the cities in which they live, and compatriots across three nations (Brazil, Germany, the United Kingdom). Our results show that people systematically misperceive comparison groups’ values. People underestimate the importance that their compatriots ascribe to more important values and overestimate the importance of less important values. This occurs in comparison with their own values, the actual values of the people living in the same city and the actual values of their compatriots. The effect sizes were medium to large. Furthermore, the results occurred independently of participants’ culture, time spent in the culture, and the underlying value model used. These results consistently show that people’s speculations about values in their community and society are biased in a self- and family favoring direction. In addition, we found that the structure of values (e.g., as proposed by Schwartz) holds for perceived family, fellow citizens of the cities in which they live, and compatriots’ values. Overall, our findings suggest that the values of other people are more selfless than is often believed.


2009 ◽  
Vol 44 (6) ◽  
pp. 663-665 ◽  
Author(s):  
Tamara C. Valovich McLeod

Abstract Reference/Citation: Broglio SP, Puetz TW. The effect of sport concussion on neurocognitive function, self-report symptoms, and postural control: a meta-analysis. Sports Med. 2008;38(1):53–67. Clinical Question: How effective are various concussion assessment techniques in detecting the effects of concussion on cognition, balance, and symptoms in athletes? Data Sources: Studies published between January 1970 and June 2006 were identified from the PubMed and PsycINFO databases. Search terms included concussion, mild traumatic brain injury, sport, athlete, football, soccer, hockey, boxing, cognition, cognitive impairment, symptoms, balance, and postural control. The authors also handsearched the reference list of retrieved articles and sought the opinions of experts in the field for additional studies. Study Selection: Studies were included if they were published in English; described a sample of athletes concussed during athletic participation; reported outcome measures of neurocognitive function, postural stability, or self-report symptoms; compared the postconcussion assessments with preseason (healthy) baseline scores or a control group; completed at least 1 postinjury assessment within the first 14 days after the concussion (to reflect neurometabolic recovery); and provided enough information for the authors to calculate effect sizes (means and SDs at baseline and postinjury time points). Selected studies were grouped according to their outcome measure (neurocognitive function, symptoms, or postural control) at initial and follow-up (if applicable) time points. Excluded articles included review articles, abstracts, case studies, editorials, articles without baseline data, and articles with data extending beyond the 14-day postinjury time frame. Data Extraction: From each study, the following information was extracted by one author and checked by the second author: participant demographics (sport, injury severity, incidence of loss of consciousness, and postconcussion assessment times), sample sizes, and baseline and postconcussion means and SDs for all groups. All effect sizes (the Hedge g) were computed so that decreases in neurocognitive function and postural control or increases in symptom reports resulted in negative effect sizes, demonstrating deficits in these domains after concussion. The authors also extracted the following moderators: study design (with or without control group), type of neurocognitive technique (Standardized Assessment of Concussion, computerized test, or pencil-and-paper test), postconcussion assessment time, and number of postconcussion assessments. Main Results: The search identified 3364 possible abstracts, which were then screened by the authors, with 89 articles being further reviewed for relevancy. Fifty articles were excluded because of insufficient data to calculate effect sizes, lack of a baseline assessment or control group, or because the data had been published in more than one study. The remaining 39 studies met all of the inclusion criteria and were used in the meta-analysis; 34 reported neurocognitive outcome measures, 14 provided self-report symptom outcomes, and 6 presented postural control as the dependent variable. The analyzed studies included 4145 total participants (concussed and control) with a mean age of 19.0 ± 0.4 years. The quality of each included study was also evaluated by each of the 2 authors independently using a previously published 15-item scale; the results demonstrated excellent agreement between the raters (intraclass correlation coefficient  =  0.91, 95% confidence interval [CI]  =  0.83, 0.95). The quality appraisal addressed randomization, sample selection, outcome measures, and statistical analysis, among other methodologic considerations. Quality scores of the included studies ranged from 5.25 to 9.00 (scored from 0–15). The initial assessment demonstrated a deficit in neurocognitive function (Z  =  7.73, P &lt; .001, g  =  −0.81 [95% CI  =  −1.01, −0.60]), increase in self-report symptoms (Z  =  2.13, P  =  .03, g  =  −3.31 [95% CI  =  −6.35, −0.27]), and a nonsignificant decrease in postural control (Z  =  1.29, P  =  .19, g  =  −2.56 [95% CI  =  −6.44, 1.32]). For the follow-up assessment analyses, a decrease in cognitive function (Z  =  2.59, P  =  .001, g  =  −26 [95% CI  =  −0.46, −0.06]), an increase in self-report symptoms (Z  =  2.17, P  =  .03, g  =  −1.09 [95% CI  =  −2.07, −0.11]), and a nonsignificant decrease in postural control (Z  =  1.59, P  =  0.11, g  =  −1.16 [95% CI  =  −2.59, 0.27]) were found. Neurocognitive and symptom outcomes variables were reported in 10 studies, and the authors were able to compare changes from baseline in these measures during the initial assessment time point. A difference in effect sizes was noted (QB(1)  =  5.28, P  =  .02), with the increases in self-report symptoms being greater than the associated deficits in neurocognitive function. Conclusions: Sport-related concussion had a large negative effect on cognitive function during the initial assessment and a small negative effect during the first 14 days postinjury. The largest neurocognitive effects were found with the Standardized Assessment of Concussion during the immediate assessment and with pencil-and-paper neurocognitive tests at the follow-up assessment. Large negative effects were noted at both assessment points for postural control measures. Self-report symptoms demonstrated the greatest changes of all outcomes variables, with large negative effects noted both immediately after concussion and during the follow-up assessment. These findings reiterate the recommendations made to include neurocognitive measures, postural control tests, and symptom reports into a multifaceted concussion battery to best assess these injuries.


1983 ◽  
Vol 5 (1) ◽  
pp. 25-57 ◽  
Author(s):  
Deborah L. Feltz ◽  
Daniel M. Landers

A longstanding research question in the sport psychology literature has been whether a given amount of mental practice prior to performing a motor skill will enhance one's subsequent performance. The research literature, however, has not provided any clear-cut answers to this question and this has prompted the present, more comprehensive review of existing research using the meta-analytic strategy proposed by Glass (1977). From the 60 studies yielding 146 effect sizes the overall average effect size was .48, which suggests, as did Richardson (1967a), that mentally practicing a motor skill influences performance somewhat better than no practice at all. Effect sizes were also compared on a number of variables thought to moderate the effects of mental practice. Results from these comparisons indicated that studies employing cognitive tasks had larger average effect sizes than motor or strength tasks and that published studies had larger average effect sizes than unpublished studies. These findings are discussed in relation to several existing explanations for mental practice and four theoretical propositions are advanced.


2020 ◽  
Vol 13 (2) ◽  
pp. 428-447 ◽  
Author(s):  
Rebecca Wolf ◽  
Jennifer Morrison ◽  
Amanda Inns ◽  
Robert Slavin ◽  
Kelsey Risman
Keyword(s):  

2015 ◽  
Vol 24 (2) ◽  
pp. 237-255 ◽  
Author(s):  
Patricia L. Cleave ◽  
Stephanie D. Becker ◽  
Maura K. Curran ◽  
Amanda J. Owen Van Horne ◽  
Marc E. Fey

Purpose This systematic review and meta-analysis critically evaluated the research evidence on the effectiveness of conversational recasts in grammatical development for children with language impairments. Method Two different but complementary reviews were conducted and then integrated. Systematic searches of the literature resulted in 35 articles for the systematic review. Studies that employed a wide variety of study designs were involved, but all examined interventions where recasts were the key component. The meta-analysis only included studies that allowed the calculation of effect sizes, but it did include package interventions in which recasts were a major part. Fourteen studies were included, 7 of which were also in the systematic review. Studies were grouped according to research phase and were rated for quality. Results Study quality and thus strength of evidence varied substantially. Nevertheless, across all phases, the vast majority of studies provided support for the use of recasts. Meta-analyses found average effect sizes of .96 for proximal measures and .76 for distal measures, reflecting a positive benefit of about 0.75 to 1.00 standard deviation. Conclusion The available evidence is limited, but it is supportive of the use of recasts in grammatical intervention. Critical features of recasts in grammatical interventions are discussed.


AERA Open ◽  
2018 ◽  
Vol 4 (2) ◽  
pp. 233285841876629 ◽  
Author(s):  
W. Steven Barnett ◽  
Kwanghee Jung ◽  
Allison Friedman-Krauss ◽  
Ellen C. Frede ◽  
Milagros Nores ◽  
...  

State-funded prekindergarten (preK) programs are increasingly common across the country. This study estimated the effects of eight state-funded preK programs (Arkansas, California, Michigan, New Jersey, New Mexico, Oklahoma, South Carolina, and West Virginia) on children’s learning using a regression discontinuity design. These programs vary with respect to the population served, program design, and context. Weighted average effect sizes from instrumental variables analyses across these states are 0.24 for language (vocabulary), 0.44 for math, and 1.10 for emergent literacy. Differences in effect sizes by domain suggest that preK programs should attend more to enhancing learning beyond simple literacy skills. State preK programs appear to differ in their effects. We offer recommendations for more rigorous, regular evaluation.


Sign in / Sign up

Export Citation Format

Share Document