Response Rates for Surveys Completed With Paper-and-Pencil and Computers: Using Meta-Analysis to Assess Equivalence

2018 ◽  
Vol 37 (5) ◽  
pp. 649-668 ◽  
Author(s):  
Arne Weigold ◽  
Ingrid K. Weigold ◽  
Sara N. Natera

The increasing number of self-report surveys being collected using computers has led to a body of literature examining the response rates for computerized surveys compared with the more traditional paper-and-pencil method. However, results from individual studies have been inconsistent, and the meta-analyses available on this topic have included studies from a restricted range of years and did not use proper statistical procedures for examining comparability. Consequently, we conducted a meta-analysis with 96 independent effect sizes spanning over two decades of studies; we also assessed potential moderators. Comparability was determined using confidence interval equivalence testing procedures. The meta-analysis indicated nonequivalence, with those in the paper-and-pencil condition being almost twice as likely to return surveys as those in the computer condition. There was large heterogeneity of variance, and 11 of the 18 potential moderators were significant. Two meta-regressions yielded only two significant unique moderators: population and type of measure. Results highlighted issues within the response rate literature that can be addressed in future studies, as well as provided an example of using equivalence testing in meta-analyses.

2020 ◽  
pp. 108705472090651 ◽  
Author(s):  
Sarah Morris ◽  
Jade Sheen ◽  
Mathew Ling ◽  
Denise Foley ◽  
Emma Sciberras

Objective: Peer social functioning difficulties characteristic of ADHD persist into adolescence, but the efficacy of interventions for this age group remains unclear. Method: A systematic search of nonpharmacological interventions for adolescents with ADHD (10–18 years) identified 11 trials addressing social functioning, of which eight were included in meta-analyses. Results: Random effects meta-analyses of four randomized trials found no differences in social functioning between treatment and control groups by parent- ( g = −0.08 [−0.34, 0.19], k = 4, N = 354) or teacher-report ( g = 0.17 [−0.06, 0.40], k = 3, N = 301). Meta-analyses of nonrandomized studies indicated participants’ social functioning improved from baseline to postintervention by parent-report, but not teacher- or self-report. All trials had a high risk of bias. Conclusion: These results highlight the paucity of research in this age group. There is little evidence that current interventions improve peer social functioning. Clearer conceptualizations of developmentally relevant targets for remediation may yield more efficacious social interventions.


2019 ◽  
Vol 76 (7) ◽  
pp. 502-509 ◽  
Author(s):  
Pieter Coenen ◽  
Henk F van der Molen ◽  
Alex Burdorf ◽  
Maaike A Huysmans ◽  
Leon Straker ◽  
...  

ObjectivesIt has often been suggested that screen work (ie, work on desktop, laptop, notebook or tablet computers) is a risk factor for neck and upper extremity symptoms. However, an up-to-date overview and quantification of evidence are lacking. We aimed to systematically review the association of exposure to screen work with neck and upper extremity symptoms from prospective studies.MethodsAn electronic database search (PubMed, Embase, Cinahl and Scopus) for prospective studies on the association of exposure to screen work and musculoskeletal symptoms was conducted. Studies were synthesised regarding extracted data and risk of bias, and meta-analyses were conducted.ResultsAfter screening 3423 unique references, 19 articles from 12 studies (with 18 538 participants) were included for the current review, with the most recent exposure assessment reported in 2005. Studies described duration and input frequency of screen work (ie, computer, keyboard and mouse use, assessed using self-reports or software recordings) and musculoskeletal symptoms (ie, self-reported neck/shoulder and distal upper extremity symptoms and diagnosed carpal tunnel syndrome [CTS]). Although there was overall an increased occurrence of musculoskeletal symptoms with larger exposure to screen work (relative risk: 1.11 [1.03 1.19]), findings were rather inconsistent with weaker (and statistically non-significant) risks when screen work was assessed by software recording (1.05 [0.91 1.21]) compared to with self-report (1.14 [1.03 1.19]).ConclusionsWe found an increased risk of musculoskeletal symptoms with screen work. However, the evidence is heterogeneous, and it is striking that it lacks information from contemporary screen work using laptop, notebook or tablet computers.


2018 ◽  
Vol 48 (15) ◽  
pp. 2477-2491 ◽  
Author(s):  
Jess Kerr-Gaffney ◽  
Amy Harrison ◽  
Kate Tchanturia

AbstractSocial anxiety disorder is one of the most common comorbid conditions in eating disorders (EDs). The aim of the current review and meta-analysis is to provide a qualitative summary of what is known about social anxiety (SA) in EDs, as well as to compare levels of SA in those with EDs and healthy controls. Electronic databases were systematically searched for studies using self-report measures of SA in ED populations. In total, 38 studies were identified, 12 of which were included in the meta-analyses. For both anorexia nervosa (AN) and bulimia nervosa, there were significant differences between ED groups and HCs, with medium to large effect sizes. Findings from the qualitative review indicate that levels of SA are similar across the ED diagnoses, and SA improves with treatment in AN. In addition, high levels of SA are associated with more severe ED psychopathology, but not body mass index. These findings add to the wider literature on socio-emotional functioning in EDs, and may have implications for treatment strategies.


2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S477-S477
Author(s):  
Phoebe E Bailey ◽  
Tarren Leon

Abstract This systematic review and meta-analysis quantifies the magnitude and breadth of age-related differences in trust. Thirty-eight independent data sets met criteria for inclusion. Overall, there was a moderate effect of age group on trust (g = 0.22), whereby older adults were more trusting than young adults. Three additional meta-analyses assessed age-related differences in trust in response to varying degrees of trustworthiness. This revealed that older adults were more trusting than young adults in response to neutral (g = 0.31) and negative (g = 0.33), but not positive (g = 0.15), indicators of trustworthiness. The effect of age group on trust in response to positive and neutral cues was moderated by type of trust (financial vs. non-financial) and type of responding (self-report vs. behavioral). Older adults were more trusting than young adults in response to positive and neutral indicators of trustworthiness when trust was expressed non-financially, but not financially. There was also an age-related increase in self-reported, but not behavioral, trust in response to neutral cues. Older adults were more trusting than young adults in response to negative indicators of trustworthiness regardless of the type of trust or type of responding. The reliability of information about trustworthiness (superficial vs. genuine cues) did not moderate any effects of age on trust. Implications of these findings and directions for future research are discussed.


BMJ Open ◽  
2019 ◽  
Vol 9 (8) ◽  
pp. e026037 ◽  
Author(s):  
Gillian Sandra Gould ◽  
Laura Twyman ◽  
Leah Stevenson ◽  
Gabrielle R Gribbin ◽  
Billie Bonevski ◽  
...  

BackgroundPregnancy is an opportunity for health providers to support women to stop smoking.ObjectivesIdentify the pooled prevalence for health providers in providing components of smoking cessation care to women who smoke during pregnancy.DesignA systematic review synthesising original articles that reported on (1) prevalence of health providers’ performing the 5As (‘Ask’, ‘Advise’, ‘Assess’, ‘Assist’, ‘Arrange’), prescribing nicotine replacement therapy (NRT) and (2) factors associated with smoking cessation care.Data sourcesMEDLINE, EMBASE, CINAHL and PsycINFO databases searched using ‘smoking’, ‘pregnancy’ and ‘health provider practices’.Eligibility criteria for selecting studiesStudies included any design except interventions (self-report, audit, observed consultations and women’s reports), in English, with no date restriction, up to June 2017.ParticipantsHealth providers of any profession.Data extraction, appraisal and analysisData were extracted, then appraised with the Hawker tool. Meta-analyses pooled percentages for performing each of the 5As and prescribing NRT, using, for example, ‘often/always’ and ‘always/all’. Meta-regressions were performed of 5As for ‘often/always’.ResultsOf 3933 papers, 54 were included (n=29 225 participants): 33 for meta-analysis. Health providers included general practitioners, obstetricians, midwives and others from 10 countries. Pooled percentages of studies reporting practices ‘often/always’ were: ‘Ask’ (n=9) 91.6% (95% CI 88.2% to 95%); ‘Advise’ (n=7) 90% (95% CI 72.5% to 99.3%), ‘Assess’ (n=3) 79.2% (95% CI 76.5% to 81.8%), ‘Assist (cessation support)’ (n=5) 59.1% (95% CI 56% to 62.2%), ‘Arrange (referral)’ (n=6) 33.3% (95% CI 20.4% to 46.2%) and ‘prescribing NRT’ (n=6) 25.4% (95% CI 12.8% to 38%). Heterogeneity (I2) was 95.9%–99.1%. Meta-regressions for ‘Arrange’ were significant for year (p=0.013) and country (p=0.037).ConclusionsHealth providers ‘Ask’, ‘Advise’ and ‘Assess’ most pregnant women about smoking. ‘Assist’, ‘Arrange’ and ‘prescribing NRT’ are reported at lower rates: strategies to improve these should be considered.PROSPERO registration numberCRD42015029989.


2014 ◽  
Vol 205 (4) ◽  
pp. 260-267 ◽  
Author(s):  
Marco Hirnstein ◽  
Kenneth Hugdahl

BackgroundThe notion that schizophrenia is characterised by increased non-right-handedness is a cornerstone of the theory that schizophrenia arises from, and is genetically linked to, abnormal brain lateralisation. Reviews and meta-analyses have reported higher rates of non-right-handers in patients with schizophrenia. However, this was suggested to be the result of a gender artefact or a hidden bias in self-report handedness questionnaires.AimsTo investigate using a meta-analytical approach whether the excess of non-right-handedness is seen in both females and males, and also when handedness is assessed behaviourally.MethodElectronic databases were searched for studies that reported (a) the rate of female and male non-right-handers in schizophrenia compared with controls and (b) the rate of non-right-handers in schizophrenia (regardless of gender) based on behavioural handedness assessment.ResultsThe odds ratios (ORs) for females (OR = 1.63; based on 621 patients, 3747 controls) and males (OR = 1.50; based on 1213 patients, 3800 controls) differed significantly from 1.0, indicating both female and male patients were more often non-right-handed than controls. Moreover, there was an excess of non-right-handedness in patients with schizophrenia when handedness was assessed behaviourally: OR = 1.84 (1255 patients, 6260 controls). Even when both gender and behavioural handedness assessment were controlled for simultaneously, the excess of non-right-handedness persisted.ConclusionsThe findings clearly demonstrate that the excess of non-right-handedness in schizophrenia does not result from a gender artefact or from biased handedness questionnaires. It is a true empirical effect and may indeed reflect a genetic link between schizophrenia and brain lateralisation.


Author(s):  
Jaap W Mandema ◽  
Raj S Pradhan ◽  
Kamlesh M Thakker ◽  
Darryl J Sleep ◽  
Robert J Padley ◽  
...  

Objective: The primary objective of the analysis was to characterize the multivariate relationship between changes in LDL-C, HDL-C and triglycerides (TG) and risk for major coronary events after treatment with statins, fibrates or niacin. Methods: Randomized controlled trials that compared statin, fibrate or niacin treatment with placebo, usual care, or active control and that reported on major coronary events were identified by a literature search, prior meta-analyses and review articles. The dependency of the odds-ratio between active and control arm on the differences in on-treatment LDL-C, HDL-C and TG was determined using a meta-regression analysis. Differences in the risk reduction per unit change in lipid values between drug classes (fibrates, statins and niacin) and drugs within a class were evaluated. Differences in risk reduction per unit change in lipid values for certain patient groups such as diabetes, males, elderly, prior CHD were also evaluated. Results: A total of 70 trials were identified and included in the meta-analysis. The meta-analysis found a significant contribution of lowering TG on top of reducing LDL-C to the risk reduction for a major coronary event after treatment with statins, fibrates or niacin (p<0.001). The risk reduction for major coronary events was estimated to be 18.5% [14.1 to 22.7%] for every 1 mmol/L (38.7 mg/dL) reduction in LDL-C and 27.5% [15.7 to 37.7%] for every 1 mmol/L (88.6 mg/dL) reduction in TG. The reduction in TG was found to explain most (84%) of the risk reduction for treatment with fibrates. For statins, the reduction in LDL-C was found to explain most (71%) of their benefit, but the reduction in TG was found to provide a statistically and clinically significant contribution to their overall risk reduction. The risk reduction per unit change in LDL-C and TG was not dependent on age, gender, diabetes and prior CHD and was not different between fibrates and statins. Conclusions: A significant additional risk reduction is expected by providing a reduction in TG on top of LDL-C changes. The independent effect of TG and LDL-C lowering supports the role for treatment combinations such as statins and fibrates that impact LDL-C and TG differentially.


Rheumatology ◽  
2021 ◽  
Author(s):  
Majd Bairkdar ◽  
Marios Rossides ◽  
Helga Westerlind ◽  
Roger Hesselstrand ◽  
Elizabeth V Arkema ◽  
...  

Abstract Objectives We aimed to conduct a systematic review and meta-analysis on the incidence and prevalence of SSc covering the entire literature. Methods This study followed the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement of 2009. We conducted a systematic search in MEDLINE, Web of Science and Embase to identify articles reporting incidence and/or prevalence of SSc. Two authors conducted the search, reviewed articles for inclusion and extracted relevant data. We used random-effects models to estimate the pooled prevalence and incidence of SSc and performed subgroup analyses by sex, case definition and region to investigate heterogeneity. We explored the association between calendar period and reported estimates using meta-regression. Results Among 6983 unique records identified, we included 61 studies of prevalence and 39 studies of incidence in the systematic review. The overall pooled prevalence of SSc was 17.6 (95% CI 15.1, 20.5) per 100 000 and the overall pooled incidence rate of SSc was 1.4 (95% CI 1.1, 1.9) per 100 000 person-years. We observed significant regional variations in reported estimates; studies conducted in North America reported considerably higher estimates than other regions. The pooled incidence and prevalence in women were five times higher than in men. More recent studies reported higher estimates than older ones. Conclusion In this comprehensive review of the incidence and prevalence of SSc across the world, there was large heterogeneity among estimates, which should be taken into consideration when interpreting the results.


2021 ◽  
Author(s):  
Sanjay Rao ◽  
Tarek Benzouak ◽  
Sasha Gunpat ◽  
Rachel Burns ◽  
Tayyeb A. Tahir ◽  
...  

BackgroundThe prevalence and prognosis of post-acute stage SARS-CoV-2 infection fatigue symptoms remain largely unknown.AimsWe performed a systematic review to evaluate the prevalence of fatigue in post-recovery from SARS-CoV-2 infection.MethodMedline, Embase, PsycINFO, CINAHL, Web of Science, Scopus, trial registries, Cochrane Central Register of Controlled Trials and Google Scholar were searched for studies on fatigue in samples that recovered from PCR diagnosed COVID-19. Meta-analyses were conducted separately for each recruitment setting.ResultsWe identified 39 studies with 8825 patients that recovered from COVID-19. Post-COVID-19 patients self-report of fatigue was higher compared to healthy controls (RR = 3.688, 95%CI [2.502, 5.436], p &lt; 0.001). Over 50% of patients discharged from inpatient care reported symptoms of fatigue during the first (ER = 0.517, 95%CI [0.278, 0.749]) and second month following recovery (ER = 0.527, 95%CI [0.337, 0.709]). 10% of the community patients reported fatigue in the first month post-recovery. Patient setting moderated the association between COVID-19 recovery and fatigue symptoms (R2 = 0.12, p &lt; 0.001). Female gender was associated with greater self-report of fatigue (OR =1.782, 95%CI [1.531, 2.870]). Patients recruited through social media had fatigue above 90% across multiple time points. Fatigue was highest in studies from Europe.ConclusionFatigue is a symptom associated with functional challenges which could have economic and social impacts. Developing long-term planning for fatigue management amongst patients beyond acute stages of SARS-CoV-2 infection is essential to optimizing patient care and public health outcomes.


2003 ◽  
Vol 92 (3_suppl) ◽  
pp. 1176-1186
Author(s):  
Justy Reed ◽  
Robert Serfass

Meta-analysis has been criticized for combining studies with different independent and dependent variables—the alleged “apples and oranges” problem, This study provides evidence for the inclusion of similarly valenced subscales from self-report mood scales in meta-analysis. Undergraduates ( N = 214) were randomly assigned to a “positive” or “negative” group to complete a checklist containing words from 12 different scales. Cluster analyses indicated that mood subscales formed a two-cluster positive and negative solution. All participants were assigned to the correct cluster. Discriminant analyses correctly classified more than 95% of participants for each mood scale. Results indicate that subscales from commonly used mood inventories can be combined in meta-analyses having positive or negative affect as the dependent variable.


Sign in / Sign up

Export Citation Format

Share Document