Nature of Our Literature

Scientists rely upon an accurate scientific literature in order to build and test new theories about the natural world. In the past decade, observational studies of the scientific literature have indicated that numerous questionable research practices and poor reporting practices may be hindering scientific progress. In particular, 3 recent studies have indicated an implausibly high rate of studies with positive (i.e., hypothesis confirming) results. In sports medicine, a field closely related to kinesiology, studies that tested a hypothesis indicated support for their primary hypothesis ~70% of the time. However, a study of journals that cover the entire field of kinesiology has yet to be completed, and the quality of other reporting practices, such as clinical trial registration, has not been evaluated. In this study we retrospectively evaluated 300 original research articles from the flagship journals of North America (Medicine and Science in Sports and Exercise), Europe (European Journal of Sport Science), and Australia (Journal of Science and Medicine in Sport). The hypothesis testing rate (~64%) and positive result rate (~81%) were much lower than what has been reported in other fields (e.g., psychology), and there was only weak evidence for our hypothesis that the positive result rate exceeded 80%. However, the positive result rate is still considered unreasonably high. Additionally, most studies did not report trial registration, and rarely included accessible data indicating rather poor reporting practices. The majority of studies relied upon significance testing (~92%), but it was more concerning that a majority of studies (~82%) without a stated hypothesis still relied upon significance testing. Overall, the positive result rate in kinesiology is unacceptably high, despite being lower than other fields such as psychology, and most published manuscripts demonstrated subpar reporting practices

Data Management for Systematic Reviews: Guidance is Needed

Data management practices for systematic reviews and other types of knowledge syntheses are variable, with some reviews following open science practices and others with poor reporting practices leading to lack of transparency or reproducibility. Reporting standards have improved the level of detail being shared in published reviews, and also encourage more open sharing of data from various stages of the review process. Similar to project planning or completion of an ethics application, systematic review teams should create a data management plan alongside creation of their study protocol. This commentary provides a brief description of a Data Management Plan Template created specifically for systematic reviews. It also describes the companion LibGuide which was created to provide more detailed examples, and to serve as a living document for updates and new guidance. The creation of the template was funded by the Portage Network.

349Help after IPV experience, how much help do victims seek? Evidence from NDHS 2018

Background Poor reporting and help seeking has contributed to the burden of IPV. However, identified barriers to IPV help-seeking include social, economic and cultural factors. This study assessed the pattern and factors associated with help-seeking by women who experienced IPV in Nigeria. Methods Complex sample analysis of 2,033 women of reproductive age who had ever experienced IPV from the 2018 Nigeria Demographic and Health Survey (NDHS), was done to determine social, economic and cultural factors that predict IPV help-seeking among these women. Results Mean age of the women was 31.5 ± 7.8 years, a third (33.3%) had sought any form of help, 36.6% had full healthcare and 33.4% had full financial autonomy respectively. Help from partner’s family and women’s family were the most prevalent source of help sought (11.5% & 23.1% respectively). Women ≥ 40 years were 37% less likely to seek help compared to young persons (OR = 0.63; 95% CI = 0.42-0.92). Women with childhood experience of violence had higher odds (42%) of seeking help for IPV than those with no childhood experience (OR = 1.42; 95 % CI = 1.08-1.85). Conclusions Majority of women experiencing IPV do not seek any form of help. Age and childhood experience of violence are significant predictors for help-seeking by victims of IPV. Key messages IPV remains a hidden issue as majority of victims are not seeking help. Efforts to make appropriate help for IPV victims should be intensified and commenced from childhood.

Remotely Delivered Monitoring and Management of Diabetes-Related Foot Disease: An Overview of Systematic Reviews

Background: Diabetes-related foot disease (DFD) management requires input from multiple healthcare professionals, and has worse outcomes for people living in remote localities by comparison to urban areas. Remotely delivered healthcare may reduce this disparity. This overview summarizes current evidence on the effectiveness, stakeholder perceptions, and cost-effectiveness of remotely delivered healthcare for DFD. Methods: A search of 5 databases was conducted to identify systematic reviews published between January 2000 and June 2020. Eligible reviews were those evaluating remotely delivered monitoring or management of patients at risk of or with active DFD, or clinicians managing these patients. Risk of bias was assessed using the AMSTAR-2 tool. Results: Eight reviews were eligible for inclusion, including 88 primary studies and 8509 participants, of which 36 studies involving 4357 participants evaluated remotely delivered monitoring or management of DFD. Only one review had a low risk of bias, with most reviews demonstrating limited search strategies and poor reporting of participants. Evidence on effectiveness was mixed, with meta-analyses demonstrating long-term ulcer healing and mortality were not significantly different between telehealth and standard care groups, although the lower-limb amputation rate was significantly decreased in one meta-analysis. Perceptions of telehealth by patients and clinicians were generally positive, whilst acknowledging limitations relating to access and use. Cost-effectiveness data were limited, with poor reporting preventing clear conclusions. Conclusions: Remotely delivered healthcare of DFD is well received by patients and clinicians, but its effectiveness is unclear. High quality trials are needed to evaluate the risks and benefits of remotely delivered DFD management.

Effects of cosmetic and other camouflage interventions on appearance-related and psychological outcomes among adults with visible differences in appearance: a systematic review

ObjectiveVisible differences in appearance are associated with poor social and psychological outcomes. Effectiveness of non-surgical cosmetic and other camouflage interventions is poorly understood. The objective was to evaluate effects of cosmetic and other camouflage interventions on appearance-related outcomes, general psychological outcomes and adverse effects for adults with visible appearance differences.DesignSystematic review.Data sourcesMEDLINE (Ovid), EMBASE (Ovid), PsycINFO (Ovid) CINAHL and Cochrane Central databases searched from inception to 24 October 2020. Two reviewers independently reviewed titles and abstracts and full texts.Eligibility criteriaRandomised controlled trials in any language on non-surgical cosmetic or other camouflage interventions that reported appearance-related outcomes, general psychological outcomes or adverse effects for adults with visible appearance differences.Data extraction and synthesisTwo reviewers independently extracted data, assessed intervention reporting using the Template for Intervention Description and Replication checklist, and assessed risk of bias using the Cochrane risk of bias tool. Outcomes included appearance-related outcomes, general psychological outcomes (eg, depression, anxiety) and adverse effects.ResultsOne head-to-head trial and five trials with waiting list or routine care comparators were included. All had unclear or high risk of bias in at least five of seven domains. Effect sizes could not be determined for most outcomes due to poor reporting. Between-group statistically significant differences were not reported for any appearance-related outcomes and for only 5 of 25 (20%) other psychological outcomes. Given heterogeneity of populations and interventions, poor reporting and high risk of bias, quantitative synthesis was not possible.ConclusionsConclusions about effectiveness of non-surgical cosmetic or other camouflage interventions could not be drawn. Well-designed and conducted trials are needed. Without such evidence, clinicians or other qualified individuals should engage with patients interested in cosmetic interventions in shared decision making, outlining potential benefits and harms, and the lack of evidence to inform decisions.PROSPERO registration numberCRD42018103421.

Insufficient transparency of statistical reporting in preclinical research: a scoping review

Non-transparent statistical reporting contributes to the reproducibility crisis in life sciences, despite guidelines and educational articles regularly published. Envisioning more effective measures for ensuring transparency requires the detailed monitoring of incomplete reporting in the literature. In this study, a systematic approach was used to sample 16 periodicals from the ISI Journal Citation Report database and to collect 233 preclinical articles (including both in vitro and animal research) from online journal content published in 2019. Statistical items related to the use of location tests were quantified. Results revealed that a large proportion of articles insufficiently describe tests (median 44.8%, IQR [33.3–62.5%], k = 16 journals), software (31%, IQR [22.3–39.6%]) or sample sizes (44.2%, IQR [35.7–55.4%]). The results further point at contradictory information as a component of poor reporting (18.3%, IQR [6.79–26.7%]). No detectable correlation was found between journal impact factor and the quality of statistical reporting of any studied item. The under-representation of open-source software (4.50% of articles) suggests that the provision of code should remain restricted to articles that use such packages. Since mounting evidence indicates that transparency is key for reproducible science, this work highlights the need for a more rigorous enforcement of existing guidelines.