The design of an evaluation framework for diabetes self-management education and support programs delivered nationally

Background The aim of this work was to develop a National Evaluation Framework to facilitate the standardization of delivery, quality, reporting, and evaluation of diabetes education and support programs delivered throughout Australia through the National Diabetes Services Scheme (NDSS). The NDSS is funded by the Australian Government, and provides access to diabetes information, education, support, and subsidized product across diverse settings in each state and territory of Australia through seven independent service-providers. This article reports the approach undertaken to develop the Framework. Methods A participatory approach was undertaken, focused on adopting nationally consistent outcomes and indicators, nominating objectives and measurement tools, specifying evaluation processes, and developing quality standards. Existing programs were classified based on related, overarching indicators enabling the adoption of a tiered system of evaluation. Results Two outcomes (i.e., improved clinical, reduced cost) and four indicators (i.e., improved knowledge and understanding, self-management, self-determination, psychosocial adjustment) were adopted from the Eigenmann and Colagiuri national consensus position statement for diabetes education. This allowed for the identification of objectives (i.e., improved empowerment, reduced distress, autonomy supportive program delivery, consumer satisfaction) and related measurement instruments. Programs were categorized as comprehensive, topic-specific, or basic education, with comprehensive programs allocated to receive the highest-level of evaluation. Eight quality standards were developed, with existing programs tested against those standards. Based on the results of testing, two comprehensive (OzDAFNE for people with type 1 diabetes, DESMOND for people with type 2 diabetes), and eight topic-specific (CarbSmart, ShopSmart, MonitorSmart, FootSmart, MedSmart, Living with Insulin, Insulin Pump Workshop, Ready Set Go – Let’s Move) structured diabetes self-management education and support programs were nominated for national delivery. Conclusions The National Evaluation Framework has facilitated consistency of program quality, delivery, and evaluation of programs delivered by multiple service providers across diverse contexts. The Framework could be applied by other service providers who facilitate multiple diabetes education and support programs and could be adapted for use in other chronic disease populations where education and support are indicated.

A Methodological Quality Evaluation of Meta-Analyses on Nursing Home Research: Overview and Suggestions for Future Directions

(1) Background: The nursing home (NH) research field lacks quality reporting about meta-analyses (MAs), and most gradings of MA evidence are biased on analyzing the effectiveness of independent variables in randomized control trials. (2) Objectives: This study aimed to perform a critical methodological review of MAs in the NH research field. (3) Methods: We searched the articles from four databases (PubMed, MEDLINE, CINAHL, and PsycINFO) until 15th January 2021. We reviewed a total of 41 published review articles in the NH research field. (4) Results: The studies primarily fell into the following categories: medicine (17/41), nursing (7/41), and psychiatry or psychology (6/41); 36.6% of the reviewed studies did not use any validated MA guidelines. The lowest correctly reported PRISMA 2000 guideline item was protocol and registration (14.6%), and more than 50% of articles did not report risk of bias. Moreover, 78.0% of studies did not describe missing reports of effect size formula. (5) Discussion: NH researchers must follow appropriate and updated guidelines for their MAs in order to provide validated reviews, as well as consider statistical issues such as the complexity of interventions, proper grouping, and scientific effect-size calculations to improve the quality of their study. Future quality review studies should investigate more diverse studies.

Quality Reporting of Mixed Methods Research in Tourism-Related Studies

The aim of this study is to gain scientific insight into internationally-accepted criteria for quality reporting of mixed methods research (MMR). Articles published post-2012 in a particular journal, which referred to “mixed methods” and “tourism”, and reported that qualitative and quantitative data were collected, were drawn from Google Scholar and Scopus. The reporting quality of these studies was analysed according to the GRAMMS framework (Good Reporting of a Mixed Methods Study). Most of the articles in the data set did not report on all the elements embedded in GRAMMS. It must not be seen as a reflection of the quality of the MMR design itself, nor is the study flawed. It indicates gaps in the reporting of important MMR elements that could be addressed in future research. Exemplars were identified that could serve as case studies for researchers in terms of the quality of reporting on MMR. Editorial boards should adopt guidelines on how MMR could be presented in articles submitted to their journals. These guidelines could assist authors in preparing their articles to conform to international standards on the reporting of MMR studies. Peer reviewers should use the guidelines to judge the quality of reporting on MMR methodology in articles under review. This study could also serve as a future reference for researchers, postgraduate students and supervisors who aim to incorporate MMR in their research.

Bankruptcy Prediction with a Doubly Stochastic Poisson Forward Intensity Model and Low-Quality Data

With the record high leverage across all segments of the (global) economy, default prediction has never been more important. The excess cash illusion created in the context of COVID-19 may disappear just as quickly as the pandemic entered our world in 2020. In this paper, instead of using any scoring device to discriminate between healthy companies and potential defaulters, we model default probability using a doubly stochastic Poisson process. Our paper is unique in that it uses a large dataset of non-public companies with low-quality reporting standards and very patchy data. We believe this is the first attempt to apply the Duffie–Duan formulation to emerging markets at such a scale. Our results are comparable, if not more robust, than those obtained for public companies in developed countries. The out-of-sample accuracy ratios range from 85% to 76%, one and three years prior to default, respectively. What we lose in (data) quality, we regain in (data) quantity; the power of our tests benefits from the size of the sample: 15,122 non-financial companies from 2007 to 2017, unique in this research area. Our results are also robust to model specification (with different macro and company-specific covariates used) and statistically significant at the 1% level.

Factors Associated With Unplanned Acute Care Services for Patients With Newly Diagnosed Hematologic Malignancies

PURPOSE This study evaluated risk factors predicting unplanned 30-day acute service utilization among adults subsequent to hospitalization for a new diagnosis of leukemia, lymphoma, or myeloma. This study explored the prevalence of medical complications (aligned with OP-35 measure specifications from the Centers for Medicare & Medicaid Services [CMS] Hospital Outpatient Quality Reporting Program) and the potential impact of psychosocial factors on unplanned acute care utilization. METHODS This study included 933 unique patients admitted to three acute care inpatient facilities within a nonprofit community-based health care system in southern California from 2012 to 2017. Integrated comprehensive data elements from electronic medical records and facility oncology registries were leveraged for univariate statistics, predictive models constructed using multivariable logistic regression, and further exploratory data mining, with predictive accuracy of the models measured with c-statistics. RESULTS The mean age of study participants was 65 years, and 55.1% were male. Specific diagnoses were lymphoma (48.7%), leukemia (35.2%), myeloma (14.0%), and mixed types (2.1%). Approximately one fifth of patients received unplanned acute care services within 30 days postdischarge, and over half of these patients presented with one or more symptoms associated with the CMS medical complication measure. The predictive models, with c-statistics ranging from 0.7 and above for each type of hematologic malignancy, indicated good predictive qualities with the impact of psychosocial functioning on the use of acute care services ( P values < .05), including lack of consult for social work during initial admission (lymphoma or myeloma), history of counseling or use of psychotropic medications (lymphoma), and past substance use (myeloma). CONCLUSION This study provides insights into patient-related factors that may inform a proactive approach to improve health outcomes, such as enhanced care transition, monitoring, and support interventions.

The Validity, Reliability, and Feasibility of Measurement Tools Used to Assess Sleep of Pre-school Aged Children: A Systematic Rapid Review

Background: Sleep of pre-school aged children is important for their health and development, but there are currently no standards for measuring sleep in this age group. We aimed to examine the validity, reliability and feasibility of tools used to assess sleep of pre-school aged children.Methods: Studies were eligible for inclusion if they examined the validity and/or reliability and/or feasibility of a measurement tool used to examine sleep of pre-school aged children (aged 3–7 years). We systematically searched six electronic databases, grey literature and trial registries. We manually searched topic specific journals, reference and citations of included studies, and reference lists of existing reviews. We extracted data and conducted a risk of bias assessment on the included studies using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) risk of bias checklist. We used a narrative synthesis to present the results.Results: Sixteen studies met the inclusion criteria: these explored accelerometers (n = 3) and parental reported tools (n = 13; nine questionnaires, six diaries). Studies assessed construct validity (n = 3), criterion validity (n = 1), convergent validity (n = 13), test-retest reliability (n = 2), internal consistency (n = 4) and feasibility (n = 12). Most studies assessed the convergent validity of questionnaires and diaries compared with accelerometers, but the validity of accelerometers for sleep in this age group is unknown. Of studies with a low risk of bias, one sleep diary was shown to be valid for measuring sleep duration. No measurement tools were appropriate for determining sleep quality. Reporting of reliability and feasibility was minimal.Discussion: The evidence base in this field is limited, and most studies had high risk of bias. Future research on sleep in pre-school aged children should focus on assessing the validity, reliability and feasibility of accelerometers, which in turn will improve the quality of studies that assess questionnaires and diaries against accelerometers.Systematic Review Registration:https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021230900; PROSPERO: CRD42021230900.

A COMPREHENSIVE GUIDE TO MEGA-PRESS FOR GABA MEASUREMENT

Background: The aim of this guideline is to provide a series of evidence-based recommendations that allow those new to the field of MEGA-PRESS to produce high-quality data for the measurement of GABA levels using edited magnetic resonance spectroscopy with the MEGA-PRESS sequence at 3T. GABA is the main inhibitory neurotransmitter of the central nervous system and has been increasingly studied due to its relevance in many clinical disorders of the central nervous system. MEGA-PRESS is the most widely used method for quantification of GABA at 3T, but is technically challenging and operates at a low signal-to-noise ratio. Therefore, the acquisition of high-quality MRS data relies on avoiding numerous pitfalls and observing important caveats. Methods: The guideline was developed by a working party that consisted of experts in MRS and experts in guideline development and implementation, together with key stakeholders. Strictly following a translational framework, we first identified evidence using a systematically conducted scoping literature review, then synthesised and graded the quality of evidence that formed recommendations. These recommendations were then sent to a panel of 21 world leaders in MRS for feedback and approval using a modified-Delphi process across two rounds. Results: The final guideline consists of 23 recommendations across six domains essential for GABA MRS acquisition (Parameters, Practicalities, Data acquisition, Confounders, Quality/reporting, Post-processing). Overall, 78% of recommendations were formed from high-quality evidence, and 91% received agreement from over 80% of the expert panel. Conclusion: These 23 expert-reviewed recommendations and accompanying extended documentation form a readily usable guideline to allow those new to the field of MEGA-PRESS to design appropriate MEGA-PRESS study protocols and generate high-quality data.

Trends in Clinical Trial Registration in Dentistry: An Analysis of Registered Clinical Trials in the Clinical Research Information Service from 2013 to 2021 in South Korea

The Clinical Research Information Service (CRIS) in South Korea provides a clinical trial registry platform in which all clinical trials should be mandatorily and prospectively registered. However, to date, the registration status of clinical trials in the field of dentistry has not been investigated. Therefore, this study aimed to provide an overview of the methodological design and trends of the registered clinical trials over a period of nine years. Information about registered clinical trials in the field of dentistry from the CRIS was comprehensively collected from 2013 to 2021. The details assessed from the collected trials include: type of sponsors, recruitment status, study design, randomization, allocation concealment, single or multi-centric, retrospective or prospective registration, and publication status. A total of 65 registered clinical trials were identified. The number of clinical trials in dentistry in South Korea was found to be less; however, an increasing trend was observed in the recent three years. A majority of the trials were interventional (81.5%), single-centered (86.2%), and conducted on patients (81.5%) and in private hospitals (55.4%). A considerable number of trials had an unclear phase, were retrospectively registered, and rarely published. Regarding the quality, most trials have inadequately reported the method of randomization and allocation concealment. The number of clinical trials in dentistry is still low in South Korea, and most of them were registered retrospectively. A poor-quality reporting of methods at several specific areas was observed. It is necessary for dental investigators to raise awareness of the need to register clinical trials.

Scientific Evidence of Xuebijing Injection in the Treatment of Sepsis

Objectives. To systematically collate, appraise, and synthesize the current evidence on the Xuebijing injection (XBJI) for sepsis. Methods. Eight databases were searched for systematic reviews (SRs) or meta-analyses (MAs) on XBJI for sepsis. Assessing the Methodological Quality of Systematic Reviews-2 (AMSTAR-2), Preferred Reporting Item for Systematic Reviews and Meta-Analyses (PRISMA), and Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methods were used to assess the methodological quality, reporting quality, and evidence quality of the enrolled studies, respectively. Results. Out of the 13 studies that were included, all studies were rated critically low quality based on AMSTAR-2 results. Based on the results obtained from PRISMA, all studies were reported to be over 80%, while the GRADE system yielded three outcome measures rated high-quality, 16 were of moderate quality, and the rest were of low or critically low quality. Conclusions. The combination of XBJI and Western medicine (WM) showed significant synergy for the treatment of sepsis compared to WM alone. However, this conclusion should be treated with caution since the quality of the SRs/MAs providing the evidence was relatively low.