scholarly journals Measuring the Effectiveness of In-School CVE Intervention Programs: Scope and Evaluation Methods

Proceedings ◽  
2021 ◽  
Vol 77 (1) ◽  
pp. 14
Author(s):  
Max Su ◽  
Nigel Harriman ◽  
Neil Shortland ◽  
Tyler Cote ◽  
Elena Savoia
Keyword(s):  
Emergency Preparedness ◽  
Research Evaluation ◽  
Controlled Trial ◽  
Evaluation Framework ◽  
Intervention Programs ◽  
Theory Of Change ◽  
Final Segment ◽  
Quasi Experimental ◽  
Programmatic Evaluation ◽  
Study Sites

This presentation outlines the results of the primary programmatic evaluation efforts the Emergency Preparedness Research Evaluation and Practice (EPREP) Program has conducted since 2016. The presentation begins with an overview of the methodology of selecting outcome measures to evaluate program efficacy, as well as a description of the evaluation framework. Results of the longitudinal and quasi-experimental 2017 evaluation of the Online4Good Academy—on of the training events at the focus of the Boston CVE Pilot Program—are presented and discussed. In 2018, the EPREP Program utilized a longitudinal and quasi-experimental design to evaluate the efficacy of the Peer2Peer antihatred campaign Kombat with Kindness. Results and implications from this study are discussed. The final portion of the presentation describes the more recent activities of the EPREP Program—an evaluation of the online safety program Operation 250 (OP250). This portion of the lecture describes the psychological framework and theory of change under which OP250 implements their initiative. During the final segment we also present the preliminary results of a randomized controlled trial conducted at two different study sites in Massachusetts designed to evaluate the programs’ efficacy.

Auricular Vagus Nerve Acupressure for Patients with Emotional Distress under the COVID-19 Pandemic: A Smartphone-based, Randomized，Controlled Trial (Preprint)

2020 ◽  
Author(s):  
Peijing Rong ◽  
Lei Wang ◽  
Lingling Yu ◽  
Junying Wang ◽  
Yan Ma ◽  
...  
Keyword(s):  
Randomized Controlled Trial ◽  
Vagus Nerve ◽  
Emotional Distress ◽  
Response Rate ◽  
Controlled Trial ◽  
Depression Scale ◽  
Randomized Controlled ◽  
Falling Asleep ◽  
Global Spread ◽  
Study Sites

BACKGROUND The global spread of the 2019 coronavirus diseases (COVID-19) has caused emotional distress. However, whether auricular vagus nerve acupressure (AVNA) is effective in improving emotional distress under the COVID-19 has not been well-documented. OBJECTIVE To confirm whether AVNA is effective in improving emotional distress under the COVID-19 pandemic. METHODS A smartphone-based online, randomized, controlled trial was designed in four study sites, including Wuhan, Beijing, Shenyang, and Guangzhou of China, from 26 February 2020 to 28 April 2020. Participants were randomly assigned to three times of AVNA (n = 191) or usual care (UC, n = 215) for 14 days. The primary outcome was the response rate, which was the proportion of participants whose Hospital Anxiety and Depression Scale (HADS) score reduced from baseline by ≥ 50%. The assessment was conducted at baseline, 3 days, and 14 days. RESULTS The AVNA group had a markedly higher response rate than the UC group at 3 days (35.6% vs. 24.9%, P = 0.02) and at 14 days (70.7% vs. 60.6%, P = 0.02). The AVNA group showed significantly greater reduction in score of HADS at the two measurement points and BAI at 3 days (P ≤ 0.03), with average respective effect size of 0.217 and 0.195. Participants with AVNA spent less time falling asleep and rated their sleep quality being remarkably higher than those with UC at endpoint. CONCLUSIONS AVNA can be recommended for patients with emotional distress under the current COVID-19 pandemic and other emergent events. CLINICALTRIAL www.chictr.org.cn Identifier: ChiCTR2000030078.

Comparison of Two Rehabilitation Protocols on Patient- and Disease-Oriented Outcomes in Individuals With Chronic Ankle Instability

2017 ◽  
Vol 22 (3) ◽  
pp. 57-65 ◽  
Author(s):  
Kyle Kosik ◽  
Masafumi Treada ◽  
Ryan McCann ◽  
Samantha Boland ◽  
Phillip A. Gribble
Keyword(s):  
Ankle Instability ◽  
Dynamic Balance ◽  
Controlled Trial ◽  
Intervention Programs ◽  
Foot And Ankle ◽  
Balance Test ◽  
Randomized Controlled ◽  
Rehabilitation Protocols ◽  
Main Effect ◽  
Ability Measure

Proximal neuromuscular alterations are hypothesized to contribute to the patient- and disease-oriented deficits observed in CAI individuals. The objective was to compare the efficacy of two 4-week intervention programs with or without proximal joint exercises. Twenty-three individuals with CAI completed this single-blinded randomized controlled trial. Outcome measures included the Star Excursion Balance Test (SEBT) and the Foot and Ankle Ability Measure (FAAM). A time main effect was observed for the FAAM-ADL (p = .013), FAAM-Sport (p = .012), and posteromedial (p = .04) and posterolateral (p = .003) SEBT reach directions. No group main effect or time by group interaction was found. Four weeks of supervised rehabilitation improved self-reported function and dynamic balance in people with CAI.

scholarly journals Effectiveness of the TEI Program for Bullying and Cyberbullying Reduction and School Climate Improvement

2019 ◽  
Vol 16 (4) ◽  
pp. 580 ◽  
Author(s):  
Rosario Ferrer-Cascales ◽  
Natalia Albaladejo-Blázquez ◽  
Miriam Sánchez-SanSegundo ◽  
Irene Portilla-Tamarit ◽  
Oriol Lordan ◽  
...  
Keyword(s):  
School Climate ◽  
Peer Victimization ◽  
Intervention Programs ◽  
Control Group ◽  
Intervention Implementation ◽  
Limited Efficacy ◽  
Group 12 ◽  
Quasi Experimental ◽  
Bullying Behavior ◽  
Experimental Group

The increase in the prevalence of bullying and cyberbullying in recent years worldwide is undeniable. Although several intervention programs oriented towards the reduction of bullying and cyberbullying have been developed and implemented, significant disparities have been found regarding their efficacy. In most of the cases, the lack of the implementation of interventions involving all of the school community could be on the basis of this limited efficacy. The present study aimed to evaluate the effectiveness of the TEI Program, an intervention based on peer tutoring, in the reduction of bullying and cyberbullying, and in the improvement of school climate. The design of the study was quasi-experimental, in which 2057 Spanish students (aged 11 to 16 years) participated from 22 schools, and were randomly assigned to the experimental group (10 schools, 987 students) or the control group (12 schools, 1070 students). The obtained results showed a significant reduction in bullying behavior, peer victimization, fighting, cyberbullying and cybervictimization in the experimental group after the intervention implementation. Similarly, a significant improvement in factors of school climate was found only in this group. The obtained results demonstrated that the TEI program is effective in reducing bully and cyberbully behavior, and at the same time, improving the school climate.

scholarly journals The Influence of Quantitative Intervention Dosage on Oral Language Outcomes for Children With Developmental Language Disorder: A Systematic Review and Narrative Synthesis

2021 ◽  
pp. 1-17
Author(s):  
Pauline Frizelle ◽  
Anna-Kaisa Tolonen ◽  
Josie Tulip ◽  
Carol-Anne Murphy ◽  
David Saldana ◽  
...  
Keyword(s):  
Oral Language ◽  
Language Disorder ◽  
Controlled Trial ◽  
Experimental Manipulation ◽  
Quantitative Aspect ◽  
Developmental Language Disorder ◽  
Dose Frequency ◽  
Language Interventions ◽  
Quasi Experimental ◽  
Language Measures

Purpose The aim of this study was to examine the degree to which quantitative aspects of dosage (dose, dose frequency, and total intervention duration) have been examined in intervention studies for children with developmental language disorder (DLD). Additionally, to establish the optimal quantitative dosage characteristics for phonology, vocabulary, and morphosyntax outcomes. Method This registered review (PROSPERO ID CRD42017076663) adhered to PRISMA guidelines. Search terms were included in seven electronic databases. We included peer-reviewed quasi-experimental, randomized controlled trial or cohort analytical studies, published in any language between January 2006 and May 2020. Included articles reported on participants with DLD ( M = 3–18 years); oral language interventions with phonology, vocabulary, or morphosyntax outcomes; and experimental manipulation or statistical analysis of any quantitative aspect of dosage. Studies were appraised using the Cochrane risk-of-bias tool. Results Two hundred forty-four articles reported on oral language interventions with children with DLD in the domains of interest; 13 focused on experimentally/statistically manipulating quantitative aspects of dosage. No article reported phonological outcomes, three reported vocabulary, and eight reported morphosyntax. Dose frequency was the most common characteristic manipulated. Conclusions Research is in its infancy, and significant further research is required to inform speech-language pathologists in practice. Dosage characteristics are rarely adequately controlled for their individual effects to be identified. Findings to date suggest that there is a point in vocabulary and morphosyntax interventions after which there are diminishing returns from additional dosage. If dose is high (number of learning opportunities within a session), then the literature suggests that session frequency can be reduced. Frequent, short sessions (2/3 × per week, approximately 2 min) and less frequent, long sessions (1 × per week, approximately 20 min) have yielded the best outcomes when composite language measures have been used; however, replication and further research are required before clinicians can confidently integrate these findings into clinical practice. Supplemental Material https://doi.org/10.23641/asha.13570934

scholarly journals Optimising implementation strategies of the first scaleup of a primary care psychological intervention for common mental disorders in Sub-Saharan Africa: a mixed methods study protocol for the optimised Friendship Bench (OptFB)

BMJ Open ◽  
2021 ◽  
Vol 11 (9) ◽  
pp. e045481
Author(s):  
Ruth Verhey ◽  
Charmaine Chitiyo ◽  
Sandra Ngonidzashe Mboweni ◽  
Ephraim Chiriseri ◽  
Dixon Chibanda ◽  
...  
Keyword(s):  
Randomised Controlled Trial ◽  
Mental Disorders ◽  
Common Mental Disorders ◽  
Psychological Intervention ◽  
Controlled Trial ◽  
Implementation Strategies ◽  
Evaluation Framework ◽  
Sub Saharan Africa ◽  
Clinical Trial Registry ◽  
Randomised Controlled

IntroductionCommon mental disorders (CMDs) are a leading cause of disability globally. CMDs are highly prevalent in Zimbabwe and have been addressed by an evidence-based, task-shifting psychological intervention called the Friendship Bench (FB). The task-shifted FB programme guides clients through problem-solving therapy. It was scaled up across 36 implementation sites in Zimbabwe in 2016.Methods and analysisThis study will employ a mixed-method framework. It aims to: (1) use quantitative survey methodologies organised around the Reach, Effectiveness, Adoption and Implementation and Maintenance evaluation framework to assess the current scaleup of the FB intervention and classify 36 clinics according to levels of performance; (2) use qualitative focus group discussions and semistructured interviews organised around the Consolidated Framework for Implementation Research to analyse determinants of implementation success, as well as elucidate heterogeneity in implementation strategies through comparing high-performing and low-performing clinics; and (3) use the results from aims 1 and 2 to develop strategies to optimise the Friendship Bench intervention and apply this model in a cluster randomised controlled trial to evaluate potential improvements among low-performing clinics. The trial will be registered with the Pan African Clinical Trial Registry (www.pactr.org). The planned randomised controlled trial for the third research aim will be registered after completing aims one and two because the intervention is dependent on knowledge generated during these phases.Ethics and disseminationThe research protocol received full authorisation from the Medical Research Council of Zimbabwe (MRCZ A/242). It is anticipated that changes in data collection tools and consent forms will take place at all three phases of the study and approval from MRCZ will be sought. All interview partners will be asked for informed consent. The research team will prioritise open-access publications to disseminate research results.

scholarly journals Look Upstream: Measurement for Innovation on the Upper Rio Negro of the Amazon Basin

2021 ◽  
Vol 8 ◽  
Author(s):  
Kurt Shaw ◽  
Rita de Cácia Oenning da Silva
Keyword(s):  
Amazon Basin ◽  
Controlled Trial ◽  
Theory Of Change ◽  
Positive Development ◽  
Private Goods ◽  
Rio Negro ◽  
The Government ◽  
Traditional Songs ◽  
The Impact

The growth of the randomized controlled trial (RCT) as the “gold standard” for evaluation has justly been praised as an advance in the professionalization of social programs and projects, an “adoption of science” - in the words of the Lancet. None the less, the emphasis on the RCT biases funding for projects that distribute private goods and which focus on “low hanging fruit” in health, nutrition, and sanitation, simply because those areas lend themselves to the sort of measurement that works with RCTs. As a result, many project developers in the government and NGO sectors lament that a hegemonic focus on RCTs impedes creativity or new models that challenge traditional paradigms. This case study of CanalCanoa, a community video coaching project for indigenous parents of young children in the Rio Negro region of the Amazon Basin, offers techniques to measure for innovation. Instead of developing a new RCT for an extremely diverse population (27 ethnic groups) where traditional childcare methods are in historical flux because of urbanization, CanalCanoa measured variables shown by previous RCTs to be causally connected with positive development results. By researching the impact of the intervention on nutrition, language (multilingualism, use of traditional songs and stories), and social network expansion, CanalCanoa measured upstream indicators, thus mixing scientific rigor with an opportunity for innovation and providing important insight and reform of a theory of change.

scholarly journals Deprescribing intervention activities mapped to guiding principles for use in general practice: a scoping review

BMJ Open ◽  
2021 ◽  
Vol 11 (9) ◽  
pp. e052547
Author(s):  
Amy Coe ◽  
Catherine Kaylor-Hughes ◽  
Susan Fletcher ◽  
Elizabeth Murray ◽  
Jane Gunn
Keyword(s):  
General Practice ◽  
Family Practice ◽  
Data Extraction ◽  
Controlled Trial ◽  
Future Research ◽  
Original Research ◽  
Practice Staff ◽  
Quasi Experimental ◽  
Guiding Principles ◽  
Randomised Controlled

ObjectiveTo identify and characterise activities for deprescribing used in general practice and to map the identified activities to pioneering principles of deprescribing.SettingPrimary care.Data sourcesMedline, EMBASE (Ovid), CINAHL, Australian New Zealand Clinical Trials Registry (ANZCTR), Clinicaltrials.gov, ISRCTN registry, OpenGrey, Annals of Family Medicine, BMC Family Practice, Family Practice and British Journal of General Practice (BJGP) from inception to the end of June 2021.Study selectionIncluded studies were original research (randomised controlled trial, quasi-experimental, cohort study, qualitative and case studies), protocol papers and protocol registrations.Data extractionScreening and data extraction was completed by one reviewer; 10% of the studies were independently reviewed by a second reviewer. Coding of full-text articles in NVivo was conducted and mapped to five deprescribing principles.ResultsFifty studies were included. The most frequently used activities were identification of appropriate patients for deprescribing (76%), patient education (50%), general practitioners (GP) education (48%), and development and use of a tapering schedule (38%). Six activities did not align with the five deprescribing principles. As such, two principles (engage practice staff in education and appropriate identification of patients, and provide feedback to staff about deprescribing occurrences within the practice) were added.ConclusionActivities and guiding principles for deprescribing should be paired together to provide an accessible and comprehensive guide to deprescribing by GPs. The addition of two principles suggests that practice staff and practice management teams may play an instrumental role in sustaining deprescribing processes within clinical practice. Future research is required to determine the most of effective activities to use within each principle and by whom.

scholarly journals A Time For Renewal

2017 ◽  
Vol 5 (2) ◽  
pp. ii-iv
Author(s):  
Mark A Gregory
Keyword(s):  
Renewal Process ◽  
Research Evaluation ◽  
Digital Economy ◽  
Australian Journal ◽  
Evaluation Framework ◽  
Second Phase

The Telecommunications Association has commenced the second phase of the renewal process that started in 2013. As part of the first phase of this renewal process a key decision was to relaunch the Telecommunications Journal of Australia as the Australian Journal of Telecommunications and the Digital Economy. In addition to the Journal, the Telecommunications Association holds the Henry Sutton and Charles Todd Orations each year in Melb0urne and Sydney respectively. As the second phase progresses, the Telecommunications Association will launch a new brand, update the Association’s website and host the first of what should become an annual two-day telecommunications forum. The first event is to be held in Melbourne in November. For the Journal, key milestones have now been achieved, including being added to the SCOPUS list of indexed Journals and the Australian Research Council’s Excellence in Research for Australia, which is the national research evaluation framework.

Evaluating and improving the contributions of university research to social innovation

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Brian M. Belcher ◽  
Rachel Claus ◽  
Rachel Davel ◽  
Stephanie M. Jones
Keyword(s):  
Evaluation Method ◽  
Social Innovation ◽  
Research Evaluation ◽  
Outcome Evaluation ◽  
Theory And Practice ◽  
Theory Of Change ◽  
Research Projects ◽  
Content Type ◽  
Design And Implementation ◽  
Training And Support

Purpose The purpose of this study is to assess the contributions of graduate research to social innovation and change for learning and improved transdisciplinary practice. Universities, as centers of teaching and research, face high demand from society to address urgent social and environmental challenges. Faculty and students are keen to use their research to contribute to social innovation and sustainable development. As part of the effort to increase societal impact, research approaches are evolving to be more problem-oriented, engaged and transdisciplinary. Therefore, new approaches to research evaluation are also needed to learn whether and how research contributes to social innovation, and those lessons need to be applied by universities to train and support students to do impactful research and foster an impact culture. Design/methodology/approach This paper uses a theory-based evaluation method to assess the contributions of three completed doctoral research projects. Each study documents the project’s theory of change (ToC) and uses qualitative data (document review, surveys and interviews) to test the ToC. This paper uses a transdisciplinary research (TDR) quality assessment framework (QAF) to analyze each projects’ design and implementation. This paper then draws lessons from the individual case studies and a comparative analysis of the three cases on, namely, effective research design and implementation for social transformation; and training and support for impactful research. Findings Each project aimed to influence government policy, organizational practice, other research and/or the students’ own professional development. All contributed to many of their intended outcomes, but with varying levels of accomplishment. Projects that were more transdisciplinary had more pronounced outcomes. Process contributions (e.g. capacity-building, relationship-building and empowerment) were as or more important than knowledge contributions. The key recommendations are for: researchers to design intentional research, with an explicit ToC; higher education institutions (HEI) to provide training and support for TDR theory and practice; and HEIs to give more attention to research evaluation. Originality/value This is the first application of both the outcome evaluation method and the TDR QAF to graduate student research projects, and one of very few such analyses of research projects. It offers a broader framework for conceptualizing and evaluating research contributions to social change processes. It is intended to stimulate new thinking about research aims, approaches and achievements.

Sign in / Sign up

Export Citation Format

Share Document