Positive Choices: Evaluation of a national initiative to disseminate evidence-based alcohol and other drug prevention strategies (Preprint)

2021 ◽  
Author(s):  
Lexine Ann Stapinski ◽  
Smriti Nepal ◽  
Tara Guckel ◽  
Lucinda Rachel Grummitt ◽  
Cath Chapman ◽  
...  
Keyword(s):  
End Users ◽  
Drug Prevention ◽  
School Staff ◽  
Evidence Based ◽  
School Students ◽  
Website Evaluation ◽  
System Usability Scale ◽  
System Usability ◽  
User Groups ◽  
The Impact

BACKGROUND To prevent adolescents from initiating alcohol and other drug (AOD) use, and reduce associated harms, effective strategies need to be implemented. Despite their availability, effective school-based programs and evidence informed parental guidelines are not consistently implemented. The Positive Choices drug prevention initiative and website was launched to address this research and practice gap. The intended end users were school staff, parents, and school students. An 8-month post-launch evaluation of the website showed that end users generally had positive feedback on the website’s usability, and following its use the majority would consider the evidence-base and effectiveness of drug education resources. The current study extends this initial evaluation by examining the effectiveness and impact of the Positive Choices initiative over a three-year period. OBJECTIVE Guided by the five dimensions of the RE-AIM framework i.e., reach, effectiveness, adoption, implementation, and maintenance, the study assesses the impact and effectiveness of the Positive Choices initiative in increasing awareness and implementation of evidence-based drug prevention. METHODS Data was collected between 2017 and 2019 using online website evaluation and community awareness surveys. Data from the surveys was merged to examine reach, effectiveness, adoption, implementation, and maintenance, via descriptive statistics. Google Analytics was used to further understand the reach of the website. The System Usability Scale was used to measure website usability. Additionally, inductive analysis was employed to assess participants’ feedback about Positive Choices. RESULTS Five years post-launch, the Positive Choices website has reached >2 million users. A national Australian campaign increased awareness from 8% to 14% post campaign among school staff, and from 15% to 22% among parents. Following a brief interaction with the website the majority of participants, who were not already following recommended strategies, reported an intention to shift towards evidence-based practices. The System Usability Scale score for the website was ‘good’, for both user groups. The participants intended to maintain their use of the Positive Choices website in the future. Both user groups reported a high level of confidence in communicating about AOD related topics. Participants’ suggestions for improvement informed a recent website update. CONCLUSIONS The Positive Choices website has the capacity to be an effective strategy for disseminating evidence-based drug prevention information and resources widely. The findings highlight the importance of investing in ongoing maintenance of, and promotion to enhance awareness of health websites. With the increased use and acceptability of health education websites, teams should ensure that websites are easy to navigate, engaging, use simple language, contain evidence-informed resources, and are supported by ongoing promotional activities.

scholarly journals 978. Assessing the Impact of a Mobile Device-Based Clinical Decision Support Tool on Guideline Adherence and Mental Workload

2018 ◽  
Vol 5 (suppl_1) ◽  
pp. S40-S40
Author(s):  
Katherine Richardson ◽  
Sarah Fouquet ◽  
Ellen Kerns ◽  
Russell Mcculloh
Keyword(s):  
Decision Support ◽  
Clinical Decision Support ◽  
Mental Workload ◽  
Clinical Decision ◽  
Medical Decision ◽  
Evidence Based ◽  
System Usability Scale ◽  
Nasa Tlx ◽  
Evidence Based Guidelines ◽  
The Impact

Abstract Background Fever in infants <90 days old can indicate a serious bacterial infection (SBI) such as urinary tract infection, bacteremia, or meningitis. Clinical management of febrile infants varies widely. Implementing clinical practice guidelines (CPGs) can help standardize care, and electronic clinical decision support (eCDS) tools are a potential means of distributing CPGs. Little is known regarding the individual-level impact of eCDS tool use on medical decision-making. Children’s Mercy Kansas City developed a mobile eCDS tool (CMPeDS: Pediatric Decision Support) that was used internationally in a practice standardization project focused on the management of febrile infants. Methods We conducted a prospective cross-over simulation study amongst pediatric healthcare providers. Attending and resident physicians performed simulated patient scenarios using either CMPeDS or a standard text reference (the Harriet Lane Handbook). Participants’ responses in the simulation were evaluated based on adherence to evidence-based guidelines. Participants’ mental workload was assessed using the NASA Task Load Index survey (NASA-TLX, in which lower scores are optimal) to assesses mental, physical, and temporal demand, as well as performance, effort, and frustration when completing a series of tasks. Paired t-test and ANOVA were used to determine significance for case performance scores and NASA-TLX scores, respectively. A System Usability Scale (SUS) was used to determine usability of the CMPeDS app. Results A total 28 of 32 planned participants have completed trial procedures to date. Mean performance scores on the cases were significantly higher with CMPeDS vs. standard reference, (87.7% vs. 72.4% [t(27) 3.22, P = 0.003]). Participants reported lower scores on the NASA-TLX when using CMPeDS compared with standard reference tool (Figure 1). Mean score on SUS was 88.2 (scale 0–100) indicating excellent tool usability (Figure 2). Conclusion Using the eCDS tool CMPeDS was associated with significantly increased adherence to evidence-based guidelines for febrile infant management and decreased mental workload in simulation. Our findings highlight the potential value of eCDS deployment as part of CPG implementation projects. Disclosures All authors: No reported disclosures.

scholarly journals Protocol for a hybrid type 3 cluster randomized trial of a technical assistance system supporting coalitions and evidence-based drug prevention programs

2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Louis D. Brown ◽  
Sarah M. Chilenski ◽  
Rebecca Wells ◽  
Eric C. Jones ◽  
Janet A. Welsh ◽  
...  
Keyword(s):  
Substance Use ◽  
Technical Assistance ◽  
Drug Prevention ◽  
Interactive Systems ◽  
Evidence Based ◽  
Interactive Systems Framework ◽  
Ebp Implementation ◽  
Prevention Support System ◽  
Systems Framework ◽  
The Impact

Abstract Background Over 5000 community anti-drug coalitions operating in the USA serve as a cornerstone of federal drug prevention. These coalitions, however, have demonstrated effectiveness in preventing substance use only when they use technical assistance (TA) and implement evidence-based programs (EBPs). The absence of TA and EBP implementation by coalitions is a key research-to-practice gap. The Coalition Check-Up TA system is designed to fill this gap by supporting community coalition implementation of EBPs. Existing TA models for evidence-based coalition approaches are resource intensive and coalition model specific. The Coalition Check-Up is a lower cost strategy that works with a variety of types of coalitions to support sustainable implementation of EBPs. This study protocol describes a hybrid type 3 effectiveness-implementation trial applying Wandersman’s Interactive Systems Framework to test the effects of the Coalition Check-Up on coalition EBP implementation capacity and outcomes. The Interactive Systems Framework outlines how the prevention support system—especially TA—bolsters EBP dissemination and implementation. Methods Using a cluster randomized controlled design, this trial will test the overall effectiveness of the Coalition Check-Up, including how it contributes to EBP implementation and prevention of youth substance use. The first aim is to estimate the impact of the Coalition Check-Up on coalitions’ capacity to do their work. We will recruit 68 anti-drug coalitions for random assignment to the Coalition Check-Up or “TA as usual” condition. We will evaluate whether the Coalition Check-Up improves coalition capacity using measures of coalition member responses about team processes, coalition network composition, and collaborative structure. Our second aim is to estimate the impact of the Coalition Check-Up on implementation of EBPs, and our third aim is to estimate the impact of the Coalition Check-Up on youth substance use. Discussion This project will clarify how the Coalition Check-Up, a scalable approach to TA due to its low cost, affects coalition capacity to support EBP implementation. Analyses also provide insight into causal pathways from the prevention support system to the prevention delivery system outlined by the Interactive Systems Framework. Results will build the evidence-base for how to support community coalitions’ sustainable implementation of evidence-based prevention programs and policies. Trial registration Clinicaltrials.gov registration number NCT04592120. Registered on October 19, 2020.

scholarly journals Development and evaluation of a multimedia e-learning resource for electrolyte and acid-base disorders

2011 ◽  
Vol 35 (3) ◽  
pp. 295-306 ◽  
Author(s):  
Mogamat Razeen Davids ◽  
Usuf M. E. Chikte ◽  
Mitchell L. Halperin
Keyword(s):  
Brain Size ◽  
Text Messages ◽  
Teaching Approach ◽  
Plasma Sodium ◽  
Acid Base ◽  
Learning Resource ◽  
System Usability Scale ◽  
System Usability ◽  
E Learning ◽  
The Impact

This article reports on the development and evaluation of a Web-based application that provides instruction and hands-on practice in managing electrolyte and acid-base disorders. Our teaching approach, which focuses on concepts rather than details, encourages quantitative analysis and a logical problem-solving approach. Identifying any dangers to the patient is a vital first step. Concepts such as an “appropriate response” to a given perturbation and the need for electroneutrality in body fluids are used repeatedly. Our Electrolyte Workshop was developed using Flash and followed an iterative design process. Two case-based tutorials were built in this first phase, with one tutorial including an interactive treatment simulation. Users select from a menu of therapies and see the impact of their choices on the patient. Appropriate text messages are displayed, and changes in body compartment sizes, brain size, and plasma sodium concentrations are illustrated via Flash animation. Challenges encountered included a shortage of skilled Flash developers, budgetary constraints, and challenges in communication between the authors and the developers. The application was evaluated via user testing by residents and specialists in internal medicine. Satisfaction was measured with a questionnaire based on the System Usability Scale. The mean System Usability Scale score was 78.4 ± 13.8, indicating a good level of usability. Participants rated the content as being scientifically sound; they liked the teaching approach and felt that concepts were conveyed clearly. They indicated that the application held their interest, that it increased their understanding of hyponatremia, and that they would recommend this learning resource to others.

scholarly journals The Impact of Undergraduate Program Developers and User Participation on the Quality of School Information System

2018 ◽  
Vol 24 (2) ◽  
pp. 222-228
Author(s):  
Nur W. Rahayu ◽  
Novi Setiani ◽  
Hanson P. Putro ◽  
Irena Yolanita Maureen
Keyword(s):  
Information System ◽  
Private Schools ◽  
User Participation ◽  
Acceptable Level ◽  
Critical Factors ◽  
System Usability Scale ◽  
System Usability ◽  
Successful School ◽  
The Impact

Developer's expertise and user participation are two critical factors of successful School Information System (SIS). Many researchers focus on user-initiated and professional SIS, while this study observes a campus-initiated SIS which involves undergraduate developers and volunteer users. We qualify the system using the System Usability Scale (SUS) and observation. The final prototype reaches an acceptable level of SUS and the outcomes among students whose GPA above 3.0 are not much different, but we recommend to find students with good grades in the supporting courses. The volunteer users come from 2 public and two private schools in Yogyakarta, Indonesia. We also examined user participation and found they were good and even excellent, although each developer may have a different standard of perceiving user participation. This study also reveals user inconsistency and interface issues were still become problematic, as changes cause the project to be overdue.

scholarly journals The Impact of a University Experience Program on Rural and Regional Secondary School Students: Keeping the Flame Burning

10.28945/3693 ◽  
2017 ◽  
Vol 14 ◽  
pp. 035-048
Author(s):  
Joy Penman ◽  
Jyothi Thalluri
Keyword(s):  
Social Issues ◽  
School Staff ◽  
University Campus ◽  
School Students ◽  
Staff Members ◽  
Regional University ◽  
Regional Universities ◽  
University Experience ◽  
The University ◽  
The Impact

Aim/Purpose: The uptake of university by regional students has been problematic for various reasons. This paper discusses a program, initiated by a South Australian regional university campus, aimed at attracting regional students into higher education. Background: A qualitative descriptive approach to study was used to determine the value of the program on participating students and school staff. Year 10 students from Roxby Downs, Port Augusta and Port Lincoln high schools were invited to participate in a two-day regionally-focussed school-university engagement program that linked students with the university campus and local employers. Methodology: A survey was administered to determine the impact of the program. Perceptions about the program by school staff were gathered using a modified One-Minute Harvard questionnaire. While 38 Year 10 students and 5 school staff members participated, 37 students and 3 staff evaluated the program. Findings: The findings revealed that the majority of the students would like to attend university, but financial and social issues were important barriers. The students learned about the regional university, what it can offer in terms of programs and support, and the employment prospect following university. The school staff benefited by developing a closer relationship with students and becoming better informed about the regional university. Recommendation for Practitioners: One way by which university uptake may be increased is to provide similar immersion programs featuring engagement with employers, our recommendation to other regional universities. In increasing the levels of education, individuals, communities and the society in general are benefited.

Using Socioscientific Issues to Enhance Evidence-Based Reasoning Among Middle School Students

2019 ◽  
pp. 150-176 ◽  
Author(s):  
Wardell Anthony Powell ◽  
Danielle Fuchs
Keyword(s):  
Middle School ◽  
Middle School Students ◽  
Socioscientific Issues ◽  
Evidence Based ◽  
School Students ◽  
Non Profit ◽  
Post Test ◽  
Enrichment Program ◽  
The Impact ◽  
Argumentation Quality

This study investigated the implementation of a socioscientific issue curricular unit that was designed to enhance evidence-based reasoning among middle school students. Forty-three middle school students (11-12 years old; 20 males, 23 females) from a summer enrichment program operated by a non-profit organization in the northeastern United States participated in this study. The duration of this curricular unit took place over five consecutive 1-hour period blocks. The researchers utilized qualitative procedures to analyze students' abilities to engage in evidence-based reasoning and the impact it might have on students' argumentation quality on whether the air we breathe makes us sick. Comparison of the findings from pre-test and post-test indicate that students were able to use evidence-based reasoning to enhance their argumentation quality. The results from this investigation suggest that perhaps the use of socioscientific issues as a critical pedagogical tool does enhance students' abilities to engage in evidence-based reasoning.

The Effect of Cognitive Fatigue on Subjective Usability Scores

2017 ◽  
Vol 61 (1) ◽  
pp. 1461-1465 ◽  
Author(s):  
Ian Robertson ◽  
Philip Kortum
Keyword(s):  
Subjective Assessment ◽  
The Other ◽  
Cognitive Fatigue ◽  
Usability Assessment ◽  
System Usability Scale ◽  
Main Effect ◽  
System Usability ◽  
Subjective Usability ◽  
The Impact ◽  
True Measure

Cognitive fatigue is a known factor in errors and major accidents. What is unknown is the impact that cognitive fatigue might have on the subjective assessment of usability. If users are regularly cognitively depleted when using a given system, and fatigue makes a difference in their usability assessment, then a true measure of usability would be derived only by testing users in that fatigued state. In this study, forty-three participants voted using twelve prototype paper voting ballots. Half of the ballots were classified as being of low usability and the other half as having high usability. These ballots were randomly assigned and participants completed six ballots before a fatigue manipulation and six after the manipulation. Each ballot was rated by the user with the System Usability Scale (SUS), and pre- and post-fatigue means were compared. No significant main effect was found for fatigue and no interaction was present, although the data suggest the effect may have been masked due to the high variance in the usability of the systems assessed.

Developing a Clinical Decision Support Tool for Appropriate Antibiotic Prescribing in Australian General Practice: A Simulation Study

2020 ◽  
Vol 40 (4) ◽  
pp. 428-437 ◽  
Author(s):  
Jo-Anne Manski-Nankervis ◽  
Ruby Biezen ◽  
Karin Thursky ◽  
Douglas Boyle ◽  
Malcolm Clark ◽  
...  
Keyword(s):  
Decision Support ◽  
Clinical Decision Support ◽  
Clinical Decision ◽  
Video Data ◽  
Consumer Information ◽  
Antibiotic Prescribing ◽  
Clinical Workflow ◽  
System Usability Scale ◽  
System Usability ◽  
The Impact

Background. Inappropriate antibiotic prescribing can lead to antimicrobial resistance and drug side effects. Tools that assist general practitioners (GPs) in prescribing decisions may help to optimize prescribing. The aim of this study was to explore the use, acceptability, and feasibility of a clinical decision support (CDS) tool that incorporates evidence-based guidelines and consumer information that integrates with the electronic medical record (EMR). Methods. Eight GPs completed an interview and brief survey after participating in 2 simulated consultations. The survey consisted of demographic questions, perception of realism and representativeness of consultations, Post-Study System Usability Questionnaire, and System Usability Scale. Qualitative data were analyzed using framework analysis. Video data were reviewed, with length of consultation and time spent using the CDS tool documented. Results. Survey responses indicated that all GPs thought the consultations were “real” and representative of real-life consultations; 7 of 8 GPs were satisfied with usability of the tool. Key qualitative findings included that the tool assisted with clinical decision making and informed appropriate antibiotic prescribing. Accessibility and ease of use, including content (guideline and patient education resources), layout, and format, were key factors that determined whether GPs said that they would access the tool in everyday practice. Integration of the tool at multiple sites within the EMR facilitated access to guidelines and assisted in ensuring that the tool fit the clinical workflow. Conclusion. Our CDS tool was acceptable to GPs. Key features required for the tool were easy navigation, clear and useful guideline content, ability to fit into the clinical workflow, and incorporation into the EMR. Piloting of the tool in general practices to assess the impact and feasibility of use in real-world consultations will now be undertaken.

scholarly journals IMPACT OF LEAP MOTION CONTROLLER ON PINCH GRIP IN SUB-ACUTE AND CHRONIC STROKE PATIENTS

2021 ◽  
Vol 10 (6) ◽  
pp. 3834-3836
Author(s):  
Prasad Dhage
Keyword(s):  
Chronic Stroke ◽  
Leap Motion ◽  
Motion Controller ◽  
Hand Rehabilitation ◽  
Stroke Patients ◽  
Leap Motion Controller ◽  
Pinch Grip ◽  
System Usability Scale ◽  
System Usability ◽  
The Impact

Stroke patients have limited everyday tasks. For that videogame-based training (VBT) with the effect of virtual reality helps to improve the role of upper limb and motor function of hand rehabilitation (finger pinch grip). The Leap motion controller can track the both extremities (hand and fingers) fine movements. The study will demonstrate the impact of the leap motion controller on pinch grip in patient with sub-acute and chronic stroke. The total of 40 participants will be taken for study as per inclusion and exclusion criteria. The duration of the study will be six months with intervention. Leap motion -based, augmented reality training will be provided to patients for half hour, Every single day, 5days of the week a month. Formant’s sign and system usability scale will be taken. Those two will be the patient’s measure outcomes. Impact of the leap motion controller device will be evaluated by using the system usability scale and Formant’s sign. The result from the study will significantly provide evidence on the use of Leap motion controller on pinch grip in subacute and chronic stroke patient.

scholarly journals Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability Scale

2020 ◽  
Author(s):  
Aaron R Lyon ◽  
Michael D. Pullmann ◽  
Jedediah Jacobson ◽  
Katie Osterhage ◽  
Morhaf Al Achkar ◽  
...  
Keyword(s):  
Primary Care ◽  
Health Services ◽  
Behavioral Health ◽  
Implementation Research ◽  
Psychosocial Interventions ◽  
Health Interventions ◽  
Evidence Based ◽  
Implementation Success ◽  
System Usability Scale ◽  
System Usability

Abstract BackgroundUsability – the extent to which an intervention can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction – is a key determinant of implementation success. However, usability is rarely assessed in implementation research and no instruments have been developed to measure the design quality of complex health interventions, such as the evidence-based psychosocial interventions that characterize the majority of effective practices in mental and behavioral health services. This study evaluated the structural validity of the Intervention Usability Scale (IUS), an adapted version of the well-established System Usability Scale for digital technologies, when measuring the usability of complex health interventions. Prior studies of the original System Usability Scale have found both one- and two-factor solutions, both of which were examined in the current study of the IUS.MethodsA survey was administered to 205 healthcare professionals working at 11 primary care sites. Surveys collected demographic information, including each participant’s professional role (i.e., medical provider, mental/behavioral health provider, pharmacist), and IUS ratings for one of six common evidence-based psychosocial interventions (e.g., cognitive behavioral therapy, motivational interviewing) that they reported using most regularly. Factor analyses replicated the procedures used in prior research on the System Usability Scale, and a sensitivity analysis using analyses of variance compared IUS scores across different groups of respondents and interventions assessed.ResultsAnalyses indicated that a two-factor solution (with “usable” and “learnable” subscales) in which one item was removed best fit the data. This solution accounted for 52.6% of the variance observed. Inter-item reliabilities for the total score, usable subscale, and learnable subscale were α = .83, α = .82, and α = .63, respectively. Resulting scores indicated that usability ranged from below acceptable standards to good, depending on the intervention. On average, behavioral health providers found the interventions to be more usable that other types of healthcare providers.ConclusionsThe current study provides evidence for a two-factor IUS structure consistent with some prior research, as well as acceptable reliability and sensitivity to role and intervention. Future directions for implementation research evaluating the usability of complex health interventions are discussed.Contributions to the Literature• The ease with which interventions can be readily adopted by service providers is a key predictor of implementation success, but very little implementation research has attended to intervention usability.• No instruments exist to evaluate the usability of complex health interventions, such as the evidence-based practices that are commonly used to integrate mental and behavioral health services into primary care.• The current study evaluated the first instrument for assessing the usability of complex health interventions and found that its factor structure replicated some research with the original version of the instrument, a scale developed to assess the usability of digital systems.

Sign in / Sign up

Export Citation Format

Share Document