iEthics: An Interprofessional Ethics Curriculum

This article discusses the development, content, implementation, and evaluation of an interprofessional ethics curriculum that has been integrated as a required component of learning in the Faculty of Pharmaceutical Sciences at the University of British Columbia (UBC), along with 12 other health professional programs. We start by giving a background and rationale for the development of the integrated ethics (iEthics) curriculum, led by UBC Health, and provide an overview of the pedagogical approach used, curriculum model, and content. We outline the way in which the iEthics curriculum has been implemented in the Faculty and share findings from program evaluations. In the discussion section, we reflect on our experience as facilitators for the interprofessional workshops and link these experiences with the findings from the program evaluations. These reflections highlight the way in which the iEthics curriculum has been successful in meeting the desired outcomes of learning in terms of the interprofessional delivery, and provide insights into how the findings from the iEthics evaluation informed other modules in the integrated curriculum and its implementation in the Faculty of Pharmaceutical Sciences.

Evaluating Gifted Programs

Program evaluation is one of the few areas in gifted education that considers the coherence among gifted education program components across the K-12 spectrum. It increases the visibility of the gifted program while acknowledging the fluidity of change in a given context and engages individuals in influencing the nature and degree of changes that can occur within their system. Two key questions in the gifted field are: To what degree do these programs make a difference in the lives of gifted children? How do we know they are working? Program evaluation is a solid and necessary step in answering these questions. Program evaluation is necessary to drive gifted program improvement. This chapter provides the rationale and literature review on gifted program evaluation as well as research-based protocols for facilitating gifted program evaluations and the commensurate processes for ensuring quality, transparency, and comprehensiveness.

A CEFR BASED EVALUATION OF B1+ LEVEL PREPARATORY PROGRAM AT A TURKISH STATE UNIVERSITY: THE APPLICATION OF THE FOREIGN LANGUAGE SKILLS SCALE

Despite the centrality of the Common European Framework of Reference for Languages (CEFR) in language teaching and assessment, studies investigating its learning outcomes in language program evaluations are quite scarce. This paper aims to evaluate the effectiveness of a modular English preparatory school program through the Foreign Language Skills Scale. The research sample consists of 357 preparatory school students having attained B1+ level of proficiency in the program. The results revealed that while the language program designed to be in line with the CEFR guidelines, in general, serves for the needs of the students, there are still some discrepancies between the learning outcomes of B1+ and opinions of students about their competencies, especially in listening sub-skills.

Development of a New Measure of Intergenerational Contact

Intergenerational relationships are a predictor of greater physical, mental, and emotional well-being; they can reduce ageism and facilitate feelings of purpose and meaning, shown to be important for health and mortality. Surprisingly there are no measures of intergenerational contact (IGC) shown to be reliable and valid across age groups. Therefore, we aimed to develop a psychometrically sound survey measure of IGC. We utilized a three-phase development process, which included a Delphi-style expert panel review of items, focus groups, and validation of the survey via Amazon MTurk. The resulting 18-item survey captures details on and comparisons between both familial and non-familial contact and is appropriate for adults of all ages. We conducted confirmatory factor analyses with the 9-item family and 9-item non-family subscales for 380 young and 256 middle-aged adults reporting on contact with older adults, and 348 older adults reporting on contact with younger adults. The family scale had good model fit across all three groups (χ2 (78) = 245.74, p<.0001; RMSEA = 0.08, 90% CI = [0.07, 0.10]; CFI = .94; TLI = .92). After covarying for 2 pairs of items among the middle-age group, the non-family scale had good model fit across all groups (χ2(75) = 217.21, p<.0001; RMSEA = 0.08, 90% CI = [0.07, 0.09]; CFI = .95; TLI = .93), indicating construct equivalence across age groups. The new IGC measure can be used in all adult age groups, making it useful for scientific projects as well as program evaluations. Funded by the RRF Foundation on Aging

Listening to Clinical Teams: Developing Strategies to Support Sustained STAR-VA Implementation

Feedback obtained from program evaluations and interviews with CLC team members who participated in STAR-VA helped to inform the development of sustained implementation strategies guided by the CFIR-ERIC Mapping Tool. A CLC readiness assessment was developed to guide selection of new champions and assess for local team readiness to implement STAR-VA. Virtual training materials were developed along with a champion training checklist to prepare additional champions and support team training. We identified key implementation steps and optional strategies to support sustained implementation, developed a sustained implementation guide, associated sustained implementation checklist, and sustainability toolkit. We are piloting a regional community of practice model, encouraging development of and building on relationship networks to promote use of program tools, collaborative problem-solving, feedback, and a shared vision for implementation. We will discuss the importance of tailored strategies for integrating new practices into usual care.

960. Creation of an Infection Prevention and Control (IPAC) Elective for Infectious Disease (ID) Fellows

Background ID specialists often function as leaders of IPAC for healthcare systems, with variable training. Our graduates have noted feeling underprepared for this role despite completion of a computer-based training course on IPAC basics. We developed a 2-4 week IPAC elective (IPACe) rotation to address this gap to increase familiarity with key IPAC concepts, introduce learners to approaches to IPAC investigations, and develop understanding of common IPAC challenges and controversies. Methods Methodology followed Kern’s 6-step approach. A reading list focusing on key areas in infection prevention was developed. Instructional methods included flipped classroom, learner led discussions, performing tracers, and integration with the IPAC team. Key hospital processes including High Level Disinfection (HLD) and Sterile Processing Department (SPD) were reviewed in detail with and observed by learners. In addition to an IPACe, periodic required IPAC essay questions on real-world investigations as they arose were delivered to the learners. Learner Assessment: Learners were assessed on elements of IPAC consistent with the ACGME 6 core competencies at the end of their rotation. Program Assessment: Anonymous narrative feedback was solicited post rotation completion and at semi-annual program evaluations. Additionally, learners were asked to rate the elective on a 5 point Likert scale (1 lowest, 5 highest) and specific feedback was solicited for improvement. Finally, feedback was solicited from graduates in IPAC roles. Results 8 learners participated over from 2017-2021: 2 for 4 weeks, and 6 for 2 weeks. 4 of 8 surveys included a response to the questionnaire, all survey respondents (4/4) rated the elective 5: “rotation should be required of all trainees in the program.” Narrative assessments revealed the elective was highly valuable. Graduates reported feeling well-prepared after the IPACe for their roles as IPAC leaders. Highlights identified were: exposure to interdisciplinary teamwork, participation in tracers in identifying gaps, and using real-world IPAC challenges as cognitive frameworks for outbreak investigation. Conclusion An IPACe was highly valued by fellow learners and narrative assessments identified key areas for further focus. Disclosures All Authors: No reported disclosures

Are Participants Good Evaluators?

Managers of workforce training programs are often unable to afford costly, full-fledged experimental or nonexperimental evaluations to determine their programs’ impacts. Therefore, many rely on the survey responses of program participants to gauge program impacts. Smith, Whalley, and Wilcox present the first attempt to assess such measures despite their already widespread use in program evaluations. They develop a multidisciplinary framework for addressing the issue and apply it to three case studies: the National Job Training Partnership Act Study, the U.S. National Supported Work Demonstration, and the Connecticut Jobs First Program. Each of these studies were subjected to experimental evaluations that included a survey-based participant evaluation measure. The authors apply econometric methods specifically developed to obtain estimates of program impacts among individuals in the studies and then compare these estimates with survey-based participant evaluation measures to obtain an assessment of the surveys’ efficacy. The authors also discuss how their findings fit into the broader literatures in economics, psychology, and survey research.

A Randomized Controlled Trial Using Automated Technology for Improving Ototoxicity Monitoring in VA Oncology Patients

Purpose Determine the efficacy of ototoxicity monitoring (OM) administered as automated protocols with the Oto-ID mobile audiometer (automated ototoxicity monitoring [A-OM]), compared with usual care (UC) OM in cancer patients receiving cisplatin. Method Participants were patients ( n = 46, mean age 64.7 years; range: 30–78 years) receiving cisplatin-based chemotherapy at the Department of Veterans Affairs Portland Health Care System. A randomized controlled trial contrasted A-OM and UC at up to three program evaluations (PEs) conducted by the study audiologist who was blinded to arm through PE1. PE1 occurred before randomization or oncology treatment; PE2 and PE3 occurred during and/or after treatment at 35 and 365 days postrandomization. The A-OM group ( n = 24) used Oto-ID to screen their hearing before each cisplatin dose. Oto-ID results were sent to the study audiologist for interpretation, follow-up, and care coordination. The UC group ( n = 22) received a consult for OM services through the audiology clinic. Outcomes included hearing shift near each patient's high-frequency hearing limit, revised hearing-handicap inventory score, and survival time from the start of treatment. Adherence to OM protocols, patients' use of aural rehabilitation services, and oncologists' treatment decisions were also examined. Results Ototoxicity was identified at a high overall rate (46% and 76% at 35 and 365 days, respectively, postrandomization). Adherence to monitoring prior to each cisplatin dose was 83.3% for those randomized to A-OM compared with 4.5% for UC. Randomization to A-OM was not associated with reduced ototoxic hearing shifts or self-reported hearing handicap relative to UC; neither did it compromise participants' survival. Half of participants in each arm accessed aural rehabilitation services. One in each arm had a documented ototoxicity-related cisplatin dose reduction. Conclusions Auditory impairment was an actionable concern for the participants and their oncology providers. A dedicated surveillance program using the Oto-ID's automated protocols improved adherence to OM recommendations over a traditional UC service delivery model. Supplemental Material https://doi.org/10.23641/asha.16649602

Problem-Solving Benefits of Down-Sampled Lexicase Selection

In genetic programming, an evolutionary method for producing computer programs that solve specified computational problems, parent selection is ordinarily based on aggregate measures of performance across an entire training set. Lexicase selection, by contrast, selects on the basis of performance on random sequences of training cases; this has been shown to enhance problem-solving power in many circumstances. Lexicase selection can also be seen as better reflecting biological evolution, by modeling sequences of challenges that organisms face over their lifetimes. Recent work has demonstrated that the advantages of lexicase selection can be amplified by down-sampling, meaning that only a random subsample of the training cases is used each generation. This can be seen as modeling the fact that individual organisms encounter only subsets of the possible environments and that environments change over time. Here we provide the most extensive benchmarking of down-sampled lexicase selection to date, showing that its benefits hold up to increased scrutiny. The reasons that down-sampling helps, however, are not yet fully understood. Hypotheses include that down-sampling allows for more generations to be processed with the same budget of program evaluations; that the variation of training data across generations acts as a changing environment, encouraging adaptation; or that it reduces overfitting, leading to more general solutions. We systematically evaluate these hypotheses, finding evidence against all three, and instead draw the conclusion that down-sampled lexicase selection's main benefit stems from the fact that it allows the evolutionary process to examine more individuals within the same computational budget, even though each individual is examined less completely.

Modelización de la trayectoria del efecto de programas y políticas: implicaciones para la evaluación

In program evaluation, results could change dramatically depending on the when, it is mainly in impact evaluation. Although it is pretty relevant, only hypothetical proposals have been found in the consulted literature about how interventions effects evolve over time. This paper analyzes the plausibility of those hypothetical proposals. In this sense, it is analyzed the number of consulting on the Internet through Google Trends. In order to develop the method, several assumptions have been made regarding interventions categories and about the relationship between the number of consulting and program impact too. From visual analysis is concluded that the effect on the number of consulting fits to a sigmoidal, leptokurtic, and positive biased function. Eventually, relevance for program evaluations and methodological implications are discussed.