OntoBAeval: Ontology Based Automatic Evaluation of Free-Text Response

Author(s):  
Pratik Thanawala ◽  
Jyoti Pareek ◽  
Manan Shah
Author(s):  
Laura C Polacek ◽  
Sally Reisch ◽  
Rebecca M Saracino ◽  
Hayley Pessin ◽  
William Breitbart

Abstract The Meaning-Centered Psychotherapy training program (MCPT) is a multimodal, intensive, in-person program that trains cancer care providers in the evidence-based psychosocial treatment Meaning-Centered Psychotherapy (MCP). This analysis aimed to identify barriers and facilitators to clinical implementation (CI) at 1 year post-training. Trainee feedback regarding CI was collected via a mixed-methods questionnaire, including rating the ease of CI and free-text response identifying facilitators and barriers to CI. Descriptive statistics and thematic content analysis of follow-up data from the first five MCPT training cohorts (n = 55) were performed to assess CI and its facilitators and barriers. One third of participants indicated that it was at least somewhat difficult to implement MCP in clinical practice. Trainee-identified facilitators and barriers to CI were characterized within four main categories: program, patient, treatment, and institution. Within each of these factors, clinicians reported a variety of components that contributed to or hindered their ability to implement MCP. MCPT itself was reported as a facilitator. Patient access and interest were simultaneously identified as facilitators for some and barriers for others. Some trainees found the MCP treatment structure helpful in addressing important patient psychosocial needs, while others felt it was too restrictive. Institutional support played an important role in whether trainees felt hindered or helped to implement MCP. These initial results provide important insight into the program’s strengths and have fostered improvements to the MCPT program to better facilitate CI. Further study of MCPT CI is warranted, and theme refinement will be possible with a larger sample.


CJEM ◽  
2019 ◽  
Vol 21 (S1) ◽  
pp. S72
Author(s):  
M. Cortel-LeBlanc ◽  
J. Landreville ◽  
L. Thurgur

Introduction: Royal College Emergency Medicine (EM) trainees at the University of Ottawa participate in weekly Academic Full Days (AFD) that consist of didactic activities, simulation-based learning, and core content sessions referred to as Core Rounds (CR). Despite CR being intentioned for all EM trainees, an attendance attrition has been noted as trainees progress towards their senior (SR) years (PGY3-5). The objectives of this study were to (1) identify barriers to SR trainee CR attendance and (2) identify areas for CR improvement. Methods: An on-line survey was administered to SR EM trainees (PGY3-5, n = 28) and recent graduates from our program (practice year 1-2, n = 20) to explore perceptions of the value of AFDs, CR attendance barriers, and areas for CR improvement. The survey consisted of 5-point Likert scales and free-text responses. Quantitative responses were analyzed using Microsoft Excel. Free-text responses were analyzed qualitatively using thematic analysis. Each free-text response was reviewed independently by two investigators (JML, MCL) and underwent line-by-line coding. Through joint discussions, the codes from each response were synthesized and themes were identified. Results: Of the 48 trainees and attendings surveyed, 32 responded (response rate 67%). Most respondents (90%) stated they benefited from SR trainee attendance when they were at a junior (JR) level. The majority perceived they benefited less from CR as a SR trainee compared to when they were a JR trainee (85%). Further, 87% responded that CR were not tailored to a SR level, and that they would attend more frequently if sessions were geared to their level (81%). From our thematic analysis, three themes emerged relating to SR trainee absenteeism: 1) CR quality, 2) External Factors (eg. trainee fatigue) and 3) Malalignment with trainees’ own education plan. We also identified three themes relating to areas for CR improvement: 1) CR content, 2) CR format and 3) SR trainee involvement. Conclusion: Respondents indicated a benefit to having SR trainee presence at CR. This study identified barriers to SR resident attendance at CR and areas for improvement. With the transition to competency based medical education it is critical that trainees engage in effective educational experiences, especially as the RCPSC does not mandate AFDs for EM training in this new curriculum. A culture-change initiative and CR reformat is now underway at our institution with planned post-implementation analysis.


2020 ◽  
pp. 77-101
Author(s):  
Robin Støckert ◽  
Andreas Bergsland ◽  
Anna Xambó

This chapter examines how students in a two-campus, cross-disciplinary program in Music, Communication and Technology (MCT) experience the sense of presence of peer students and teachers, some physically co-localized while others are present via an audiovisual communications system. The chapter starts by briefly delineating the MCT program, the audiovisual communications system and the learning space built around it, named the Portal, and the research project SALTO which frames the current study. We then review research literature on presence relevant to this particular context and use this as a basis for the design of an online survey using a combination of Likert items and free text response. Our main findings, based on responses from the 16 students who participated in the survey, are that the mediating technologies of the Portal affect the experience of presence negatively, but that formal learning scenarios are less affected than informal scenarios that require social interaction.


Circulation ◽  
2018 ◽  
Vol 138 (Suppl_2) ◽  
Author(s):  
Sarah M Perman ◽  
Shelby K Shelton ◽  
Christopher Knoepke ◽  
Kathryn Rappaprt ◽  
Daniel D Matlock ◽  
...  

Introduction: Women who suffer an out of hospital cardiac arrest have been observed to receive less bystander cardiopulmonary resuscitation (CPR) than men. Potential reasons for why women receive less bystander CPR than men are largely unknown. Methods: Mechanical Turk (MTurk), Amazon’s crowdsourcing platform, was used to pilot a national survey asking participants why they believe women receive less bystander CPR than men. Eligible participants were adults (18 years or over) located in the US. Participants were reimbursed $1 for their participation. To ensure adequate knowledge on the subject, survey responses were excluded if they incorrectly defined CPR. Participant demographics as well as familiarity with CPR were queried. Participants were asked to answer the following free-text question “Do you have any ideas on why women may be less likely to receive CPR than men when they collapse in public?” Descriptive statistics were used to define the cohort. The free text response was coded using thematic analysis and major themes were identified via classical content analysis. Results: Within 55 minutes of deploying the pilot survey, 54 individuals responded. All respondents answered the knowledge question correctly, and none were excluded. Mean age was 36.9 ±9.6 years and 38.9% were female. Participants were geographically distributed as follows: 13% West, 13% Southwest, 16.7% Midwest, 27.8% Southeast, 29.6% Northeast. Predominant themes identified for why women might receive less bystander CPR than men are identified in Table 1. Within this cohort, 27.8% were trained in CPR, and only 5.6% of respondents had actually performed CPR on a person. Conclusions: In this pilot survey, public perceptions identified social norms regarding fear of inappropriate touching and hurting women as significant contributors to reasons for why women receive less bystander CPR than men. Additional work using a larger national sample to confirm and expand on these findings is ongoing.


2019 ◽  
Vol 6 ◽  
pp. 238212051983455 ◽  
Author(s):  
Damian Flanders ◽  
Athina Pirpiris ◽  
Niall Corcoran ◽  
Robert Forsyth ◽  
Richard Grills

Objectives: To re-assess the perceived benefit and relevance of simulation sessions to Victorian urology trainees and to identify areas for potential improvement. Subjects and methods: All trainees attending skills training sessions between 2011 and 2016 were asked to complete a structured questionnaire at the completion of the session. The questionnaire included 11 topic areas ranging from the year of surgical training to degree of usefulness of the session, including several sections for free-text response to offer more detailed feedback. Sessions were examined both individually and collectively to assess end-user satisfaction with the structure and content of the program. Results: In total, 24 individual skills sessions were held over the 6-year period, with a total of 355 attendees. Of these, 331 attendees completed the majority of the questionnaire, a response rate of over 93%. Overall 88% of the surveyed attendees stated that they had both the support of their supervising consultant and the flexibility of workload to attend the session; 90% of trainees felt that there was adequate reading material provided prior to the skills session, an improvement from 76% in the previous study period; and 97% of those surveyed felt that the existing session structure was appropriate and the same proportion found the sessions both useful and interesting, compared with just 63% in the previous study period. Analysis of individual topics demonstrates some variability in outcome measures, but for nearly every assessed parameter, greater than 90% of participants agreed that the session fulfilled the expected criteria. New topics developed since the 2011 analysis, including renal transplant and vascular repair, also had high levels of satisfaction. The practical models used have been refined and achieved higher scores than those in the previous assessment period. Conclusion: The urology skills-based training program has been well received by the surveyed trainees and is now embedded and accepted as part of the Victorian training program. The format of the sessions has matured and the overall rating, both individually and collectively, was high. There has been a clear increase in satisfaction across most areas assessed when compared with previous feedback. Despite this, there remain areas that can be improved, such as the amount and quality of available equipment and the inclusion of video demonstrations of operative techniques.


BMJ Open ◽  
2019 ◽  
Vol 9 (9) ◽  
pp. e031360 ◽  
Author(s):  
Joshua Zadro ◽  
Aimie L Peek ◽  
Rachael H Dodd ◽  
Kirsten McCaffery ◽  
Christopher Maher

ObjectivesChoosing Wisely holds promise for increasing awareness of low-value care in physiotherapy. However, it is unclear how physiotherapists’ view Choosing Wisely recommendations. The aim of this study was to evaluate physiotherapists’ feedback on Choosing Wisely recommendations and investigate agreement with each recommendation.SettingThe Australian Physiotherapy Association emailed a survey to all 20 029 physiotherapist members in 2015 seeking feedback on a list of Choosing Wisely recommendations.ParticipantsA total of 9764 physiotherapists opened the email invitation (49%) and 543 completed the survey (response rate 5.6%). Participants were asked about the acceptability of the wording of recommendations using a closed (Yes/No) and free-text response option (section 1). Then using a similar response format, participants were asked whether they agreed with each Choosing Wisely recommendation (sections 2–6).Primary and secondary outcomesWe performed a content analysis of free-text responses (primary outcome) and used descriptive statistics to report agreement and disagreement with each recommendation (secondary outcome).ResultsThere were 872 free-text responses across the six sections. A total of 347 physiotherapists (63.9%) agreed with the ‘don’t’ style of wording. Agreement with recommendations ranged from 52.3% (electrotherapy for back pain) to 76.6% (validated decision rules for imaging). The content analysis revealed that physiotherapists felt that blanket rules were inappropriate (range across recommendations: 13.9%–30.1% of responses), clinical experience is more valuable than evidence (11.7%–28.3%) and recommendations would benefit from further refining or better defining key terms (7.3%–22.4%).ConclusionsAlthough most physiotherapists agreed with both the style of wording for Choosing Wisely recommendations and with the recommendations, their feedback highlighted a number of areas of disagreement and suggestions for improvement. These findings will support the development of future recommendations and are the first step towards increasing the impact Choosing Wisely has on physiotherapy practice.


2021 ◽  
Author(s):  
Mary Chambers ◽  
Sue McAndrew ◽  
Fiona Nolan ◽  
Benjamin Thomas ◽  
Paul Watts ◽  
...  

Abstract Background: A key component of caring for service users (SUs) in acute mental health inpatient environments is Therapeutic Engagement (TE). To that end, the Therapeutic Engagement Questionnaire (TEQ) was developed and validated. The TEQ measures TE between SUs and registered mental health nurses (RMHNs) from the perspective of both parties and can quantify and recognise how nurses engage with SUs and monitor this activity as well as its enhancement of SU care and recovery. The aim of this study was to explore the views of SUs and RMHNs in relation to the TEQ and how it could be adopted into clinical practice within an acute inpatient environment.Methods: As part of the validation stage of the development of the TEQ, the views of 628 SUs and 543 RMHNs were collected using a qualitative approach by way of free text at the end of the questionnaire. Two questions required free text response: – ‘what do you think of the TEQ?’, and ‘how can it be utilised?’Results: Following thematic analysis, it was found that both sets of participants stated that such a tool could be utilised to improve the service, could help nurses with reflective practice, be utilised as part of clinical supervision and to aid nurses’ professional development. The nurse participants also stated that such a tool would help track SU participation and enablement in their care. Furthermore, the nurses noted that the tool would help to reinforce the core ‘caring’ value of nursing and the overall goal of recovery. The SUs added that a TE tool would recognise the work of mental health nurses and provide them with a clear opportunity to express their views in relation to nursing staff.Conclusions: Therapeutic engagement (TE) has been identified as part of the repertoire of mental health nursing and both groups of participants identified how a tool to assess this construct may be utilised in day-to-day clinical practice to the benefit of each group.


2018 ◽  
Vol 25 (3) ◽  
pp. 200 ◽  
Author(s):  
D. Berger-Richardson ◽  
R.S. Xu ◽  
R.A. Gladdy ◽  
J.A. McCart ◽  
A. Govindarajan ◽  
...  

Background Some surgeons change gloves and instruments after the extirpative phase of cancer surgery with the intent of reducing the risk of local and wound recurrence. Although this practice is conceptually appealing, the evidence that gloves or instruments act as vectors of cancer-cell seeding in the clinical setting is weak. To determine the potential effect of further investigation of this question, we surveyed the practices and beliefs of a broad spectrum of surgeons who operate on cancer patients.Methods Using a modified Dillman approach, a survey was mailed to all 945 general surgeons listed in the College of Physicians and Surgeons of Ontario public registry. The survey consisted of multiple-choice and free-text response questions. Responses were tabulated and grouped into themes, including specific intraoperative events and surgeon training. Predictive variables were analyzed by chi-square test.ResultsOf 459 surveys returned (adjusted response rate: 46%), 351 met the inclusion criteria for retention. Of those respondents, 52% reported that they change gloves during cancer resections with the intent of decreasing the risk of tumour seeding, and 40%, that they change instruments for that purpose. The proportion of respondents indicating that they take measures to protect the wound was 73% for laparoscopic cancer resections and 31% for open resections. Training and years in practice predicted some of the foregoing behaviours. The most commonly cited basis for adopting specific strategies to prevent tumour seeding was “gut feeling,” followed by clinical training. Most respondents believe that it is possible or probable that surgical gloves or instruments harbour malignant cells, but that a cancer recurrence proceeding from that situation is unlikely.Conclusions There is no consensus on how gloves and instruments should be handled in cancer operations. Further investigation is warranted.


Sign in / Sign up

Export Citation Format

Share Document