scholarly journals Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

2019 ◽  
Vol 7 (23) ◽  
pp. 1-160
Author(s):  
Carol Rivas ◽  
Daria Tkacz ◽  
Laurence Antao ◽  
Emmanouil Mentzakis ◽  
Margaret Gordon ◽  
...  

BackgroundPatient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually.Main aimTo improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience.Secondary aims(1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability.DesignA scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice.Key outcomesA taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods.Results(1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support.LimitationsSmall participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use.ConclusionsUsing a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application.Future workFurther exploration is needed of implementation into practice, transferable uses and technology development co-design approaches.FundingThe National Institute for Health Research Health Services and Delivery Research programme.

2021 ◽  
Vol 36 (3) ◽  
pp. 362-369
Author(s):  
Katie A. Willson ◽  
Gerard J. FitzGerald ◽  
David Lim

AbstractObjective:This scoping review aims to map the roles of rural and remote primary health care professionals (PHCPs) during disasters.Introduction:Disasters can have catastrophic impacts on society and are broadly classified into natural events, man-made incidents, or a mixture of both. The PHCPs working in rural and remote communities face additional challenges when dealing with disasters and have significant roles during the Prevention, Preparedness, Response, and Recovery (PPRR) stages of disaster management.Methods:A Johanna Briggs Institute (JBI) scoping review methodology was utilized, and the search was conducted over seven electronic databases according to a priori protocol.Results:Forty-one papers were included and sixty-one roles were identified across the four stages of disaster management. The majority of disasters described within the literature were natural events and pandemics. Before a disaster occurs, PHCPs can build individual resilience through education. As recognized and respected leaders within their community, PHCPs are invaluable in assisting with disaster preparedness through being involved in organizations’ planning policies and contributing to natural disaster and pandemic surveillance. Key roles during the response stage include accommodating patient surge, triage, maintaining the health of the remaining population, instituting infection control, and ensuring a team-based approach to mental health care during the disaster. In the aftermath and recovery stage, rural and remote PHCPs provide long-term follow up, assisting patients in accessing post-disaster support including delivery of mental health care.Conclusion:Rural and remote PHCPs play significant roles within their community throughout the continuum of disaster management. As a consequence of their flexible scope of practice, PHCPs are well-placed to be involved during all stages of disaster, from building of community resilience and contributing to early alert of pandemics, to participating in the direct response when a disaster occurs and leading the way to recovery.


Author(s):  
Mario Jojoa Acosta ◽  
Gema Castillo-Sánchez ◽  
Begonya Garcia-Zapirain ◽  
Isabel de la Torre Díez ◽  
Manuel Franco-Martín

The use of artificial intelligence in health care has grown quickly. In this sense, we present our work related to the application of Natural Language Processing techniques, as a tool to analyze the sentiment perception of users who answered two questions from the CSQ-8 questionnaires with raw Spanish free-text. Their responses are related to mindfulness, which is a novel technique used to control stress and anxiety caused by different factors in daily life. As such, we proposed an online course where this method was applied in order to improve the quality of life of health care professionals in COVID 19 pandemic times. We also carried out an evaluation of the satisfaction level of the participants involved, with a view to establishing strategies to improve future experiences. To automatically perform this task, we used Natural Language Processing (NLP) models such as swivel embedding, neural networks, and transfer learning, so as to classify the inputs into the following three categories: negative, neutral, and positive. Due to the limited amount of data available—86 registers for the first and 68 for the second—transfer learning techniques were required. The length of the text had no limit from the user’s standpoint, and our approach attained a maximum accuracy of 93.02% and 90.53%, respectively, based on ground truth labeled by three experts. Finally, we proposed a complementary analysis, using computer graphic text representation based on word frequency, to help researchers identify relevant information about the opinions with an objective approach to sentiment. The main conclusion drawn from this work is that the application of NLP techniques in small amounts of data using transfer learning is able to obtain enough accuracy in sentiment analysis and text classification stages.


2021 ◽  
Vol 8 ◽  
pp. 237437352199774
Author(s):  
Thomas Key ◽  
Avadhut Kulkarni ◽  
Vikram Kandhari ◽  
Zayd Jawad ◽  
Angela Hughes ◽  
...  

The coronavirus disease 2019 (COVID-19) pandemic has necessitated many rapid changes in the provision and delivery of health care in hospital. This study aimed to explore the patient experience of inpatient care during COVID-19 pandemic. An electronic questionnaire was designed and distributed to inpatients treated at a large University Health Board over a 6-week period. It focused on hospital inpatients’ experience of being cared for by health care professionals wearing personal protective equipment (PPE), explored communication, and patients’ perceptions of the quality of care. A total of 704 patients completed the survey. Results demonstrated that patients believe PPE is important to protect the health of both patients and staff and does not negatively impact on their care. In spite of routine use of PPE, patients were still able to identify and communicate with staff. Although visiting restrictions were enforced to limit disease transmission, patients maintained contact with their relatives by using various electronic forms of communication. Overall, patients rated the quality of care they received at 9/10. This single-center study demonstrates a positive patient experience of care at an unprecedented time.


2021 ◽  
pp. 136749352110058
Author(s):  
Helen J Nelson ◽  
Catherine Pienaar ◽  
Anne M Williams ◽  
Ailsa Munns ◽  
Katie McKenzie ◽  
...  

Patient experience surveys have a user focus and measure the quality of person-centered health care for hospital inpatients and consumers of community health services, providing a governance process to evaluate the quality of care and to action improvement. Experience of care has been described as effective communication, respect and dignity, and emotional support. Measurement criteria for these domains are not standardized, leading to inconsistent reporting of patient experience. The objective of this scoping review was to synthesize evidence for measuring experience of care in children’s community health services using the Joanna Briggs Institute framework for scoping review method. Three parent-reported surveys met the inclusion criteria, and 50 survey items were assessed by expert reviewers for fit to domains of healthcare experience. Conceptual domains of parent experience in children’s community health services included respect and dignity, effective communication, and emotional support. A gap was identified, in that few items in identified surveys measured emotional support. This contribution will promote consistent reporting of healthcare experience, informing policy and practice for person-centered health care.


10.2196/16055 ◽  
2020 ◽  
Vol 8 (4) ◽  
pp. e16055
Author(s):  
Charlotte Romare ◽  
Lisa Skär

Background Anesthesia departments and intensive care units represent two advanced, high-tech, and complex care environments. Health care in those environments involves different types of technology to provide safe, high-quality care. Smart glasses have previously been used in different health care settings and have been suggested to assist health care professionals in numerous areas. However, smart glasses in the complex contexts of anesthesia care and intensive care are new and innovative. An overview of existing research related to these contexts is needed before implementing smart glasses into complex care environments. Objective The aim of this study was to highlight potential benefits and limitations with health care professionals' use of smart glasses in situations occurring in complex care environments. Methods A scoping review with six steps was conducted to fulfill the objective. Database searches were conducted in PubMed and Scopus; original articles about health care professionals’ use of smart glasses in complex care environments and/or situations occurring in those environments were included. The searches yielded a total of 20 articles that were included in the review. Results Three categories were created during the qualitative content analysis: (1) smart glasses as a versatile tool that offers opportunities and challenges, (2) smart glasses entail positive and negative impacts on health care professionals, and (3) smart glasses' quality of use provides facilities and leaves room for improvement. Smart glasses were found to be both a helpful tool and a hindrance in caring situations that might occur in complex care environments. This review provides an increased understanding about different situations where smart glasses might be used by health care professionals in clinical practice in anesthesia care and intensive care; however, research about smart glasses in clinical complex care environments is limited. Conclusions Thoughtful implementation and improved hardware are needed to meet health care professionals’ needs. New technology brings challenges; more research is required to elucidate how smart glasses affect patient safety, health care professionals, and quality of care in complex care environments.


2020 ◽  
pp. 089033442098069
Author(s):  
Suzanne Hetzel Campbell ◽  
Nicole de Oliveira Bernardes ◽  
Thayanthini Tharmaratnam ◽  
Flaviana Vely Mendonça Vieira

Background Breastfeeding is a fundamental component of health care, and health professionals need to be adequately prepared. As part of the system, health care professionals have the ability to influence the establishment and maintenance of breastfeeding. The global literature regarding the curricular approach or established best practices for health professional education in lactation is inconclusive and lacking in rigor. Research aim To explore the literature for the educational resources, methods, and curriculum used in the education of undergraduate health students related to lactation. Methods A scoping review examining the curricular programs of health professional students in lactation was undertaken exploring and summarizing evidence from peer reviewed and grey literature. A scoping review with a five-stage review process was followed. The database search between 1982–2018 generated 625 results, 79 full-text articles were reviewed, and 29 articles published in English met the inclusion criteria. Results In general, educational resources, methods, curricular approaches, and foundational topics were based on best practice standards. Some authors incorporated a variety of learning methods and provided experiential learning, with evidence of translation of knowledge into clinical practice. In the studies examined, researchers reported that students had improved their: knowledge and attitudes (59%); breastfeeding support skills (45%); and confidence (10%). However, even in programs that focused on developing students’ breastfeeding support skills, authors reported a lack of change in students’ confidence. Conclusions Although only English articles met the inclusion criteria, this review was unique in its search of multidisciplinary, multilingual, and international studies. Consistency in teaching across disciplines is key and not evident in the studies reviewed.


2020 ◽  
Vol 54 (10) ◽  
pp. 1038-1046
Author(s):  
Barbara J. Zarowitz

Advances in the application of artificial intelligence, digitization, technology, iCloud computing, and wearable devices in health care predict an exciting future for health care professionals and our patients. Projections suggest an older, generally healthier, better-informed but financially less secure patient population of wider cultural and ethnic diversity that live throughout the United States. A pragmatic yet structured approach is recommended to prepare health care professionals and patients for emerging pharmacotherapy needs. Clinician training should include genomics, cloud computing, use of large data sets, implementation science, and cultural competence. Patients will need support for wearable devices and reassurance regarding digital medicine.


Sign in / Sign up

Export Citation Format

Share Document