scholarly journals What Makes a Difference in Patient Safety when Designing, Implementing and Evaluating Clinical Decision Support Systems?

Author(s):  
Mustafa Ozkaynak ◽  
Ann Bisantz ◽  
Laura Militello ◽  
Kristen Miller ◽  
Michael Rayo ◽  
...  

Clinical decision support (CDS) has become an important component of all health settings. Despite a long history of research on their design and implementation, their use is still suboptimal. Unique characteristics of specific settings can require highlighting different features and design recommendations for CDS. This panel will focus on various pitfalls in designing and implementing CDS in various clinical settings and strategies to overcome these pitfalls. Each panelist will introduce their work by discussing the design and implementation challenges that prevent achieving the targeted patient and organizational outcomes. Panelists will also discuss potential approaches with their strengths and limitations to address these challenges. The panelists will then interact with audience members to solicit users’ (e.g. clinicians, patients) unfulfilled needs and limitations of existing approaches to create a broad future research agenda at the intersection of human factors approaches and theories, and CDS systems.

2018 ◽  
Vol 59 (6) ◽  
pp. 1024-1033 ◽  
Author(s):  
Mustafa Ozkaynak ◽  
Blaine Reeder ◽  
Cynthia Drake ◽  
Peter Ferrarone ◽  
Barbara Trautner ◽  
...  

Abstract Background and Objectives Clinical decision support systems (CDSS) hold promise to influence clinician behavior at the point of care in nursing homes (NHs) and improving care delivery. However, the success of these interventions depends on their fit with workflow. The purpose of this study was to characterize workflow in NHs and identify implications of workflow for the design and implementation of CDSS in NHs. Research Design and Methods We conducted a descriptive study at 2 NHs in a metropolitan area of the Mountain West Region of the United States. We characterized clinical workflow in NHs, conducting 18 observation sessions and interviewing 15 staff members. A multilevel work model guided our data collection and framework method guided data analysis. Results The qualitative analysis revealed specific aspects of multilevel workflow in NHs: (a) individual, (b) work group/unit, (c) organization, and (d) industry levels. Data analysis also revealed several additional themes regarding workflow in NHs: centrality of ongoing relationships of staff members with the residents to care delivery in NHs, resident-centeredness of care, absence of memory aids, and impact of staff members’ preferences on work activities. We also identified workflow-related differences between the two settings. Discussion and Implications Results of this study provide a rich understanding of the characteristics of workflow in NHs at multiple levels. The design of CDSS in NHs should be informed by factors at multiple levels as well as the emergent processes and contextual factors. This understanding can allow for incorporating workflow considerations into CDSS design and implementation.


2017 ◽  
Author(s):  
Laura Légat ◽  
Sven Van Laere ◽  
Marc Nyssen ◽  
Stephane Steurbaut ◽  
Alain G Dupont ◽  
...  

BACKGROUND Worldwide, the burden of allergies—in particular, drug allergies—is growing. In the process of prescribing, dispensing, or administering a drug, a medication error may occur and can have adverse consequences; for example, a drug may be given to a patient with a documented allergy to that particular drug. Computerized physician order entry (CPOE) systems with built-in clinical decision support systems (CDSS) have the potential to prevent such medication errors and adverse events. OBJECTIVE The aim of this review is to provide a comprehensive overview regarding all aspects of CDSS for drug allergy, including documenting, coding, rule bases, alerts and alert fatigue, and outcome evaluation. METHODS The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed as much as possible and searches were conducted in 5 databases using CPOE, CDSS, alerts, and allergic or allergy as keywords. Bias could not be evaluated according to PRISMA guidelines due to the heterogeneity of study types included in the review. RESULTS Of the 3160 articles considered, 60 met the inclusion criteria. A further 9 articles were added based on expert opinion, resulting in a total of 69 articles. An interrater agreement of 90.9% with a reliability Κ=.787 (95% CI 0.686-0.888) was reached. Large heterogeneity across study objectives, study designs, study populations, and reported results was found. Several key findings were identified. Evidence of the usefulness of clinical decision support for drug allergies has been documented. Nevertheless, there are some important problems associated with their use. Accurate and structured documenting of information on drug allergies in electronic health records (EHRs) is difficult, as it is often not clear to healthcare providers how and where to document drug allergies. Besides the underreporting of drug allergies, outdated or inaccurate drug allergy information in EHRs poses an important problem. Research on the use of coding terminologies for documenting drug allergies is sparse. There is no generally accepted standard terminology for structured documentation of allergy information. The final key finding is the consistently reported low specificity of drug allergy alerts. Current systems have high alert override rates of up to 90%, leading to alert fatigue. Important challenges remain for increasing the specificity of drug allergy alerts. We found only one study specifically reporting outcomes related to CDSS for drug allergies. It showed that adverse drug events resulting from overridden drug allergy alerts do not occur frequently. CONCLUSIONS Accurate and comprehensive recording of drug allergies is required for good use of CDSS for drug allergy screening. We found considerable variation in the way drug allergy are recorded in EHRs. It remains difficult to reduce drug allergy alert overload while maintaining patient safety as the highest priority. Future research should focus on improving alert specificity, thereby reducing override rates and alert fatigue. Also, the effect on patient outcomes and cost-effectiveness should be evaluated.


We are in the midst of a healthcare paradigm shift driven by the wide adoption of ubiquitous computing and various modes of information communications technologies. As a result, cities worldwide are undergoing a major process of urbanization with ever increasing wealth of sensing capabilities – hence the Internet of Things (IoT). These trends impose great pressure on how healthcare is done. This paper describes the design and implementation of a situated clinical decision support (SCDSS) system, most appropriate for smart cities. The SCDSS was prototyped and enhanced in a clinic. The SCDSS was then used in a clinic as well as in a university hospital centre. In this article, the system’s architecture, subcomponents and integrated workflow are described. The systems’ design was the result of a knowledge acquisition process involving interviews with five specialists and testing with 50 patients. The reports (specialist consultation report) generated by the SCDSS were shown to general practitioners who were not able to distinguish them from human specialist reports. We propose a context-aware CDSS and assess its effectiveness in managing a wide medical range of patients. Five different patient cases were identified for analysis. The SCDSS was used to produce draft electronic specialist consultations, which were then compared to the original specialists’ consultations. It was found that the SCDSS-generated consults were of better quality for a number of reasons discussed herein. SCDSSs have great promise for their use in the clinical environment of smart cities. Valuable insights into the integration and use of situated clinical decision support systems are highlighted and suggestions for future research are given.


2014 ◽  
Vol 23 (01) ◽  
pp. 163-166 ◽  
Author(s):  
J.-B. Lamy ◽  
J. Bouaud ◽  

Summary Objective: To summarize recent research and propose a selection of best papers published in 2013 in the field of computer-based decision support in health care. Method: Two literature reviews were performed by the two section editors from bibliographic databases with a focus on clinical decision support systems (CDSSs) and computer provider order entry in order to select a list of candidate best papers to be peer-reviewed by external reviewers. Results: The full review process highlighted three papers, illustrating current trends in the domain of clinical decision support. The first trend is the development of theoretical approaches for CDSSs, and is exemplified by a paper proposing the integration of family histories and pedigrees in a CDSS. The second trend is illustrated by well-designed CDSSs, showing good theoretical performances and acceptance, while failing to show a clinical impact. An example is given with a paper reporting on scorecards aiming to reduce adverse drug events. The third trend is represented by research works that try to understand the limits of CDSS use, for instance by analyzing interactions between general practitioners, patients, and a CDSS. Conclusions: CDSSs can achieve good theoretical results in terms of sensibility and specificity, as well as a good acceptance, but evaluations often fail to demonstrate a clinical impact. Future research is needed to better understand the causes of this observation and imagine new effective solutions for CDSS implementation.


2016 ◽  
Vol 23 (5) ◽  
pp. 1001-1006 ◽  
Author(s):  
Stephanie Medlock ◽  
Jeremy C Wyatt ◽  
Vimla L Patel ◽  
Edward H Shortliffe ◽  
Ameen Abu-Hanna

Abstract A fundamental challenge in the field of clinical decision support is to determine what characteristics of systems make them effective in supporting particular types of clinical decisions. However, we lack such a theory of decision support itself and a model to describe clinical decisions and the systems to support them. This article outlines such a framework. We present a two-stream model of information flow within clinical decision-support systems (CDSSs): reasoning about the patient (the clinical stream), and reasoning about the user (the cognitive-behavioral stream). We propose that CDSS “effectiveness” be measured not only in terms of a system’s impact on clinical care, but also in terms of how (and by whom) the system is used, its effect on work processes, and whether it facilitates appropriate decisions by clinicians and patients. Future research into which factors improve the effectiveness of decision support should not regard CDSSs as a single entity, but should instead differentiate systems based on their attributes, users, and the decision being supported.


2021 ◽  
Vol 11 (11) ◽  
pp. 5088
Author(s):  
Anna Markella Antoniadi ◽  
Yuhan Du ◽  
Yasmine Guendouz ◽  
Lan Wei ◽  
Claudia Mazo ◽  
...  

Machine Learning and Artificial Intelligence (AI) more broadly have great immediate and future potential for transforming almost all aspects of medicine. However, in many applications, even outside medicine, a lack of transparency in AI applications has become increasingly problematic. This is particularly pronounced where users need to interpret the output of AI systems. Explainable AI (XAI) provides a rationale that allows users to understand why a system has produced a given output. The output can then be interpreted within a given context. One area that is in great need of XAI is that of Clinical Decision Support Systems (CDSSs). These systems support medical practitioners in their clinic decision-making and in the absence of explainability may lead to issues of under or over-reliance. Providing explanations for how recommendations are arrived at will allow practitioners to make more nuanced, and in some cases, life-saving decisions. The need for XAI in CDSS, and the medical field in general, is amplified by the need for ethical and fair decision-making and the fact that AI trained with historical data can be a reinforcement agent of historical actions and biases that should be uncovered. We performed a systematic literature review of work to-date in the application of XAI in CDSS. Tabular data processing XAI-enabled systems are the most common, while XAI-enabled CDSS for text analysis are the least common in literature. There is more interest in developers for the provision of local explanations, while there was almost a balance between post-hoc and ante-hoc explanations, as well as between model-specific and model-agnostic techniques. Studies reported benefits of the use of XAI such as the fact that it could enhance decision confidence for clinicians, or generate the hypothesis about causality, which ultimately leads to increased trustworthiness and acceptability of the system and potential for its incorporation in the clinical workflow. However, we found an overall distinct lack of application of XAI in the context of CDSS and, in particular, a lack of user studies exploring the needs of clinicians. We propose some guidelines for the implementation of XAI in CDSS and explore some opportunities, challenges, and future research needs.


1993 ◽  
Vol 32 (01) ◽  
pp. 12-13 ◽  
Author(s):  
M. A. Musen

Abstract:Response to Heathfield HA, Wyatt J. Philosophies for the design and development of clinical decision-support systems. Meth Inform Med 1993; 32: 1-8.


2006 ◽  
Vol 45 (05) ◽  
pp. 523-527 ◽  
Author(s):  
A. Abu-Hanna ◽  
B. Nannings

Summary Objectives: Decision Support Telemedicine Systems (DSTS) are at the intersection of two disciplines: telemedicine and clinical decision support systems (CDSS). The objective of this paper is to provide a set of characterizing properties for DSTSs. This characterizing property set (CPS) can be used for typing, classifying and clustering DSTSs. Methods: We performed a systematic keyword-based literature search to identify candidate-characterizing properties. We selected a subset of candidates and refined them by assessing their potential in order to obtain the CPS. Results: The CPS consists of 14 properties, which can be used for the uniform description and typing of applications of DSTSs. The properties are grouped in three categories that we refer to as the problem dimension, process dimension, and system dimension. We provide CPS instantiations for three prototypical applications. Conclusions: The CPS includes important properties for typing DSTSs, focusing on aspects of communication for the telemedicine part and on aspects of decisionmaking for the CDSS part. The CPS provides users with tools for uniformly describing DSTSs.


2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
S M Jansen-Kosterink ◽  
M Cabrita ◽  
I Flierman

Abstract Background Clinical Decision Support Systems (CDSSs) are computerized systems using case-based reasoning to assist clinicians in making clinical decisions. Despite the proven added value to public health, the implementation of CDSS clinical practice is scarce. Particularly, little is known about the acceptance of CDSS among clinicians. Within the Back-UP project (Project Number: H2020-SC1-2017-CNECT-2-777090) a CDSS is developed with prognostic models to improve the management of Neck and/or Low Back Pain (NLBP). Therefore, the aim of this study is to present the factors involved in the acceptance of CDSSs among clinicians. Methods To assess the acceptance of CDSSs among clinicians we conducted a mixed method analysis of questionnaires and focus groups. An online questionnaire with a low-fidelity prototype of a CDSS (TRL3) was sent to Dutch clinicians aimed to identify the factors influencing the acceptance of CDSSs (intention to use, perceived threat to professional autonomy, trusting believes and perceived usefulness). Next to this, two focus groups were conducted with clinicians addressing the general attitudes towards CDSSs, the factors determining the level of acceptance, and the conditions to facilitate use of CDSSs. Results A pilot-study of the online questionnaire is completed and the results of the large evaluation are expected spring 2020. Eight clinicians participated in two focus groups. After being introduced to various types of CDSSs, participants were positive about the value of CDSS in the care of NLBP. The clinicians agreed that the human touch in NLBP care must be preserved and that CDSSs must remain a supporting tool, and not a replacement of their role as professionals. Conclusions By identifying the factors hindering the acceptance of CDSSs we can draw implications for implementation of CDSSs in the treatment of NLBP.


Sign in / Sign up

Export Citation Format

Share Document