Model blindness: A Framework for Understanding how Model-Based Decision Support Systems can Lead to Performance Degradation

Author(s):  
Sweta Parmar ◽  
David A. Illingworth ◽  
Rickey P. Thomas

Model-Based Decision Support Systems (MDSS) are ubiquitous in many high-consequence domains like emergency management and military command and control. This paper proposes a framework of model-blindness imposed by MDSS via filtering relevant information and presenting irrelevant information to the decision-maker, causing performance degradation. The paper also defines novel categories of performance: model-limited, strategy-limited, and context-limited. We propose a theoretical confluence model of operator performance under model blindness and a framework to evaluate model blindness empirically. We report simulation results to demonstrate the impact of model blindness on performance and outline mitigation strategies for designers and developers of MDSS. The recommendations and insights can be used to evaluate the limitations associated with particular MDSS before implementation.

2009 ◽  
Vol 18 (01) ◽  
pp. 84-95 ◽  
Author(s):  
A. Y. S. Lau ◽  
G. Tsafnat ◽  
V. Sintchenko ◽  
F. Magrabi ◽  
E. Coiera

Summary Objectives To review the recent research literature in clinical decision support systems (CDSS). Methods A review of recent literature was undertaken, focussing on CDSS evaluation, consumers and public health, the impact of translational bioinformatics on CDSS design, and CDSS safety. Results In recent years, researchers have concentrated much less on the development of decision technologies, and have focussed more on the impact of CDSS in the clinical world. Recent work highlights that traditional process measures of CDSS effectiveness, such as document relevance are poor proxy measures for decision outcomes. Measuring the dynamics of decision making, for example via decision velocity, may produce a more accurate picture of effectiveness. Another trend is the broadening of user base for CDSS beyond front line clinicians. Consumers are now a major focus for biomedical informatics, as are public health officials, tasked with detecting and managing disease outbreaks at a health system, rather than individual patient level. Bioinformatics is also changing the nature of CDSS. Apart from personalisation of therapy recommendations, translational bioinformatics is creating new challenges in the interpretation of the meaning of genetic data. Finally, there is much recent interest in the safety and effectiveness of computerised physicianorderentry (CPOE) systems, given that prescribing and administration errors are a significant cause of morbidity and mortality. Of note, there is still much controversy surrounding the contention that poorly designed, implemented or used CDSS may actually lead to harm. Conclusions CDSS research remains an active and evolving area of research, as CDSS penetrate more widely beyond their traditional domain into consumer decision support, and as decisions become more complex, for example by involving sequence level genetic data.


Author(s):  
Jitka Janová ◽  
M. Lindnerová

The decision support systems commonly used in industry and economy managerial practice for optimizing the processes are based on algoritmization of the typical decision problems. In Czech forestry business, there is a lack of developed decision support systems, which could be easily used in daily practice. This stems from the fact, that the application of optimization methods is less successful in forestry decision making than in industry or economy due to inherent complexity of the forestry decision problems. There is worldwide ongoing research on optimization models applicable in forestry decision making, but the results are not globally applicable and moreover the cost of possibly arising software tools are indispensable. Especially small and medium forestry companies in Czech Republic can not afford such additional costs, although the results of optimization could positively in­fluen­ce not only the business itself but also the impact of forestry business on the environment. Hence there is a need for user friendly optimization models for forestry decision making in the area of Czech Republic, which could be easily solved in commonly available software, and whose results would be both, realistic and easily applicable in the daily decision making.The aim of this paper is to develop the optimization model for the machinery use planning in Czech logging firm in such a way, that the results can be obtained using MS EXCEL. The goal is to identify the integer number of particular machines which should be outsourced for the next period, when the total cost minimization is required. The linear programming model is designed covering the typical restrictions on available machinery and total volume of trees to be cut and transported. The model offers additional result in the form of optimal employment of particular machines. The solution procedure is described in detail and the results obtained are discussed with respect to its applicability in practical forestry decision making. The possibility of extension of suggested model by including additional requirements is mentioned and the example for the wood manipulation requirement is shown.


2010 ◽  
pp. 1043-1055 ◽  
Author(s):  
Ankush Sharma ◽  
Preeta Vyas

Retailing is in a rapid state of change due to speedy technological developments, changing competitive positions, varying consumer behaviour as well as their expectations and liberalized regulatory environment. In such a scenario, information is crucial to plan and control profitable retail businesses and it can be an important source of competitive advantage so long as it is affordable and readily available. DSS (Decision Support Systems) which provide timely and accurate information can be viewed as an integrated entity providing management with the tools and information to assist their decision making.


Author(s):  
Frédéric Adam ◽  
Jean-Charles Pomerol ◽  
Patrick Brézillon

In this article, a newspaper company which has implemented a computerised editorial system is studied in an attempt to understand the impact that groupware systems can have on the decision making processes of an organisation. First, the case study protocol is presented, and the findings of the case are described in detail. Conclusions are then presented which pertain both to this case and to the implementation of decision support systems that have a groupware dimension.


Author(s):  
Patrick Humphreys

The discourses established as the foundations of group decision support systems (GDSS) have been called into question not only in the interests of advancing the academic GDSS field (Bannon, 1997), but also out of the perceived need to plug gaps that sophisticated GDSS systems throw up in practice (Huber, 1981; Humphreys & Brezillon, 2002; Humphreys & Jones, 2006; Stabell, 1987). The limitations of rational perspectives of “decision- making as choice” have been raised (Carlsson, 2002; Cyert & March, 1992; Nappelbaum, 1997). The challenges relate to failures of implementation, the rise of unintended outcomes, the impact of cultures of fear and failure within organisations (Humphreys & Nappelbaum, 1997), and problems associated with externalisation of decision systems designers who “play God” by designing from outside the game for those who are inside (Humphreys, 1989).


Sign in / Sign up

Export Citation Format

Share Document