Cognitive evaluation of uncertainty visualization methods for decision making

Author(s):  
Maria Riveiro
2020 ◽  
Vol 2 ◽  
Author(s):  
Michelle Korporaal ◽  
Ian T. Ruginski ◽  
Sara Irina Fabrikant

2016 ◽  
Vol 16 (2) ◽  
pp. 97-105 ◽  
Author(s):  
Jennifer Smith Mason ◽  
Alexander Klippel ◽  
Susanne Bleisch ◽  
Aidan Slingsby ◽  
Stephanie Deitrick

2012 ◽  
Vol 6 (1) ◽  
pp. 30-56 ◽  
Author(s):  
Xiao Dong ◽  
Caroline C. Hayes

Uncertainty is inherent in all real work contexts; it creates ambiguities that make decision making difficult. To help decision makers manage ambiguity, the authors developed and evaluated a domain-independent decision support system (DSS), the Uncertainty DSS. It is designed to help decision makers recognize situations in which uncertainty creates ambiguity in their choices and to identify information that can help reduce that ambiguity. It does so by providing an uncertainty visualization, which shows when the range of possible values for two or more alternatives overlap, indicating that one cannot identify the best alternative given the current information. To evaluate the Uncertainty DSS, the authors created a pared-down version, the Certainty DSS, which provides no uncertainty visualizations. They recruited 22 engineering designers and asked them compare alternative designs from real, ongoing design projects using no DSS, the Certainty DSS, and the Uncertainty DSS. The authors found that without the visualizations, participants did not distinguish between ambiguous and unambiguous choices. However, the Uncertainty DSS improved participants’ ability to recognize ambiguous decision situations. Additionally, it increased the likelihood that participants would form plans to seek clarifying information. These results suggest that a relatively simple visualization can change the way in which designers think about decision choices.


Author(s):  
Stephen M. Fiore ◽  
Samantha F. Warta ◽  
Andrew Best ◽  
Olivia Newton ◽  
Joseph J. LaViola

This paper describes initial validation of a theoretical framework to support research on the visualization of uncertainty. Two experiments replicated and extended this framework, illustrating how the manipulation of task complexity produces differences in performance. Additionally, using a combinatory metric of workload and performance, this framework provides a new metric for assessing uncertainty visualization. We describe how this work acts as a theoretical scaffold for examining differing forms of visualizations of uncertainty by providing a means for systematic variations in task context.


Author(s):  
Jihye Song ◽  
Olivia B. Newton ◽  
Stephen M. Fiore ◽  
Corey Pittman ◽  
Joseph J. LaViola

Recent advances in uncertainty visualization research have focused not only on design features to support decision making, but also on challenges of evaluating the effectiveness of uncertainty visualizations, such as the degree to which individuals’ baseline task comprehension may alter their performance on experimental tasks regardless of a visualization’s effectiveness. Building on recent work, we investigated the effect of training comprehension on performance across varying representations of uncertainty and varying degrees of visualization interactivity using a simulated course of action selection task. Additionally, we explored how extended cognition theory can be applied to visualization evaluations by incorporating interface features that afford externalization of knowledge within the task environment. Our findings suggest that regardless of how uncertainty is represented, training comprehension leads to superior transfer, reduced workload, more accurate metacognitive judgments, and higher cognitive efficiency. Our findings also suggest that external cognition during decision making leads to improved accuracy and cognitive efficiency. The present study contributes to research on the design and evaluation of uncertainty visualizations. In addition, this study extends previous work by demonstrating how extended cognition theory can inform the design of human-machine interfaces to support decision making.


2012 ◽  
Vol 24 (6) ◽  
pp. 987-993 ◽  
Author(s):  
Melanie C. Greenaway ◽  
Noah L. Duncan ◽  
Sherrie Hanna ◽  
Glenn E. Smith

ABSTRACTBackground: We examined the utility of cognitive evaluation to predict instrumental activities of daily living (IADLs) and decisional ability in Mild Cognitive Impairment (MCI).Methods: Sixty-seven individuals with single-domain amnestic MCI were administered the Dementia Rating Scale-2 (DRS-2) as well as the Everyday Cognition assessment form to assess functional ability.Results: The DRS-2 Total Scores and Initiation/Perseveration and Memory subscales were found to be predictive of IADLs, with Total Scores accounting for 19% of the variance in IADL performance on average. In addition, the DRS-2 Initiation/Perseveration and Total Scores were predictive of ability to understand information, and the DRS-2 Conceptualization helped predict ability to communicate with others, both key variables in decision-making ability.Conclusions: These findings suggest that performance on the DRS-2, and specific subscales related to executive function and memory, is significantly related to IADLs in individuals with MCI. These cognitive measures are also associated with decision-making-related abilities in MCI.


2019 ◽  
Vol 1 ◽  
pp. 1-2
Author(s):  
Petr Kubíček ◽  
Milan Konečný ◽  
Jie Shen ◽  
Zdeněk Stachoň ◽  
Radim Štampach ◽  
...  

<p><strong>Abstract.</strong> The issue of uncertainty as a generic phenomenon in the natural world has been at the centre of both the cartographic and GI communities since the beginning of geographic data quality research. In accordance with the development of theoretical aspects of cartographic visualization and methods of uncertainty propagation in models, the generally accepted opinion is that uncertainty has to be presented to users in an unambiguous and understandable way. Despite reasonable amounts of work done in the field of uncertainty visualization methods (MacEachren1992, Leitner and Buttenfield 2000) and the testing of impact of visualization on decision making (Senaratne et al. 2012; Kinkeldy et al. 2015), there is still a wide gap between the uncertainty visualization theory and widely accepted use of uncertainty representation within decision making process. MacEachren et al. (2012), Fabrikant et al. (2010) initiated the discussion towards optimization of uncertainty visualization regarding visual semiotics and use of specific representations of uncertainty within complex mapping compositions and application context. However, their studies left also some open questions to be solved regarding the international audience of users.</p><p>The presented study focused on two unresolved topics, namely how would users perceive the uncertainty point map signs within a complex map field and what would be the appropriate visualization in case if there is a need to combine value and uncertainty together. Moreover, we performed the testing in two different cultural environments in Brno (Czech Republic, Europe) and Nanjing (China).</p>


Sign in / Sign up

Export Citation Format

Share Document