Applicability of Usability Evaluation Techniques to Aviation Systems

Contemporary software systems focus on usability and accessibility from the point of view of effectiveness and ergonomics. However, the correct usage of the domain dictionary and the description of domain relations and properties via their user interfaces are often neglected. We use the term domain usability (DU) to describe the aspects of the user interface related to the terminology and domain. Our experience showed that poor domain usability reduces the memorability and effectiveness of user interfaces. To address this problem, we describe a method called ADUE (Automatic Domain Usability Evaluation) for the automated evaluation of selected DU properties on existing user interfaces. As a prerequisite to the method, metrics for formal evaluation of domain usability, a form stereotype recognition algorithm, and general application terms filtering algorithm have been proposed. We executed ADUE on several real-world Java applications and report our findings. We also provide proposals to modify existing manual usability evaluation techniques for the purpose of domain usability evaluation.

Download Full-text

Usability Evaluation Techniques for Agile Software Model

Journal of Software ◽

10.17706/jsw.10.1.32-41 ◽

2015 ◽

Vol 10 (1) ◽

pp. 32-41

Author(s):

Saad Masood Butt ◽

Shahid Masood Butt ◽

Azura Onn ◽

Nadra Tabassam ◽

Mazlina Abdul Majid

Keyword(s):

Usability Evaluation ◽

Software Model ◽

Agile Software ◽

Evaluation Techniques

Download Full-text

Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

Applied Clinical Informatics ◽

10.4338/aci-2011-01-ra-0004 ◽

2011 ◽

Vol 02 (02) ◽

pp. 202-224 ◽

Cited By ~ 14

Author(s):

S. Iribarren ◽

S. Kapsandoy ◽

S. Perri ◽

N. Staggers ◽

J. Guo

Keyword(s):

Patient Safety ◽

Medication Administration ◽

Usability Evaluation ◽

Staff Nurses ◽

Call To Action ◽

Clinical Nurses ◽

Usability Problems ◽

Evaluation Techniques ◽

Promote Patient Safety ◽

Electronic Medication Administration

SummaryBackground: Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users.Objective: To conduct a formal usability evaluation of an implemented eMAR.Methods: Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses.Results: Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic.Conclusion: The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety.

Download Full-text

The Use of ‘Stalking Horse' Evaluation Prototypes for Probing DTV Accessibility Requirements

Interactive Digital Television ◽

10.4018/978-1-59904-361-6.ch008 ◽

2011 ◽

pp. 131-147

Author(s):

Mark Springett ◽

Richard Griffiths

Keyword(s):

Critical Incidents ◽

Low Vision ◽

Inductive Reasoning ◽

Digital Tv ◽

Usability Evaluation ◽

The Other ◽

Wizard Of Oz ◽

Reported Study ◽

Rich Information ◽

Evaluation Techniques

This chapter describes a technique that utilises established usability evaluation techniques to discover a range of accessibility requirements for digital TV (DTV) viewers with low vision. A study was reported in which two “stalking horse” prototype conditions were tried by subjects performing interactive tasks. These prototypes were not developed technologies but Wizard-of-Oz style conditions. In one condition subjects were asked to use gestures to interact with DTV services, with the screen responding to their hand movements. The other condition used a static keyboard display placed on the table in front of them. Their role was both to probe the efficacy of these approaches and to prompt rich information relating to the subjects abilities, lifestyles, and strategies for interaction. The reported study analyses four viewers with differing types of sight impairment. .The reported study was successful in yielding both general concerns about current approaches to DTV display and interactivity design as well as giving significant insights into the possible potential of and difficulties with alternative input methods. The sessions yielded numerous critical incidents, examples of which are reported and analysed. The format also yielded key insights into the way in which individual viewers compensate for diminished vision by using alternative skills such as touch-typing and alternative sensory signals, inductive reasoning and heuristics. The significance of these insights for DTV design and accessibility support is then discussed.

Download Full-text

The design of manual domain usability evaluation techniques

Open Computer Science ◽

10.1515/comp-2018-0005 ◽

2018 ◽

Vol 8 (1) ◽

pp. 51-67 ◽

Cited By ~ 1

Author(s):

Michaela Bačíková ◽

Lukáš Galko

Keyword(s):

User Interfaces ◽

Qualitative Evaluation ◽

Gospel Music ◽

Usability Evaluation ◽

Future Research ◽

Specific Domain ◽

System Usability Scale ◽

Usability Metrics ◽

The Impact ◽

Evaluation Techniques

AbstractIn this paper we design novel techniques for manual domain usability evaluation. Domain usability is the aspect of a particular user interface that relates to its terminology, hierarchy of terms, feature descriptions and icons, used language and consistency. However, domain usability is often neglected not only by software developers, but also by many researchers. The design of formal means to evaluate existing user interfaces would aid the development of better, domain-usable user interfaces. We designed six qualitative evaluation techniques and one formal evaluation technique based on System Usability Scale (SUS). To show the viability of the designed techniques, we demonstrate each of them in the domain of gospel music. Two of the techniques were used to experimentally verify the impact of specific domain usability aspects on usability and user experience. In this paper we also focus on the equality of the domain usability aspects with the goal of designing domain usability metrics. The preliminary design of the metrics is also presented in this paper and areas of future research are suggested.

Download Full-text