A Systematic Mapping Review of Usability Evaluation Methods for Software Development Process

Author(s):  
Freddy Paz ◽  
José Antonio Pow-Sang
Author(s):  
Judith Symonds

Usability Evaluation Methods (UEM) are plentiful in the literature. However, there appears to be a new interest in usability testing from the viewpoint of the industry practitioner and renewed effort to reflect usability design principles throughout the software development process. In this chapter we examine one such example of usability testing from the viewpoint of the industry practitioner and reflect upon how usability evaluation methods are perceived by the software developers of a content driven system and discuss some benefits that can be derived from bringing together usability theory and usability evaluation methods protocols used by practitioners. In particular, we use the simulated prototyping method and the “Talk Aloud” protocol to assist a small software development company to undertake usability testing. We propose some issues that arise from usability testing from the perspectives of the researchers and practitioners and discuss our understanding of the knowledge transfer that occurs between the two.


Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3480
Author(s):  
Walter Takashi Nakamura ◽  
Iftekhar Ahmed ◽  
David Redmiles ◽  
Edson Oliveira ◽  
David Fernandes ◽  
...  

The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process.


2018 ◽  
Vol 7 (2.28) ◽  
pp. 10 ◽  
Author(s):  
Freddy Paz ◽  
Freddy A. Paz ◽  
José Antonio Pow-Sang ◽  
César Collazos

Heuristic evaluation is one of the most used techniques to evaluate the level of usability of a software product. In this research, we performed a comprehensive analysis of the recent studies which report the use of this method in the context of a software development process. The purpose was to identify the specific way in which each author performs this usability evaluation method, in order to propose a formal protocol. After an indeed examination of these studies, we have determined there are several differences in the way this technique is conducted according to the literature. There is no agreement about the number of inspectors that should participate, the usability principles that should be used, the profile of the specialists who must be part of the assessment team, or the evaluation process that should be followed. This work highlights the available settings and a detailed procedure to perform a heuristic evaluation in the domain of software products.  


Author(s):  
Fouad Abdulameer Salman ◽  
Aziz Bin Deraman ◽  
Masita Binti Abdul Jalil

As consumer demand for user friendly software increases, usability evaluation is crucial to develop software systems which are easy to learn and use. However, implementation of usability evaluation is challenging for small and medium-sized enterprises (SMEs) due to factors such as lack of technical expertise, knowledge and experience of methods and standards. This results in neglect, or poorly executed evaluations of projects, resulting in software that disappoints and frustrates clients. To overcome this loss of competitiveness, we propose here a visual incorporation tool derived from ISO standards that would assist software development teams in SMEs in understanding and implementing usability evaluations. It shows fundamental Usability Engineering (UE) and Software Engineering (SE) activities and artifacts relevant to the usability evaluation and software development process, with potential incorporation points being highlighted. Dependencies and relationships are shown by links between activities and artifacts. Additionally, convergent artifacts of both disciplines were identified and shown. Evaluation of the proposed tool was based on the questionnaire results of software development practitioners from SMEs.


Sign in / Sign up

Export Citation Format

Share Document