scholarly journals Usability Textual Data Analysis: A Formulaic Coding Think-Aloud Protocol Method for Usability Evaluation

2021 ◽  
Vol 11 (15) ◽  
pp. 7047
Author(s):  
Toshihisa Doi
Keyword(s):  
Data Analysis ◽  
Usability Evaluation ◽  
Analysis Procedure ◽  
Think Aloud ◽  
Verbal Responses ◽  
Usability Tests ◽  
Usability Problems ◽  
Think Aloud Protocol ◽  
Textual Data ◽  
Explicit Procedure

Think-aloud protocols are among the most standard methods for usability evaluation, which help to discover usability problems and to examine improvements because they provide direct information on a user’s thinking and cognitive processes; however, it is often difficult to determine how to analyze the data to identify usability problems because there is no formulaic analysis procedure for textual data. Therefore, the analysis is time-consuming, and the quality of the results varies depending on an analyst’s skills. In the present study, the author proposes a formulaic analysis think-aloud protocol method that specifies the procedure for analyzing participants’ verbal responses during usability tests. The aim of the proposed think-aloud protocol method was to deliver an explicit procedure using step coding (SCAT) and 70 design items for textual data analysis, and then, the method was applied to a case study of usability evaluation to confirm that the method could extract the target system’s problems. By using step coding and 70 design items, the process of extracting usability problems from textual data was made explicit, and the problems were extracted analytically. In other words, the proposed method was less ambiguous. Once a formulaic analysis procedure was established, textual data analysis could be performed easily and efficiently. The analysis could be performed without hesitation after data acquisition, and there were fewer omissions. In addition, it is expected that the procedure would be easy to use, even for novice designers.

scholarly journals A Study on the Perceived Mobile Experience of Myeg Users

2019 ◽  
Vol 13 (11) ◽  
pp. 4
Author(s):  
Azham Hussain ◽  
Emmanuel O.C. Mkpojiogu ◽  
Norzila Ishak ◽  
Nurhidayah Mokhtar
Keyword(s):  
User Experience ◽  
Usability Evaluation ◽  
Electronic Government ◽  
Government Agencies ◽  
Think Aloud ◽  
Auto Insurance ◽  
Customer Needs ◽  
Think Aloud Protocol ◽  
Electronic Channel

Mobility is the trend right now. It is transforming the user experience from the confines of the desk to the convenience of anytime-anywhere. MyEG Services Berhad ("MYEG") is a concessionaire for Malaysian Electronic-Government ("E-Government") MSC Flagship Application. MYEG builds, operates and owns the electronic channel that delivers services from various Government agencies to Malaysia citizens and businesses. To make their services up-to-date and in trend, MyEG app was developed and can also be used to check summons, pay summons, renew road-tax and renew auto insurance. To make sure that this application is efficient, fulfilling the customer needs and satisfaction, a usability evaluation was conducted. The evaluation was conducted in “Jabatan Teknologi Maklumat & Komunikasi, Politeknik Seberang Perai”, with 15 participants consisting of both lecturers and students. The think-aloud protocol was used while conducting the evaluation. The result of the evaluation revealed that overall the app is efficient, successful in fulfilling the users’ requirement and needs and promotes users mobile experience.

EVALUATING CONSTRUCTION DEFECT MOBILE APPLICATION USING THINK ALOUD

2018 ◽  
Vol 3 (2) ◽  
pp. 162
Author(s):  
Zan Azma Nasruddin ◽  
Azleen Markom ◽  
Maslina Abdul Aziz ◽  
Pa'ezah Hamzah
Keyword(s):  
Mobile Application ◽  
Usability Evaluation ◽  
Mobile App ◽  
Think Aloud ◽  
Evaluation Technique ◽  
Defect Inspection ◽  
Design Improvement ◽  
Usability Problems ◽  
Future Work ◽  
The Given

Construction Defect mobile application (app) is used by Ministry of Defense's Construction Defect Inspection Team to help the team in recording construction defect. However, the mobile app has never been evaluated formally to identify any usability problems. The objectives of this study are to identify usability problems of Construction Defect mobile app using think aloud and to recommend design improvement of Construction Defect mobile app based on the identified usability problems. The think aloud study involved 15 participants. During the evaluation, every participant carried out the given tasks and gave his impressions as he went along the tasks. Three usability problems were identified. Some recommendations have been proposed to improve the design of Construction Defect mobile app. As for the future work, the study may be conducted using different usability evaluation technique.

Usability evaluation with tasks characterized by the information search process

2016 ◽  
Vol 34 (4) ◽  
pp. 572-587 ◽  
Author(s):  
Cuichang Ma ◽  
Shujin Cao ◽  
Tinghua Gu
Keyword(s):  
Digital Library ◽  
Digital Libraries ◽  
Information Search ◽  
Usability Evaluation ◽  
Search Process ◽  
Content Type ◽  
Usability Tests ◽  
Usability Problems ◽  
Knowledge States ◽  
Perceived Usability

Purpose The purpose of this study is to present an approach to evaluating the usability of digital libraries in terms of knowledge states within the information search process (ISP) by investigating the connections among components with which users interact, perceived usability and task stages. The China National Knowledge Infrastructure (CNKI), the most popular digital library in China, was chosen to be studied. Design/methodology/approach With the research framework, measurements were generated for perceived usability in task stages for efficiency, effectiveness and satisfaction. Two usability experiments and usability tests were administered to 22 subjects in two groups. Three information retrieval tasks were designed according to the characteristics of knowledge states within the ISP for each experiment. The transaction logs were captured and the experimental results were recorded. The users completed a pre-search questionnaire and post-search questionnaire, and interviews were conducted. Findings The study showed that both interactions on components of the digital library and usability scores differed with sequential tasks characterized by knowledge states within the ISP; new usability problems relating to the CNKI were found based on the empirical results. Originality/value Many studies on the usability evaluation of digital libraries focused on the outcome rather than on the ISP. This study proposed an effective approach to usability evaluation based on users’ knowledge states within the ISP.

scholarly journals Academic E-book Usability from the Student’s Perspective

2018 ◽  
Vol 13 (4) ◽  
pp. 70-87
Author(s):  
Esta Tovstiadi ◽  
Natalia Tingle ◽  
Gabrielle Wiersma
Keyword(s):  
User Satisfaction ◽  
Usability Testing ◽  
Think Aloud ◽  
Purchasing Decisions ◽  
Student Expectations ◽  
University Of Colorado ◽  
Usability Tests ◽  
Think Aloud Protocol ◽  
User Expectations ◽  
The University

Abstract Objective – This article describes how librarians systematically compared different e-book platforms to identify which features and design impact usability and user satisfaction. Methods – This study employed task-based usability testing, including the “think-aloud protocol.” Students at the University of Colorado Boulder completed a series of typical tasks to compare the usability and measure user satisfaction with academic e-books. For each title, five students completed the tasks on three e-book platforms: the publisher platform and two aggregators. Thirty-five students evaluated seven titles on nine academic e-book platforms. Results – This study identified each platform’s strengths and weaknesses based on students’ experiences and preferences. The usability tests indicated that students preferred Ebook Central over EBSCO and strongly preferred the aggregators over publisher platforms. Conclusions – Librarians can use student expectations and preferences to guide e-book purchasing decisions. Preferences may vary by institution, but variations in e-book layout and functionality impact students’ ability to successfully complete tasks and influences their affinity for or satisfaction with any given platform. Usability testing is a useful tool for gauging user expectations and identifying preferences for features, functionality, and layout.

The Axiomatic Usability Evaluation Method

2014 ◽  
pp. 353-373
Author(s):  
Yinni Guo
Keyword(s):  
Mobile Phone ◽  
User Satisfaction ◽  
Design Theory ◽  
Evaluation Method ◽  
Usability Evaluation ◽  
Think Aloud ◽  
Usability Problems ◽  
Domain Functional ◽  
Axiomatic Evaluation ◽  
And Control

This chapter introduces a new usability evaluation method, the axiomatic evaluation method, which is developed based on the axiomatic design theory – a formalized design methodology that can be used to solve a variety of design problems. This new evaluation method examines three domains of a product: customer domain, functional domain, and control domain. This method investigates not only usability problems reported by the users, but also usability problems related to customer requirements and usability problems related to control through checking the mapping matrix between the three domains. To determine how well this new usability evaluation method works, a between-subject experiment was conducted to compare the axiomatic evaluation method with the think aloud method. Sixty participants were randomly assigned to use either method to evaluate three popular consumer electronic devices (music player, digital camera, mobile phone) that represented different levels of complexity. Number of usability problems discovered, completion time, and overall user satisfaction were collected. Results show that the axiomatic evaluation method performed better in finding usability problems for the mobile phone. The axiomatic evaluation method was also better at finding usability problems about user expectation and control than the think aloud method. Benefits and drawbacks of using the axiomatic evaluation method are discussed.This chapter introduces a new usability evaluation method, the axiomatic evaluation method, which is developed based on the axiomatic design theory – a formalized design methodology that can be used to solve a variety of design problems. This new evaluation method examines three domains of a product: customer domain, functional domain, and control domain. This method investigates not only usability problems reported by the users, but also usability problems related to customer requirements and usability problems related to control through checking the mapping matrix between the three domains. To determine how well this new usability evaluation method works, a between-subject experiment was conducted to compare the axiomatic evaluation method with the think aloud method. Sixty participants were randomly assigned to use either method to evaluate three popular consumer electronic devices (music player, digital camera, mobile phone) that represented different levels of complexity. Number of usability problems discovered, completion time, and overall user satisfaction were collected. Results show that the axiomatic evaluation method performed better in finding usability problems for the mobile phone. The axiomatic evaluation method was also better at finding usability problems about user expectation and control than the think aloud method. Benefits and drawbacks of using the axiomatic evaluation method are discussed.

Die Effektivität formativer Evaluation bei der Entwicklung gebrauchs- tauglicher Software–eine Fallstudie

2010 ◽  
Vol 54 (1) ◽  
pp. 29-38 ◽  
Author(s):  
Kai Kaspar ◽  
Kai-Christoph Hamborg ◽  
Timo Sackmann ◽  
Julia Hesselmann
Keyword(s):  
Subjektive Bewertung ◽  
Usability Test ◽  
Usability Tests ◽  
Usability Problems

Die vorliegende Fallstudie befasste sich mit der Effektivität von Usability-Tests als Methodik für die Gestaltung gebrauchstauglicher Software. Ein Online-Bookshop wurde zu zwei Zeitpunkten in einem Entwicklungszyklus mithilfe eines Usability-Tests evaluiert. Aus den im ersten Usability-Test identifizierten Usability-Problemen wurden Gestaltungskonsequenzen abgeleitet und umgesetzt. Die so überarbeitete zweite Version des Bookshops wurde einem weiteren Usability-Test unterzogen, in dem wiederum Usability-Probleme erhoben wurden. Die ausgewertete Stichprobe von 22 studentischen Versuchspersonen unterteilte sich in 11 Novizen und 11 Experten, 10 Probanden waren männlichen und 12 weiblichen Geschlechts. Von diesen 22 Probanden nahmen jeweils 11 an einem der beiden Usability-Tests teil, in denen die gleichen drei aufeinander aufbauenden Testaufgaben bearbeitet wurden. Die Befunde zeigen wie angenommen, dass sich die Quantität der erkannten Usability-Probleme vom ersten zum zweiten Usability-Test verringerte. Entgegen der Erwartung wurde jedoch keine Veränderung der Bedeutsamkeit der erhobenen Usability-Probleme verzeichnet. Entsprechend der Untersuchungsannahmen zeigt sich weiterhin ein Effekt der Kombination von Evaluation und Gestaltung auf die subjektive Bewertung von Gefallensaspekten und der ergonomischen Qualität des Bookshops durch die Nutzer. Zudem stellt sich die Expertise der Nutzer als relevanter Faktor für die Häufigkeit explizit geäußerter Kritik am Produkt dar. Konsequenzen für die Praxis und weitere Forschung im Bereich des Usability-Engineerings sowie die Notwendigkeit einer psychologisch begründeten Definition des Konstrukts des Usability-Problems werden diskutiert.

MODEL KEPUTUSAN PEMBELIAN MELALUI IMPLEMENTASI STRATEGI BAURAN PROMOSI PADA BISNIS ONLINE (STUDI KASUS: PADA TRANSPORTASI PT GOJEK INDONESIA)

2018 ◽  
Vol 16 (1) ◽  
pp. 85-92
Author(s):  
Eddy Soeryanto Soegoto
Keyword(s):  
Data Analysis ◽  
Data Collection ◽  
Analysis Procedure ◽  
Sales Promotion ◽  
Survey Method ◽  
Purchase Decision ◽  
Transportation Service ◽  
Analysis Technique ◽  
Community Relationship ◽  
Personal Sale

The goals of the research are to divulge the implementation of promotion mix strategy and its impact on the purchase decision towards the Go-jek online transportation service. The research-er uses a quantitative approach, descriptive and verified design, and survey method. As much as 100 respondents have been drawn using the purposive approach from the population of the Go-jek consumers. The data collection employs questionnaire and the path analysis procedure has been used as the data analysis technique. The findings of this research are as follows: the varia-bles of advertising, sales promotion, personal sale, publicity and community relationship fall into moderate – good category; moreover both partially and simultaneously the variables of advertis-ing, sales promotion, personal sale, publicity and community relationship, as well as direct mar-keting affect the purchase decision.

Sign in / Sign up

Export Citation Format

Share Document