Usability Testing vs. Heuristic Evaluation: A Head-to-Head Comparison

1992 ◽  
Vol 36 (4) ◽  
pp. 409-413 ◽  
Author(s):  
Robert W. Bailey ◽  
Robert W. Allan ◽  
P. Raiello
Keyword(s):  
User Interface ◽  
Graphical User Interface ◽  
Computer Software ◽  
Usability Testing ◽  
Heuristic Evaluation ◽  
User Testing ◽  
Iterative Design ◽  
Usability Test ◽  
Ideal System ◽  
Experimental Group

The importance of user testing, heuristic evaluation and iterative design in the development of computer software programs was examined. In the first study, twenty-five subjects with limited computer experience, were randomly divided into five groups of five subjects each. All groups were asked to perform a telephone bill inquiry task using two character-based screens. After having one group perform, one change per screen was made before beginning the testing of the next group. The system was improved three times. A final experimental group completed the same task using an “ideal” system designed and presented by Molich and Nielsen (1990). Rather than the 29 changes originally suggested by Molich and Nielsen, our results showed that only one change to each of the original screens was necessary to achieve the same performance and preference levels as those demonstrated by their “ideal” system. The same task was repeated using a graphical user interface. A heuristic evaluation suggested up to 43 potential changes, whereas the usability test demonstrated that only two changes optimized performance. These findings demonstrate one of the major weaknesses of heuristic evaluations, and the importance of usability testing in the design and development of human interfaces.

scholarly journals Visual Recognition Of Graphical User Interface Components Using Deep Learning Technique

2020 ◽  
Vol 13 (1) ◽  
pp. 35
Author(s):  
Agyl Ardi Rahmadi ◽  
Aris Sudaryanto
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
User Interface ◽  
Graphical User Interface ◽  
Visual Recognition ◽  
Usability Testing ◽  
Learning Technique ◽  
Different Types ◽  
Vision Technique ◽  
Computer Vision Technique

Graphical User Interface (GUI) building in software development is a process which ideally need to go through several steps. Those steps in the process start from idea or rough sketch of the GUI, then refined into visual design, implemented in coding or prototype, and finally evaluated for its function and usability to discover design problem and to get feedback from users. Those steps repeated until the GUI considered satisfactory or acceptable by the user. Computer vision technique has been researched and developed to make the process faster and easier; for example generating code for implementation, or automatic GUI testing using component images. But among those techniques, there are still few for usability testing purpose. This preliminary research attempted to make the foundation for usability testing using computer vision technique by built minimalist dataset which has images of various GUI components and used the dataset in deep learning experiment for GUI components visual recognition. The experiment results showed deep learning technique suitable for the intended task, with accuracy of 95% for recognition of two different types of components, and accuracy of 72% for six different types of component.

A novel approach for usability evaluation of mobile applications

2021 ◽  
Vol 65 (1) ◽  
pp. 437-441
Author(s):  
Junho Park ◽  
Maryam Zahabi
Keyword(s):  
Graphical User Interface ◽  
Mobile Applications ◽  
Human Subject ◽  
Mobile Apps ◽  
Usability Evaluation ◽  
Heuristic Evaluation ◽  
User Testing ◽  
Novel Approach ◽  
Design Cycle ◽  
Level Model

Mobile applications (apps) have been massively developed and released in recent years. In this competitive market, the users’ adoption of the app or satisfaction greatly depends on its usability. Therefore, tech companies and app developers are looking for quick and easy approaches to evaluate the usability of their products early in the design cycle. The objective of this study was to introduce a novel approach combining the capabilities of the gesture-level model (GLM) and heuristic evaluation to assess the usability of mobile apps in early stages of the design cycle and without the need for costly and time-consuming user testing. The approach can be run on a graphical user interface and includes uncertainties regarding user skill level and distraction. Preliminary results suggested that this approach can be used for usability evaluation of mobile apps; however, its validity and generalizability to other domains need to be validated in the future with human-subject experiments.

scholarly journals PERBANDINGAN ANALISA USABILITY DESAIN USER INTERFACE PADA WEBSITE SHOPEE DAN BUKALAPAK MENGGUNAKAN METODE HEURISTIC EVALUATION

2021 ◽  
Vol 12 (3) ◽  
pp. 188
Author(s):  
Siti Auliaddina ◽  
Adiva Arini Puteri ◽  
Iedam Fardian Anshori
Keyword(s):  
User Interface ◽  
Heuristic Method ◽  
Heuristic Evaluation ◽  
Usability Test ◽  
Usability Tests ◽  
Test User ◽  
Computer Interaction

AbstrakWebsite e-commerce yang merupakan website untuk melakukan transaksi jual beli haruslah memiliki User Interface (UI) yang menarik agar dapat membuat banyak user tertarik menggunakan websitenya dalam transaksi jual beli. User Interface merupakan salah satu faktor yang menentukan banyaknya pengunjung pada suatu website. User Interface dibahas dalam ilmu disiplin HCI (Human and Computer Interaction) atau biasa disebut juga interaksi manusia dan computer. Karena begitu pentingnya User Interface pada suatu web maka diperlukan Usability Test, untuk mengecek seberapa efisien dan efektifnya User Interface website tersebut. Dalam penelitian ini penulis melakukan perbandingan Usability Test dua website e-commerce yaitu Bukalapak dan Shopee yang merupakan 2 dari 3 besar website e-commerce terbesar di Indonesia. Metode yang digunakan adalah metode Heuristic yang semua karakeristiknya dapat digunakan untuk mengetest semua karakteristik User Interface yang efisien dan efektif. Penelitian dilakukan dengan menyebarkan kuesioner kepada 70 orang koresponden. Dari hasil penelitian ini didapat bahwa website Shopee lebih efektif dan efisien untuk digunakan diabndingkan dengan website Bukalapak. Kata Kunci : Interaksi Manusia dan computer, Metode Heursitic, Usability Test, User Interface, Website. AbstractAn e-commerce website which is a website for conducting buying and selling transactions must have an attractive User Interface (UI) in order to make many users interested in using their website in buying and selling transactions. The User Interface is one of the factors that determine the number of visitors to a website. User Interface is discussed in the discipline of HCI (Human and Computer Interaction) or also known as human and computer interaction. Because the User Interface is so important on a website, a Usability Test is needed, to check how efficient and effective the website's User Interface is. In this study, the authors compare the Usability Tests of two e-commerce websites, namely Bukalapak and Shopee, which are 2 of the 3 biggest e-commerce websites in Indonesia. The method used is the Heuristic method which all of its characteristics can be used to test all the characteristics of an efficient and effective User Interface. The research was conducted by distributing questionnaires to 70 correspondents. From the results of this study, it was found that the Shopee website was more effective and efficient to use compared to the Bukalapak website. Keywords : Heuristic Method, Usability Test, Human and Computer Interaction, User Interface, Website.

An Empirical Study of Usability Testing: Heuristic Evaluation Vs. User Testing

2002 ◽  
Vol 46 (8) ◽  
pp. 774-778 ◽  
Author(s):  
Enlie Wang ◽  
Barrett Caldwell
Keyword(s):  
Cost Benefit Analysis ◽  
Low Cost ◽  
Cost Benefit ◽  
Usability Testing ◽  
Heuristic Evaluation ◽  
Benefit Analysis ◽  
User Testing ◽  
Testing Methods ◽  
Usability Problems ◽  
Wide Range

In this study, two different usability-testing methods (Heuristic Evaluation and User Testing) were selected to test the usability of a pre-release version of software searching for Science, Mathematics and Engineering education materials. Our major goal is to compare Heuristic Evaluation and User Testing in terms of efficiency, effectiveness and cost/benefit analysis. We found that Heuristic Evaluation was more efficient than User Testing in finding usability problems (41 vs. 10), while User Testing was more effective than Heuristic Evaluation in finding major problems (70% vs.12%). in general, Heuristic Evaluation appears to be more economic in finding a wide range of usability problems by incurring a low cost in comparison to User Testing. However, User Testing can provide more insightful data from real users such as user's performance and satisfaction.

scholarly journals Perancangan Usability Website Interface Sistem Informasi Kerusakan Laboratorium Universitas AMIKOM Yogyakarta

Respati ◽  
2017 ◽  
Vol 12 (3) ◽  
Author(s):  
Mulia Sulistiyono
Keyword(s):  
Usability Testing ◽  
Ease Of Use ◽  
Mobile Technologies ◽  
Heuristic Evaluation ◽  
User Testing ◽  
First Semester ◽  
Software Applications ◽  
Usability Problems ◽  
Usability Analysis

INTISASIUsability sebagai ukuran kualitas pengalaman pengguna seringkali dikatakan sebagai suatu nilai penerimaan (acceptance) seseorang terhadap suatu produk ketika berinteraksi dengan sebuah antarmuka. Termasuk situs web, aplikasi perangkat lunak, teknologi bergerak, maupun peralatan-peralatan lain yang dioperasikan oleh pengguna. Kata usability mengacu pada sebuah metode yang digunakan untuk meningkatkan kemudahan penggunaan selama proses desain. Sistem Informasi Pelaporan Kerusakan Laboratorium (SIPKL) berfungsi memberikan segala bentuk informasi kerusakan yang terjadi didalam laboratorium. SIPKL merupakan sistem yang baru digunakan mulai semester genap tahun 2014, banyak sekali tanggapan dari para penggunanya yang terdiri dari : asisten praktikum, dosen praktikum, student staff/teknisi lab, serta laboran sehingga perlu ada evaluasi secara detail untuk mengetahui seberapa mudah website SIPKL digunakan salah satunya dengan analisa usability. Banyak metode yang dapat digunakan untuk mengidentifikasi masalah usability terutama dari sisi interface web. Dalam penelitian ini untuk mengukur aspek usability pada SIPKL dengan metode User Testing by Expert dan Heuristic Evaluation. Semua Atribut yang diteliti dengan evaluasi heuristic menunjukkan bahwa kendali dan kebebasan pengguna (Terdapat tombol bantu saat error, nilai : 1,70)  Fitur Bantuan dan Dokumentasi (terdapat menu help, nilai : 1,50), serta  Fleksibilitas dan Efisiensi (tata letak menu yang familiar, nilai : 2,10) memiliki masalah usability dengan tingkat kepuasan yang rendah dibanding atribut yang lain. sedangkan hasil user testing by expert memberikan rekomendasi pengembangan fungsional konten, stimulus bagi pengguna agar lebih mudah menggunakan website SIPKL..Kata kunci: Usability, Website Interface, Sistem Informasi, Usability Testing, Evaluasi Heuristik ABSTRACTUsability as a measure of the quality of the user experience is often said to be a person's acceptance of a product when interacting with an interface. Includes websites, software applications, mobile technologies, and other equipment operated by the user. The usability word refers to a method used to improve ease of use during the design process. . Sistem Informasi Pelaporan Kerusakan Laboratorium (SIPKL) serves to provide all forms of damage information that occurs in the laboratory. SIPKL is a newly used system from the first semester of 2014, a lot of responses from its users consisting of: lab assistant, practicum lecturer, student staff / lab technician, and laboran so there needs to be detailed evaluation to find out how easy SIPKL website used wrong only with usability analysis. Many methods can be used to identify usability problems especially from the web interface side. In this study to measure aspects of usability on SIPKL with User Testing by Expert method and Heuristic Evaluation. All Attributes studied with a heuristic evaluation show that control and freedom of the user (There are auxiliary buttons when error, value: 1.70) Help and Documentation Feature (there is a help menu, value: 1.50), and Flexibility and Efficiency (menu layout which is familiar, value: 2.10) has usability problems with a lower satisfaction level than other attributes., whereas the result of user testing by expert gives recommendations for the development of functional content, the stimulus for the user to make it easier to use the SIPKL website.Keywords :Usability, Website Interface, Information System, Usability Testing, Heuristik Evaluation 

scholarly journals Heuristic Evaluation of Upgradation of Magic XPI Dashboard Web Application

2021 ◽  
Vol 9 (VI) ◽  
pp. 4090-4096
Author(s):  
Ganesh Bhutkar
Keyword(s):  
User Interface ◽  
Graphical User Interface ◽  
Web Application ◽  
Evaluation Method ◽  
New Product ◽  
Summative Evaluation ◽  
Heuristic Evaluation ◽  
Usability Problems ◽  
Web App ◽  
Time And Space Complexity

Magic Monitor is the product developed by Magic Software Enterprises. It is an upgradation of the old Magic XPI dashboard. Currently this new product has all the functionalities which old product possesses along with some additional functionalities. The main objective of this product was to make the product/dashboard more interactive than older one, also to make Graphical User Interface more effective & informative. Hence, we decide to evaluate the product to identify usability issues and the efficiency of the product. To evaluate this product, we decided to use Heuristic Evaluation method since it is quicker and simpler to implement. It is an expert-based summative evaluation method, which also facilitates web-app redesigning and versioning. The product`s efficiency could be determined by it showing lesser time and space complexity and additional functionalities to the older product. It has got some usability problems which are mainly related to user not being aware about hardware underlying the product and entire journey of the messages/requests to be processed, generated by the product. This usability will be resolved soon but currently this product seems to be more efficient than older one.

HEURISTIC EVALUATION FOR MOBILE APPLICATION (STUDI KASUS: APLIKASI DEPO AUTO 2000 TANJUNG API API PALEMBANG)

2017 ◽  
Vol 8 (2) ◽  
pp. 563 ◽  
Author(s):  
Usman Ependi
Keyword(s):  
Real World ◽  
Mobile Application ◽  
Usability Testing ◽  
Heuristic Evaluation ◽  
End User ◽  
Error Prevention ◽  
The Real ◽  
User Control ◽  
Cosmetic Problem

Heuristic evaluation merupakan salah satu bentuk usability testing perangkat lunak yang dinilai oleh pengguna (evaluator). Dalam melakukan heuristic evaluation instrumen penilaian terdiri dari sepuluh (10) pernyataan dengan lima pilihan jawaban dalam skala severity ratings. Dalam penelitian ini heuristic evaluation terhadap aplikasi Depo Auto 2000 Tanjung Api-Api Palembang yang dilakukan oleh 4 evaluator.  Hasil dari heuristic evaluation dikelompokkan kedalam  masing-masing instrumen yaitu visibility of system status dengan nilai 0,75, match between system and the real world dengan nilai 0,25, user control and freedom dengan nilai 0,25, consistency and standards dengan nilai 0,75, error prevention dengan nilai 1, recognition rather than recall dengan nilai 1,25, flexibility and efficiency of use dengan nilai 0,25, Aesthetic and minimalist design dengan nilai 0,25, help users recognize, diagnose, and recover from errors dengan nilai 1 dan Help and documentation dengan nilai 0. Dari hasil heuristic evaluation yang dilakukan menunjukkan bahwa evaluator memberikan nilai 0 dan 1 aplikasi Depo Atuo 2000 Tanjung Api-Api Palembang. Hasil penilaian tersebut menunjukkan bahwa aplikasi yang buat tidak ada masalah usability dan hanya memiliki cosmetic problem sehingga aplikasi Depo Auto 2000 Tanjung Api Api Palembang  dapat dinyatakan layak untuk didistribusikan kepada pengguna akhir (end user). 

Sign in / Sign up

Export Citation Format

Share Document