Identification of Web Usability Problems and Interaction Patterns with the RealEYES-iAnalyzer

Identifying Web Usability Problems from Eye-Tracking Data

10.14236/ewic/hci2007.12 ◽

2007 ◽

Cited By ~ 49

Author(s):

Claudia Ehmke ◽

Stephanie Gray Wilson

Keyword(s):

Eye Tracking ◽

Tracking Data ◽

Web Usability ◽

Usability Problems

Download Full-text

reVISit: Looking Under the Hood of Interactive Visualization Studies

10.31219/osf.io/cbw36 ◽

2021 ◽

Author(s):

Carolina Nobre ◽

Dylan Wootton ◽

Zach Cutler ◽

Lane Harrison ◽

Hanspeter Pfister ◽

...

Keyword(s):

Performance Metrics ◽

Interactive Visualization ◽

Interaction Patterns ◽

Design Decisions ◽

Pilot Studies ◽

Analysis Methodology ◽

Usability Problems ◽

Analysis Methods ◽

Analysis Strategies ◽

Interactive Visualizations

Quantifying user performance with metrics such as time and accuracy does not show the whole picture when researchers evaluate complex, interactive visualization tools. In such systems, performance is often influenced by different analysis strategies that statistical analysis methods cannot account for. To remedy this lack of nuance, we propose a novel analysis methodology for evaluating complex interactive visualizations at scale. We implement our analysis methods in reVISit, which enables analysts to explore participant interaction performance metrics and responses in the context of users' analysis strategies. Replays of participant sessions can aid in identifying usability problems during pilot studies and make individual analysis processes salient. To demonstrate the applicability of reVISit to visualization studies, we analyze participant data from two published crowdsourced studies. Our findings show that reVISit can be used to reveal and describe novel interaction patterns, to analyze performance differences between different analysis strategies, and to validate or challenge design decisions.

Download Full-text

Walkthroughs in Web Usability

Human Computer Interaction Research in Web Design and Evaluation ◽

10.4018/978-1-59904-246-6.ch011 ◽

2007 ◽

pp. 229-256

Author(s):

Hokyoung Ryu

Keyword(s):

Website Evaluation ◽

Web Usability ◽

Usability Problems ◽

Improve Accuracy ◽

Cognitive Walkthrough

The evaluators of a website have a need for robust and easy-to-use usability inspection methods to help them to systematically identify the possible usability problems of the website being analysed. Three usability inspection methods – heuristic walkthrough (HW), cognitive walkthrough (CW), and activity walkthrough (AW) – are reviewed in this chapter. Reviewing that work, this chapter discusses the relative advantages and weaknesses of all of the techniques, and suggestions for web evaluation are offered, with a short website example. Based on these analyses, we suggest some changes to website evaluation to improve accuracy and reliability of the current walkthrough methods; however, this chapter is not a comparison between the walkthrough techniques in order to determine which technique is best at detecting usability problems of a website.

Download Full-text

Exploring the impact of interface signs’ interpretation accuracy, design, and evaluation on web usability

Journal of Systems and Information Technology ◽

10.1108/jsit-03-2014-0019 ◽

2014 ◽

Vol 16 (4) ◽

pp. 250-276 ◽

Cited By ~ 5

Author(s):

Muhammad Nazrul Islam ◽

Franck Tétard

Keyword(s):

Empirical Research ◽

Research Approach ◽

User Behavior Analysis ◽

Content Type ◽

Web Usability ◽

Ui Design ◽

Usability Test ◽

Usability Problems ◽

Intuitive Interface ◽

The Impact

Purpose – The purpose of this empirical study was to address two important concerns of Web usability: how user-intuitive interface signs affect Web usability and how applying semiotics (i.e. the doctrine of signs) in user interface (UI) design and evaluation helps to improve usability. Design/methodology/approach – An empirical research approach is followed here to conduct three user tests. These tests were conducted on a Web application with 17 test participants. Data were gathered through laboratory-based think-aloud usability test, questionnaires and interviews. Following an empirical research approach, statistics and user behavior analysis were used to analyze the data. Findings – This study explores two important concerns of UI design and evaluation. First, users’ interpretation accuracy of interface signs impact on Web usability. The study found that users’ interpretation of signs might be accurate, moderate, conflicting, erroneous or incapable; user-intuitive interface signs led participants to interpret signs’ meaning accurately; and users’ inaccurate interpretation of one or a few task-related interface sign(s) led users to usability problems, resulting in participants performing tasks with lower task-completion performance. Second, considering semiotics perception in UI design and evaluation is important to improve Web usability. This study showed that interface signs, when re-designed considering the semiotics guidelines, have increased the end-users’ interpretation accuracy and the interface signs’ intuitiveness. This study also provides a small set of semiotics guidelines for sign design and evaluation. Originality/value – This study empirically demonstrated that signs’ intuitiveness impact on Web usability and that considering the semiotics perception in sign design and evaluation is important to improve Web usability. These outcomes are valuable in a number of ways to HCI researchers and practitioners: the results provide awareness of the importance of user-intuitive interface signs in UI design; practitioners can easily adopt the concept of interpretation accuracy classification to conduct a sign test to obtain an “overall impression of interface signs’ intuitiveness”; practitioners can easily adopt the methodological approach followed in this study to conduct usability test without additional resources; and the results raised important fundamental questions for future research such as “what does a practitioner need to be aware of when designing or evaluating interface signs?”

Download Full-text

Exploring the relationship between web presence and web usability for universities

Program electronic library and information systems ◽

10.1108/prog-04-2014-0024 ◽

2016 ◽

Vol 50 (2) ◽

pp. 157-174 ◽

Cited By ~ 8

Author(s):

Serhat Peker ◽

Seyma Kucukozer-Cavdar ◽

Kursat Cagiltay

Keyword(s):

Usability Evaluation ◽

Strong Positive Correlation ◽

Content Type ◽

Web Usability ◽

Web Presence ◽

University Websites ◽

Usability Problems ◽

The University ◽

The Relationship ◽

Practical Implications

Purpose – The purpose of this paper is to statistically explore the relationship between web usability and web presence of the universities. As a case study, five Turkish universities in different rankings which were selected from Webometrics rankings were evaluated and compared. Design/methodology/approach – Two different methods were employed for performing usability evaluation of the selected universities: a user testing was used to measure the user performance on the selected tasks and a questionnaire to assess the user satisfaction on the website use. Both usability evaluation methods were applied on the pre-determined tasks for each university by participation of 20 subjects. After the usability evaluation, the universities were ranked in terms of usability results and finally, the relationship between web usability and web presence of universities was statistically investigated by using Kendall’s rank correlation. Findings – Several common usability problems which were asserted by related previous studies were identified at the end of usability evaluation of university websites. The usability results also revealed that selected Turkish university websites suffer from numerous usability problems. Further, a strong positive correlation (p < 0.05) between the usability of the university websites and their web presences were identified. Hence, the participants showed a higher success and satisfaction while performing the tasks on the university websites which have strong web presences. Practical implications – The findings from this study have practical implications for universities. Correlation results showed that universities can improve their web usability by giving importance to their web presence volumes. Universities can estimate their web usability levels by investigating their web presence rankings and they can also raise their rankings in Webometrics ranking system by improving the usability of their websites. Moreover, university web developers can design more usable and more user-friendly websites by avoiding usability and design problems identified through usability evaluation. Originality/value – Different from the prior research efforts focussing on usability of educational web pages, this study contributes to the growing literature by statistically exploring the relationship between web presence and web usability of universities. This study is also precious from the point of view that it is one of the first attempts to evaluate and compare usability levels of a set of universities’ websites from Turkey.

Download Full-text

Evaluasi Usability Website Berita Online Prokal.Co Menggunakan Evaluasi Heuristic dan Webuse

Jurnal Teknologi Informasi dan Ilmu Komputer ◽

10.25126/jtiik.2020753707 ◽

2020 ◽

Vol 7 (5) ◽

pp. 911

Author(s):

M. Gilvy Langgawan Putra ◽

Nisya Rani Sabilla ◽

Sri R. Natasia

Keyword(s):

User Interface ◽

Heuristic Method ◽

Evaluation Study ◽

Usability Evaluation ◽

Success Factor ◽

Evaluation Tool ◽

Web Usability ◽

Usability Problems ◽

Design Alternatives ◽

Search For Information

Website PROKAL.co merupakan portal berita wilayah Kalimantan, yang diharapkan dapat membantu masyarakat maupun pihak PROKAL sebagai pengguna, agar dapat mencari informasi yang dibutuhkan dengan mudah. Hasil wawancara dengan pihak PROKAL menunjukkan bahwa, terdapat permasalahan usability yang berkaitan dengan faktor keberhasilan usability pada PROKAL.co, yaitu learnability dan errors. Sejak didirikannya PROKAL.co pada tahun 2015, evaluasi terkait usability pada website PROKAL.co belum pernah dilakukan. Hal tersebut mempengaruhi rencana PROKAL dalam melakukan redesain tampilan website PROKAL.co pada tahun 2020, dikarenakan PROKAL tidak mengetahui kebutuhan dan permasalahan yang dialami pengguna dan masih belum memiliki gambaran yang jelas diperbaiki seperti apa tampilan website ke depannya. Oleh karena itu, dilakukan penelitian evaluasi usability menggunakan metode Heuristic agar dapat ditemukan permasalahan dari website PROKAL.co dengan mengacu pada prinsip-prinsip heuristic. Kemudian, untuk dapat melibatkan pengguna PROKAL.co, maka digunakan pula metode Web Usability Evaluation Tool (WEBUSE). Penelitian ini dilakukan dengan 5 tahapan utama, yaitu establishing requirement untuk menemukan masalah usability, design alternatives untuk merancang perbaikan tampilan berupa ide desain, prototyping untuk mengimplementasi dan membangun desain, evaluating untuk mengevaluasi hasil prorotype dengan pihak PROKAL, dan kesimpulan. Berdasarkan hasil evaluasi yang dilakukan, terdapat 2 indikator evaluasi yang sangat memerlukan perbaikan, 7 indikator evaluasi memerlukan perbaikan dengan prioritas tinggi, dan 1 indikator evaluasi memerlukan perbaikan dengan prioritas rendah. Selain itu, dihasilkan usulan rekomendasi tampilan berupa prototype sebanyak 11 desain tampilan perbaikan pada desktop dan 30 desain tampilan mobile website PROKAL.co yang telah disesuaikan dan disetujui dengan kebutuhan PROKAL. Hasil yang diperoleh ini dapat dijadikan acuan oleh website PROKAL.co dalam melakukan perbaikan. AbstractWebsite PROKAL.co is the Kalimantan regional news portal, this website expected to facilitate its users including PROKAL to search for information that users need. Based on the results of interviews with PROKAL, there are usability issues related to the success factor of website PROKAL.co, there are learnability and errors. Since founded in 2015, the evaluation related to the usability of the website has yet to be performed. It affects PROKAL's plan to redesign the user interface of the website in 2020, because PROKAL still doesn’t know the needs and problems experienced by users also what website will look like in the future. Based on the description above, a usability evaluation study was conducted using the Heuristic method in order to find problems from the PROKAL.co website with reference to heuristic principles. Then, to be able to involve PROKAL.co users, the Web Usability Evaluation Tool (WEBUSE) method is also used. This research was conducted with 5 main stages, those are establishing requirements to find usability problems, design alternatives to design the improvements with the form of design ideas, protoyping to implement and build designs, evaluating to evaluate the prototype results, and conclusions. Based on the results of the evaluation, there are 2 evaluation indicators that really need improvement, 7 evaluation indicators need improvement with high priority, and 1 evaluation indicator require improvement with low priority. In addition, there were proposed recommendations for user interface in the form of 11 prototype user interface designs for desktop improvements and 30 designs for the mobile website PROKAL.co that have been adjusted and approved to the needs of PROKAL. The results obtained can be used as a reference by the PROKAL.co website in making improvements.<div> </div>

Download Full-text

Die Effektivität formativer Evaluation bei der Entwicklung gebrauchs- tauglicher Software–eine Fallstudie

Zeitschrift für Arbeits- und Organisationspsychologie A&O ◽

10.1026/0932-4089/a000003 ◽

2010 ◽

Vol 54 (1) ◽

pp. 29-38 ◽

Cited By ~ 4

Author(s):

Kai Kaspar ◽

Kai-Christoph Hamborg ◽

Timo Sackmann ◽

Julia Hesselmann

Keyword(s):

Subjektive Bewertung ◽

Usability Test ◽

Usability Tests ◽

Usability Problems

Die vorliegende Fallstudie befasste sich mit der Effektivität von Usability-Tests als Methodik für die Gestaltung gebrauchstauglicher Software. Ein Online-Bookshop wurde zu zwei Zeitpunkten in einem Entwicklungszyklus mithilfe eines Usability-Tests evaluiert. Aus den im ersten Usability-Test identifizierten Usability-Problemen wurden Gestaltungskonsequenzen abgeleitet und umgesetzt. Die so überarbeitete zweite Version des Bookshops wurde einem weiteren Usability-Test unterzogen, in dem wiederum Usability-Probleme erhoben wurden. Die ausgewertete Stichprobe von 22 studentischen Versuchspersonen unterteilte sich in 11 Novizen und 11 Experten, 10 Probanden waren männlichen und 12 weiblichen Geschlechts. Von diesen 22 Probanden nahmen jeweils 11 an einem der beiden Usability-Tests teil, in denen die gleichen drei aufeinander aufbauenden Testaufgaben bearbeitet wurden. Die Befunde zeigen wie angenommen, dass sich die Quantität der erkannten Usability-Probleme vom ersten zum zweiten Usability-Test verringerte. Entgegen der Erwartung wurde jedoch keine Veränderung der Bedeutsamkeit der erhobenen Usability-Probleme verzeichnet. Entsprechend der Untersuchungsannahmen zeigt sich weiterhin ein Effekt der Kombination von Evaluation und Gestaltung auf die subjektive Bewertung von Gefallensaspekten und der ergonomischen Qualität des Bookshops durch die Nutzer. Zudem stellt sich die Expertise der Nutzer als relevanter Faktor für die Häufigkeit explizit geäußerter Kritik am Produkt dar. Konsequenzen für die Praxis und weitere Forschung im Bereich des Usability-Engineerings sowie die Notwendigkeit einer psychologisch begründeten Definition des Konstrukts des Usability-Problems werden diskutiert.

Download Full-text