scholarly journals Comparing different eye tracking cues when using theretrospective think aloud method in usability testing

Author(s):  
Anneli Olsen ◽  
Linnea Smolentzov ◽  
Tommy Strandvall
2008 ◽  
Vol 2 (4) ◽  
Author(s):  
Aulikki Hyrskykari ◽  
Saila Ovaska ◽  
Pävi Majaranta ◽  
Kari-Jouko Räihä ◽  
Merja Lehtinen

For a long time, eye tracking has been thought of as a promising method for usability testing. During the last couple of years, eye tracking has finally started to live up to these expectations, at least in terms of its use in usability laboratories. We know that the user’s gaze path can reveal usability issues that would otherwise go unnoticed, but a common understanding of how best to make use of eye movement data has not been reached. Many usability practitioners seem to have intuitively started to use gaze path replays to stimulate recall for retrospective walk through of the usability test. We review the research on thinkaloud protocols in usability testing and the use of eye tracking in the context of usability evaluation. We also report our own experiment in which we compared the standard, concurrent think-aloud method with the gaze path stimulated retrospective think-aloud method. Our results suggest that the gaze path stimulated retrospective think-aloud method produces more verbal data, and that the data are more informative and of better quality as the drawbacks of concurrent think-aloud have been avoided.


Author(s):  
Ni Luh Putu Ratih Indriyani ◽  
Gede Rasben Dantes ◽  
Kadek Yota Ernanda Aryanto

This research is aimed to determine the results of the usability analysis from the website Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya viewed from the user side as well as knowing the recommendation of website improvement of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya from usability aspect. The methods used are Usability Testing of Performance Measurement and Retrospective Think Aloud (RTA) techniques and the dissemination of SUS questionnaires.  The results showed that the Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya still not effective, it is seen from the error or mistake made by users of lecturers and students while doing the task. Statistically website Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya has been efficient for lecture but not efficient for college students users. For lecturers there are 6 out of 10 tasks that do not have significant time difference, while for  college students there are 4 out of 10 tasks that do not have significant time difference. From the aspect of user satisfaction, both lecturers and college students feel still less satisfied using the website of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya, this can be seen from the SUS questionnaire scores of lecturers of 63.28 and college students users of 58.44. Based on the analysis result, it can be concluded that the Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya has not fulfilled the criteria of products that have good usability, because the three aspects (effectiveness, efficiency and user satisfaction) have not been met. Based on the above, the recommendation of Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya website is focused on adjustment of display, language and term change, feature addition, menu name adjustment, menu structure and menu layout, content addition and menu simplification. Repairs done by making wireframe recommendation page Sekolah Tinggi Pariwisata (STIPAR) Triatma Jaya.


2015 ◽  
Vol 3 ◽  
pp. 482-486 ◽  
Author(s):  
Terézia Kvasnicová ◽  
Iveta Kremeňová

Websites, nowadays, are used not only as a sales method and information tool, but also as a communication tool. Almost every company has a website. Universities and colleges understand their strength, too. In this article, we describe theory of usability of university website and one of the usability testing methods—eye tracking. We use eye tracking to assess the usability of University of Žilina website. We present and use different analysis: Scan Path and Focus map. We identify many usability problems whose removal will help to create new pages and, thus, increasing their effectiveness.


Author(s):  
William J. Gibbs ◽  
Joseph E. McKendrick

News providers today offer interactive sources that engage people, enable them to build community, and to participate in the news. At the same time, the digital interfaces through which people access the news are continuingly evolving, diverse, and oftentimes visually complex. How these factors shape human information seeking in news-oriented virtual communities is a relatively new area of study and therefore greater understanding of their influence on human behavior is of much practical value. In this chapter, the authors explore trends and developments in news-oriented virtual communities. They review several data collection and analysis techniques such as content analysis, usability testing and eye-tracking and propose that these techniques and associated tools can aid the study of news communities. They examine the implications these techniques have for better understanding human behavior in virtual communities as well as for improving the design of these environments.


2020 ◽  
Author(s):  
Katherine L. Dauber-Decker ◽  
Melissa Basile ◽  
D'Arcy King ◽  
Jennifer Polo ◽  
Karina Calise ◽  
...  

BACKGROUND Cystic fibrosis (CF) is a life-limiting genetic disease that causes chronic lung infections. We developed an internet-based decision aid (decision aid) to help CF patients make better informed decisions regarding treatments and advance care planning (ACP). We built the decision aid around two major treatment decisions: whether or not to have a lung transplant, and whether or not to agree to intubation. OBJECTIVE To present results from iterative usability testing of the InformedChoices Cystic Fibrosis advance care planning decision aid among adults with cystic fibrosis, their clinicians and family caregivers. METHODS We performed a patient needs assessment and “think aloud” usability testing with CF patients, their surrogates, and clinicians caring for CF patients. “Think aloud” participants provided feedback while navigating the decision aid and answered surveys. Session transcripts and survey results were categorized into common, generalizable themes and optimizations for improving content, comprehension, and navigation. RESULTS Participants gave the decision aid an average System Usability Scale (SUS) score of 88.33 (“excellent”). Comments were coded into three themes: Functionality, Visibility and Navigation, and Content and Usefulness. Areas for improvement included reducing repetition, enhancing comprehension, and changing the flow. CONCLUSIONS Usability testing revealed areas for potential improvement. Testing also yielded positive feedback, suggesting the decision aid’s future success.Integrating changes prior to implementation should improve the decision aid’s comprehension, navigation, and usefulness, and lead to greater adoption.


Author(s):  
Dewa Ayu Putu Ari Widhiani ◽  
I Ketut Resika Arthana ◽  
I Made Ardwi Pradnyana

Penelitian ini bertujuan untuk mengetahui tingkat kepuasan pengguna dan mengevaluasi SIAK Undiksha ditinjau dari pengguna mahasiswa menggunakan metode Usability Testing dengan teknik Firstclick Usability Testing, Performance Measurement, Retrospective Think Aloud (RTA), kuisoner System Usability Scale (SUS) serta memberikan rekomendasi perbaikan terhadap sistem tersebut berdasarkan atas hasil penelitian. Ada beberapa aspek yang dikaji dalam penelitian ini yaitu efektivitas (effectiveness), efisiensi (efficiency), tingkat kesalahan (error), dan kepuasan pengguna (satisfaction) menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa.Populasi dari penelitian ini yaitu mahasiswa Undiksha dengan melibatkan 385 responden kuisioner SUS dan 20 orang responden usability testing. Hasil penelitian berdasarkan analisis Mann Whitney U-test dan SUS menunjukkan bahwa (1) SIAK Undiksha ditinjau dari pengguna mahasiswa sudah efektif akan tetapi masih terdapat beberapa error yang ditemukan dalam sistem, (2) SIAK Undiksha ditinjau dari pengguna mahasiswa sudah efisien dilihat dari tidak adanya perbedaan yang signifikan waktu pengerjaan tugas kelompok mahir dan kelompok pemula, dan (3) Pengguna merasa kurang puas menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa dilihat dari skor kuisioner SUS sebesar 61,6.Dengan demikian berdasarkan hasil analisis data tersebut disimpulkan bahwa SIAK Undiksha ditinjau dari pengguna mahasiswa sudah memenuhi kriteria usability baik akan tetapi pengguna belum puas  saat menggunakan SIAK Undiksha ditinjau dari pengguna mahasiswa. Hal ini dapat dilihat pada penilaian tingkat efektivitas, efisiensi, tingkat kesalahan dan kepuasan pengguna, SIAK Undiksha ditinjau dari pengguna tersebut hanya berhasil memenuhi 2 dari 4 aspek. Oleh sebab itu, rekomendasi perbaikan dalam penelitian ini difokuskan untuk mengubah tata letak (layout) halaman dan menu navigasi sesuai hasil data penyebab kesalahan (error) pengguna dan menyederhanakan penggunaa Bahasa. Perbaikan dilakukan dengan membuat wireframe halaman utama SIAK Undiksha itinjau dari pengguna mahasiswa, halaman menu prosedur, halaman submenu biodata, halaman ubah biodata, halaman statistic nilai mahasiswa dan halaman cetak kartu rencana studi.


Author(s):  
Baqar Ali Zardari ◽  
Zahid Hussain ◽  
Aijaz Ahmed Arain ◽  
Wajid H. Rizvi ◽  
Muhammad Saleem Vighio

Sign in / Sign up

Export Citation Format

Share Document