Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ)

Author(s):  
Andreas Hinderks ◽  
Francisco José Domínguez-Mayo ◽  
Anna-Lena Meiners ◽  
Jörg Thomaschewski

In recent years, user experience questionnaires have established themselves to measure various aspects of User Experience (UX). In addition to these questionnaires, an evaluation tool is usually offered so that the results of a study can be evaluated in the light of the questionnaire. As a rule, the evaluation consists of preparing the data and comparing it with a benchmark. Often this interpretation of the data is not sufficient as it only evaluates the current User Experience. However, it is desirable to determine exactly where there is a need for action. The User Experience Questionnaire (UEQ) is a common and valid questionnaire with an evaluation tool to measure and analyse the User Experience for a product or service. In our article we present an approach that evaluates the results from the User Experience Questionnaire using the importance-performance analysis (IPA). The aim is to create another possibility to interpret the results of the UEQ and to derive recommendations for action from them. In a study with 467 participants, we validated the approach presented with YouTube, WhatsApp, and Facebook. The results show that the IPA provides additional insights from which further recommendations for action can be derived.

2021 ◽  
Vol 8 (5) ◽  
pp. 1057
Author(s):  
Fara Regina Isadora ◽  
Buce Trias Hanggara ◽  
Yusi Tyroni Mursityo

<p class="Abstrak">Rumah Sakit Semen Gresik merupakan fasilitas kesehatan yang ada di Kabupaten Gresik dengan akreditasi tingkat paripurna. Rumah Sakit Semen Gresik di kondisi pandemi saat ini mengalami penurunan jumlah pasien dan pendapatan, sehingga Rumah Sakit Semen Gresik berencana untuk menghadirkan layanan kesehatan yang dapat dilakukan di rumah menggunakan aplikasi untuk memudahkan pasien dalam mendapatkan layanan Kesehatan tanpa datang ke rumah sakit. Aplikasi yang dibangun harus memberikan kenyamanan saat digunakan oleh pengguna, maka dari itu perlu adanya rancangan <em>user experience. Design thinking </em>merupakan metode yang digunakan untuk merancang <em>user experience </em>pada aplikasi HomeCare dengan mendefinisikan permasalahan serta memberikan solusi desain yang dapat menyelesaikan permasalahan tersebut. Solusi desain selanjutnya diuji menggunakan <em>user experience questionnaire </em>(UEQ) untuk mengetahui apakah solusi desain yang dirancang sudah menyelesaikan permasalahan yang dialami oleh calon pengguna. Hasil dari pengujian menggunakan UEQ yaitu, untuk aplikasi HomeCare dengan pengguna pasien memiliki nilai <em>mean</em> tiap skala UEQ yang berada pada kategori positif dengan semua skala UEQ berada pada kategori baik kecuali skala <em>dependability </em>yang berada pada kategori sangat baik, sedangkan untuk aplikasi HomeCare Giver dengan pengguna tenaga kesehatan memiliki nilai <em>mean</em> tiap skala UEQ yang juga berada pada kategori positif dengan semua skala UEQ berada pada kategori baik kecuali skala <em>attractiveness </em>dan <em>novelty </em>yang berada pada kategori sangat baik<em>. </em>Sehingga aplikasi HomeCare dan HomeCare Giver memiliki rancangan <em>user experience </em>yang baik.</p><p class="Abstrak"><em><strong>Abstract</strong></em></p><p class="Judul2"><em>Semen Gresik Hospital is a health facility in Gresik Regency </em><em>with a paripurna level of accreditation</em><em>. Semen Gresik Hospital in a pandemic condition is currently experiencing a decrease in the number of patients, so that Semen Gresik Hospital plans to provide health services that can be done at home using an application to make it easier for patients to get health services without coming to the hospital. Applications that are built must provide comfort when used by users, therefore there is a need for a user experience design. Design thinking is a method used to design user experiences on the HomeCare application by defining problems and providing design solutions that can solve these problems. The design solution is then tested using a user experience questionnaire (UEQ) to find out whether the design solution designed has resolved the problems experienced by potential users. The results of the test using UEQ are, for the HomeCare application whose users are patient, the mean value of each UEQ scale is in the positive category with all UEQ scales in the good category except for the dependability scale which is in the very good category, while for the HomeCare Giver application whose the users are health workers, has a mean value of each UEQ scale which is also in the positive category with all UEQ scales in the good category except the attractiveness and novelty scales which are in the very good category. This can be concluded that HomeCare and HomeCare Giver applications have a good user experience design.</em></p><p class="Abstrak"><em><strong><br /></strong></em></p>


2020 ◽  
Vol 6 (2) ◽  
pp. 89-95
Author(s):  
Cerah Ayunda Prawastiyo ◽  
Indra Hermawan

Penggunaan internet di Indonesia khususnya di instansi pendidikan terutama perguruan tinggi yaitu mengandalkan internet untuk mencari kumpulan informasi dan referensi terkait dengan mata kuliah. Salah satu unit di sebuah perguruan tinggi yang menggunakan internet dengan memanfaatkan sistem informasi berbasis website adalah perpustakaan Politeknik Negeri Jakarta (PNJ). Website berperan penting untuk instansi sebagai acuan website yang baik salah satunya dapat dinilai dari sisi User Interface (UI) yang memiliki tampilan menarik dan User Experience (UX) untuk meningkatkan kenyamanan pengguna website. Dalam pengembangan front end website perpustakaan menggunakan metode User Centered Design (UCD), framework bootstrap, bahasa pemrograman HTML5, CSS dan Javascript. Pada tahap evaluasi design dalam bentuk wireframe menggunakan metode System Usability Scale (SUS) mendapatkan skor 83, pengujian black box untuk mengukur fungsionalitas website mendapatkan hasil sesuai dengan skenario, pengujian User Experience Questionnaire (UEQ) untuk mengukur tingkat kenyamanan pengguna website mendapatkan hasil positif.


2019 ◽  
Vol 35 (S1) ◽  
pp. 31-32
Author(s):  
Elisa Puigdomenech Puig ◽  
Elisa Poses Ferrer ◽  
Lina Masana ◽  
Mireia Espallargues

IntroductionDue to the specific characteristics and challenges of mobile health (mHealth) technologies there is a need to have assessment tools based on their particularities to be used by health technology assessment (HTA) agencies and evaluation experts. In the development of a comprehensive and practical evaluation tool for the evaluation of mHealth solutions we aimed to include the views and opinions of key stakeholders: health professionals, developers, hospital managers, HTA agencies, patients and general public.MethodsFocus groups and an online modification of the Delphi technique are being used to discuss and agree on domains and criteria to be included in the mHealth assessment tool. Domains and criteria used for health apps evaluation were drawn from a literature review on the topic. The initial list includes 95 criteria grouped into the following domains: purpose of the app, privacy and security, clinical effectiveness, content of the intervention, user experience and usability, interoperability, expenses, impact on the organization, and legal and ethical aspects. Data coming from focus groups is currently being analyzed from a thematic and content analysis perspective.ResultsFocus groups with professionals have showed that the most important domains to be considered when evaluating health apps are those related with security, user experience, and clinical effectiveness. Some criteria were considered to be mandatory (mainly regarding safety issues), on which a first step assessment should indicate whether the app ‘pass or fails’ for the subsequent throughout assessment. Focus groups with patients will provide insight on critical aspects related to the choice, use and adherence to a health app.ConclusionsInsights from main stakeholders on the design of the tool for mHealth assessment are relevant and complementary between them. Next steps include (i) the agreement of criteria by using an online modification of the Delphi Technique and (ii) piloting of the tool.


Technologies ◽  
2019 ◽  
Vol 7 (2) ◽  
pp. 31 ◽  
Author(s):  
Costas Boletsis ◽  
Stian Kongsvik

The drum-like virtual reality (VR) keyboard is a contemporary, controller-based interface for text input in VR that uses a drum set metaphor. The controllers are used as sticks which, through downward movements, “press” the keys of the virtual keyboard. In this work, a preliminary feasibility study of the drum-like VR keyboard is described, focusing on the text entry rate and accuracy as well as its usability and the user experience it offers. Seventeen participants evaluated the drum-like VR keyboard by having a typing session and completing a usability and a user experience questionnaire. The interface achieved a good usability score, positive experiential feedback around its entertaining and immersive qualities, a satisfying text entry rate (24.61 words-per-minute), as well as moderate-to-high total error rate (7.2%) that can probably be further improved in future studies. The work provides strong indications that the drum-like VR keyboard can be an effective and entertaining way to type in VR.


Author(s):  
Miguel Saona-Vallejos ◽  
Michael Thomas

This chapter investigates the user experience of the language learning platform Busuu as a tool for learning Spanish as a Foreign Language (SFL). Social constructionism has been highlighted by previous research as the theory on which Busuu is based, however, Álvarez concluded that Busuu constitutes an ecological system of nested semiotic spaces where pedagogical elements and principles from different theories of language learning interweave in complementary ways. Following a review of existing research, the chapter analyses data arising from a study involving a mixed group of university students who used the premium version of Busuu for four weeks. Data were collected via pre- and post-tests, a user experience questionnaire, and individual interviews, and were analysed using descriptive statistics and thematic analysis. Findings suggest that Busuu did not fully satisfy the requirements of a social network in terms of ease of participation, communication, and collaboration. Further research is required to explore the implications of usability testing for the design of effective SNSLL.


Sign in / Sign up

Export Citation Format

Share Document