scholarly journals Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)

2019 ◽  
Author(s):  
Stefan Sigle ◽  
Pilar Barriga ◽  
Francisco Javier Correa Fernández ◽  
Christian Juhra ◽  
Steffen Härtel ◽  
...  
Keyword(s):  
Information Systems ◽  
User Satisfaction ◽  
Information Model ◽  
Consumer Information ◽  
Medication Information ◽  
Task Success ◽  
Task Time ◽  
Reference Implementation ◽  
Online Consumer ◽  
And Task

BACKGROUND Medication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (<i>P</i>=.02) and task time (<i>P</i>=.03), while physicians did not have significant differences in SUS scores (<i>P</i>=.83) and task time (<i>P</i>=.72). For pharmacists, a significant difference in SUS scores (<i>P</i>&lt;.001) and task time (<i>P</i>=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.

scholarly journals Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study

10.2196/16648 ◽  
2020 ◽  
Vol 8 (6) ◽  
pp. e16648
Author(s):  
Stefan Sigle ◽  
Pilar Barriga ◽  
Francisco Javier Correa Fernández ◽  
Christian Juhra ◽  
Steffen Härtel ◽  
...  
Keyword(s):  
Information Systems ◽  
User Satisfaction ◽  
Information Model ◽  
Consumer Information ◽  
Medication Information ◽  
Task Success ◽  
Task Time ◽  
Reference Implementation ◽  
Online Consumer ◽  
And Task

Background Medication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective The objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results A total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. Conclusions The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.

scholarly journals User Satisfaction Reward Estimation Across Domains: Domain-independent Dialogue Policy Learning

2021 ◽  
Vol 12 (2) ◽  
pp. 81-114
Author(s):  
Stefan Ultes ◽  
Wolfgang Maier
Keyword(s):  
User Satisfaction ◽  
Objective Measure ◽  
Dialogue Systems ◽  
Success Rates ◽  
Estimation Model ◽  
Spoken Dialogue Systems ◽  
Task Success ◽  
Domain Independent ◽  
Similar Task ◽  
And Task

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work that is based on reinforcement learning employs an objective measure like task success for modelling the reward signal, we propose to use a reward signal based on user satisfaction. We propose a novel estimator and show that it outperforms all previous estimators while learning temporal dependencies implicitly. We show in simulated experiments that a live user satisfaction estimation model may be applied resulting in higher estimated satisfaction whilst achieving similar success rates. Moreover, we show that a satisfaction estimation model trained on one domain may be applied in many other domains that cover a similar task. We verify our findings by employing the model to one of the domains for learning a policy from real users and compare its performance to policies using user satisfaction and task success acquired directly from the users as reward.

scholarly journals Perancangan User Experience Menggunakan Metode Five Planes Pada Aplikasi Mobile Kode Funding Di PT Kodetag Global Teknotama

2019 ◽  
Vol 9 (1) ◽  
pp. 55-69
Author(s):  
Paramita Retno Utami ◽  
Firman Ardiansyah ◽  
Muhammad Zubair
Keyword(s):  
User Interface ◽  
Success Rate ◽  
User Experience ◽  
User Satisfaction ◽  
Usability Testing ◽  
Task Completion ◽  
Think Aloud ◽  
Task Success ◽  
Funding Application ◽  
And Task

ABSTRACT Kode Funding Application is a cooperative mobile-based application which is a service product of PT Kodetag Global Teknotama. This application is designed to have features of cooperatives transactions, but it has not been designed with user experience (UX) and user interface optimization (UI) to meet the needs and achieve user satisfaction. As the consequence, when the user used the application, they faced difficulties in making transactions on the application such as data input errors. These following things will affect the performance of the user while making the transactions.The design of user experience and user interface optimization are designed to build an Android mobile application prototype for Koperasi Simpan Pinjam dan Pembiayaan Syariah (KSPPS) Kode Funding that is using the Five Planes Element of User Experience by Garrett (2011) and considering the aspects of usability and aesthetics. The evaluation was carried out using techniques such as think aloud and learnability assessment by testing 5 participants for a medium fidelity prototype. The final evaluation results on usability testing using task success get a 90% success rate for time and task completion. All participants can complete the proposed task. Meanwhile, the results of the time completion evaluation were calculated to be 5 out of 50 participants that exceeded the time limit. Participants assumed that the prototype with UX design giving a more attractive appearance and the better experience when using the application, as well as the availability of detailed transaction information.   ABSTRAK Aplikasi Kode Funding adalah aplikasi koperasi berbasis mobile yang merupakan produk layanan dari PT Kodetag Global Teknotama. Aplikasi ini telah dirancang memiliki fungsi atau fitur transaksi pada koperasi, namun belum dilakukan perancangan user experience (UX) dan optimasi user interface (UI) untuk memenuhi kebutuhan dan mencapai kepuasan pengguna. Sehingga, ketika user menggunakan aplikasi tersebut, terdapat kesulitan dalam melakukan transaksi pada aplikasi seperti adanya kesalahan input data setoran. Hal berikut tentunya mempengaruhi performa dan kinerja dari pengguna aplikasi dalam bertransaksi.Perancangan user experience dan optimasi user interface dimaksudkan agar terbentuknya prototipe aplikasi mobile Android Koperasi Simpan Pinjam dan Pembiayaan Syariah (KSPPS) Kode Funding yang menggunakan metode Five Planes User Experience Elements oleh Garrett (2011) dengan mempertimbangkan aspek usability dan estetika. Evaluasi dilakukan menggunakan teknik think aloud dan penilaian learnability dengan pengujian pada 5 partisipan untuk medium fidelity prototype. Hasil akhir evaluasi pada usability testing menggunakan task success mendapatkan success rate sebesar 90% untuk time and task completion. Seluruh partisipan dapat menyelesaikan task yang diajukan. Sedangkan, hasil evaluasi dari pemenuhan waktu terdapat 5 dari 50 partisipan melebihi batas waktu. Partisipan menganggap pengembangan prototipe dengan perancangan UX memberikan dampak tampilan yang lebih menarik dan pengalaman menggunakan aplikasi yang lebih baik, serta adanya informasi transaksi yang lebih rinci.

Volunteering as Group Spokesman as a Function of Task Effectiveness, Leader Success, and Task Similarity

1971 ◽  
Vol 28 (3) ◽  
pp. 911-917
Author(s):  
Jack M. Wright ◽  
Morgan Worthy
Keyword(s):  
Task Success ◽  
Group Members ◽  
Task Similarity ◽  
Type Apparatus ◽  
And Task

By reversing the procedure in a Crutchfield-type apparatus, the frequency of adopting the job of spokesman for one's group was studied as a function of the following variables: effectiveness of performance on a previous task, success in influencing the behavior of other group members; and task similarity. Results for 64 male Ss indicate that persons are most willing to function as spokesmen for the group when they have been effective on an earlier task. This is especially likely when the earlier task is similar to the task on which they volunteer as spokesmen or when Ss had been unable to influence other group members' judgments on the previous task. The interpretation is advanced that some types of leadership attempts occur more readily on the basis of feeling of adequacy on the task than on feelings of acceptance as leader (i.e., successful influence).

Local Consumer Information Systems for Services: A Test

1986 ◽  
Vol 20 (2) ◽  
pp. 249-266 ◽  
Author(s):  
PATRICK E. MURPHY ◽  
STEVEN C. ROSS
Keyword(s):  
Information Systems ◽  
Consumer Information

scholarly journals Metode Pieces Framework Pada Tingkat Kepuasan Pengguna Sistem Informasi Perpustakaan Universitas Muhammadiyah Sorong

2021 ◽  
Vol 8 (1) ◽  
pp. 63
Author(s):  
Muzakkir Pangri ◽  
Sunardi Sunardi ◽  
Rusydi Umar
Keyword(s):  
Information System ◽  
Information Systems ◽  
User Satisfaction ◽  
System Analysis ◽  
Performance Information ◽  
Analysis Model ◽  
Framework Analysis ◽  
Campus Environment ◽  
Level Of Satisfaction ◽  
Domain Performance

Abstrak: Sistem informasi mempunyai peran penting dalam menghasilkan informasi bagi semua tingkatan manajemen. Analis perlu mengetahui keperluan informasi yang diinginkan manajemen agar informasi yang dihasilkan oleh sistem informasi dapat berfungsi dan tepat bagi manajemen. Proses evaluasi terhadap kinerja dari sistem informasi diperlukan untuk mengetahui apakah sistem informasi Universitas Muhammadiyah Sorong berjalan sebagaimana mestinya. Evaluasi sistem informasi dapat dilakukan dengan cara yang berbeda dan pada tingkatan yang berbeda, tergantung pada tujuan evaluasinya. Dalam melakukan kegiatan analisis dan evaluasi sistem informasi, terdapat beberapa metode atau model analisis yang dapat digunakan salah satunya adalah model analisis PIECES Framework. Untuk mempermudah evaluasi, ditawarkan cara analisis dengan kerangka PIECES Framework yang menguraikan ke dalam 6 fokus analisis kelemahan yaitu Performance, Information and Data, Economy, Control and Security, Eficiency dan Service. Tujuan penelitan ini untuk mengukur tingkat kepuasan, mengetahui kelemahan serta kekuatan dan menganalisis komponen-komponen yang diperlukan untuk meningkatkan kualitas pelayanan, yang terdapat pada sistem informasi perpustakaan Universitas Muhammadiyah Sorong. Berdasarkan hasil perhitungan daftar pernyataan yang diberikan kepada responden yang merupakan pengguna sistem informasi perpustakaan Universitas Muhammadiyah Sorong, domain Performance, Information & Data, Economics, Control & Security, Efficiency, dan Service, semua berada pada kategori puas, artinya penerapan sistem informasi perpustakaan Universitas Muhammadiyah Sorong, yang saat ini digunakan dilingkungan Kampus sudah dapat diterima sesuai dengan kerangka PIECES Framework.   Kata kunci: kepuasan pengguna, PIECES Framework, website.   Abstract: Information systems have an important role in producing information for all levels of management. Analysts need to know necessity of the information that management wants so that the information generated by the information system can function and be appropriate for management. The process of evaluating performance of the information system is needed to determine whether the information system at the University of Muhammadiyah Sorong is running as it should. Information systems evaluation can be carried out in different ways and at different levels, depending on objective of the evaluation. In carrying out information system analysis and evaluation activities, there are several methods or analysis models that can be used, one of which is the PIECES Framework analysis model. To simplify the evaluation, an analysis method is offered with the PIECES Framework which describes the 6 focus of weakness analysis, that are Performance, Information and Data, Economy, Control and Security, Efficiency and Service. The purpose of this research is to measure the level of satisfaction, find out the strengths, weaknesses and analyze the components that need to be improved the quality of service, which is contained in the library information system of the Muhammadiyah University of Sorong. Based on the results of the calculation of the list of statements given to respondents who are users of the library information system at the Muhammadiyah University of Sorong, the domain of Performance, Information & Data, Economics, Control & Security, Efficiency and Service, all of in the satisfied category, meaning that the application of the library information system at the Muhammadiyah University of Sorong , which is currently being used in the campus environment is acceptable in accordance with the PIECES Framework.   Keywords: user satisfaction, PIECES Framework, website.

scholarly journals Factors that Affect User Satisfaction of Dukcapil Application (Dukcapil Dalam Genggaman) in Surakarta Regency

2020 ◽  
pp. 154-175
Author(s):  
Andreas Bayu Darmawan ◽  
Rino Ardhian Nugroho
Keyword(s):  
Information Systems ◽  
Communication Technology ◽  
User Satisfaction ◽  
Ease Of Use ◽  
Electronic Government ◽  
End User ◽  
Civil Registration ◽  
Population Information ◽  
Information And Communication

Electronic Government (e-Government) has been implemented in Indonesia at both the central and regional levels, where Information and Communication Technology (ICT) is integrated with public services in order to increase effectiveness, efficiency, and transparency. Surakarta has succeeded in creating an application that operates online which can be used to access population administration services, namely Dukcapil application (Dukcapil dalam genggaman in Indonesian term). This application is designed to make it easier for some people of Surakarta who are still experiencing problems if they have to directly access population administration services, whether constrained in terms of time, energy, and cost. As part of population administration services and population information systems, user satisfaction is important for Dukcapil Dalam Genggaman because it is related to the quality of the services provided and the success of implementing the application. User satisfaction can be influenced by several factors. Therefore, this study will examine the factors that influence user satisfaction of Dukcapil Dalam Genggaman. These factors were adapted from a model for measuring the level of user satisfaction with information systems, namely End User Computing Satisfaction (EUCS), which measures satisfaction based on content, accuracy, format, ease of use, and timeliness. This study aims to determine the effect of these factors on user satisfaction of Dukcapil Dalam Genggaman. The questionnaire was distributed to users of Dukcapil Dalam Genggaman and successfully obtained a sample of 107 users. The data analysis used is multiple linear regression. It was found that content, accuracy, ease of use, and timeliness have a significant effect on user satisfaction of Dukcapil Dalam Genggaman. Meanwhile, the format does not have a effect on user satisfaction of Dukcapil Dalam Genggaman. Based on these findings, the Department of Population and Civil Registration of Surakarta is recommended to develop Dukcapil Dalam Genggaman by focusing on the factors that affect user satisfaction of the application.

scholarly journals Using XML schemas to structure information models of capital construction facilities

Vestnik MGSU ◽  
2020 ◽  
pp. 1570-1583
Author(s):  
Sergey A. Volkov ◽  
Tatiana V. Khripko
Keyword(s):  
Information System ◽  
Life Cycle ◽  
Information Systems ◽  
Management Information System ◽  
Information Model ◽  
Management Information ◽  
State Information ◽  
Building Information ◽  
Capital Construction ◽  
Urban Planning Management

Introduction. Building Information Modeling (BIM) is an auspicious approach that supports management and exchange of semantically rich 3D models across design disciplines. Recently, BIM has gained widespread acceptance in the AEC industry, and it improves the efficiency and quality of the process by facilitating the early exchange of 3D building models. At different stages of the life cycle, a building information model is gradually refined from rough conceptual design to detailed individual components. The task is to develop mechanisms for machine verification (authentication) of data transmitted to/from different systems (for example, from a customer to an expert evaluation authority, from a contractor to the urban planning management information system or any other state information system) in the form of an information model of capital construction facilities or certain components of an information model. Materials and methods. To substantiate the choice of the language employed to describe machine-readable documents, various use cases of XML schemas were analyzed, including the use of the Google Trends tool. Information systems, implemented in the Russian Federation, were also considered. Most of them use the W3C XML Schema language to describe XSD schemas. Results. A consolidated list of XML schemas, necessary and sufficient to maintain stages of the life cycle of a capital construction facility in terms of interaction with the Urban Planning Management Information System is presented. To ensure interaction between the life cycle participants and state information systems, it is necessary to have the list of XML schemas approved at the federal level. The paper presents matrixes of scenarios for the application of XML schemas in the following coordinates: participants, life cycle stages. Conclusions. XML schemas can be supplemented in respect of various stages of a life cycle of a capital construction faci-lity to be verified with due regard for further methodological approaches and changes in regulatory and technical acts; new approaches and the need for this supplementation must be substantiated.

Sign in / Sign up

Export Citation Format

Share Document