scholarly journals The Collaborative Metadata Repository (CoMetaR) Web App: Quantitative and Qualitative Usability Evaluation

10.2196/30308 ◽  
2021 ◽  
Vol 9 (11) ◽  
pp. e30308
Author(s):  
Mark R Stöhr ◽  
Andreas Günther ◽  
Raphael W Majeed
Keyword(s):  
Qualitative Analysis ◽  
Medical Informatics ◽  
Ease Of Use ◽  
Metadata Management ◽  
System Usability Scale ◽  
Standards And Guidelines ◽  
Use Efficiency ◽  
Metadata Repository ◽  
Web App ◽  
Further Development

Background In the field of medicine and medical informatics, the importance of comprehensive metadata has long been recognized, and the composition of metadata has become its own field of profession and research. To ensure sustainable and meaningful metadata are maintained, standards and guidelines such as the FAIR (Findability, Accessibility, Interoperability, Reusability) principles have been published. The compilation and maintenance of metadata is performed by field experts supported by metadata management apps. The usability of these apps, for example, in terms of ease of use, efficiency, and error tolerance, crucially determines their benefit to those interested in the data. Objective This study aims to provide a metadata management app with high usability that assists scientists in compiling and using rich metadata. We aim to evaluate our recently developed interactive web app for our collaborative metadata repository (CoMetaR). This study reflects how real users perceive the app by assessing usability scores and explicit usability issues. Methods We evaluated the CoMetaR web app by measuring the usability of 3 modules: core module, provenance module, and data integration module. We defined 10 tasks in which users must acquire information specific to their user role. The participants were asked to complete the tasks in a live web meeting. We used the System Usability Scale questionnaire to measure the usability of the app. For qualitative analysis, we applied a modified think aloud method with the following thematic analysis and categorization into the ISO 9241-110 usability categories. Results A total of 12 individuals participated in the study. We found that over 97% (85/88) of all the tasks were completed successfully. We measured usability scores of 81, 81, and 72 for the 3 evaluated modules. The qualitative analysis resulted in 24 issues with the app. Conclusions A usability score of 81 implies very good usability for the 2 modules, whereas a usability score of 72 still indicates acceptable usability for the third module. We identified 24 issues that serve as starting points for further development. Our method proved to be effective and efficient in terms of effort and outcome. It can be adapted to evaluate apps within the medical informatics field and potentially beyond.

scholarly journals The Collaborative Metadata Repository (CoMetaR) Web App: Quantitative and Qualitative Usability Evaluation (Preprint)

2021 ◽  
Author(s):  
Mark R Stöhr ◽  
Andreas Günther ◽  
Raphael W Majeed
Keyword(s):  
Qualitative Analysis ◽  
Medical Informatics ◽  
Ease Of Use ◽  
Metadata Management ◽  
System Usability Scale ◽  
Standards And Guidelines ◽  
Use Efficiency ◽  
Metadata Repository ◽  
Web App ◽  
Further Development

BACKGROUND In the field of medicine and medical informatics, the importance of comprehensive metadata has long been recognized, and the composition of metadata has become its own field of profession and research. To ensure sustainable and meaningful metadata are maintained, standards and guidelines such as the FAIR (Findability, Accessibility, Interoperability, Reusability) principles have been published. The compilation and maintenance of metadata is performed by field experts supported by metadata management apps. The usability of these apps, for example, in terms of ease of use, efficiency, and error tolerance, crucially determines their benefit to those interested in the data. OBJECTIVE This study aims to provide a metadata management app with high usability that assists scientists in compiling and using rich metadata. We aim to evaluate our recently developed interactive web app for our collaborative metadata repository (CoMetaR). This study reflects how real users perceive the app by assessing usability scores and explicit usability issues. METHODS We evaluated the CoMetaR web app by measuring the usability of 3 modules: <i>core module</i>, <i>provenance module</i>, and <i>data integration module</i>. We defined 10 tasks in which users must acquire information specific to their user role. The participants were asked to complete the tasks in a live web meeting. We used the System Usability Scale questionnaire to measure the usability of the app. For qualitative analysis, we applied a modified think aloud method with the following thematic analysis and categorization into the ISO 9241-110 usability categories. RESULTS A total of 12 individuals participated in the study. We found that over 97% (85/88) of all the tasks were completed successfully. We measured usability scores of 81, 81, and 72 for the 3 evaluated modules. The qualitative analysis resulted in 24 issues with the app. CONCLUSIONS A usability score of 81 implies very good usability for the 2 modules, whereas a usability score of 72 still indicates acceptable usability for the third module. We identified 24 issues that serve as starting points for further development. Our method proved to be effective and efficient in terms of effort and outcome. It can be adapted to evaluate apps within the medical informatics field and potentially beyond.

Crowdsourcing the Evaluation of Design Concepts With Empathic Priming

2016 ◽  
Author(s):  
Michelle A. Pang ◽  
Carolyn C. Seepersad
Keyword(s):  
Rating Scales ◽  
Pairwise Comparison ◽  
Comparison Method ◽  
Ease Of Use ◽  
Primary Study ◽  
Design Concepts ◽  
The Impact ◽  
Further Development ◽  
Similar Evaluation ◽  
Insight Into

The evaluation of design concepts is a time consuming and resource intensive process. Crowdsourcing evaluations has been examined in previous work as a means to reduce the need for expert raters, while achieving similar evaluation results. This paper examines the impact of empathically priming novice raters on their evaluation of alternative design concepts. The rating system is based on a pairwise comparison method that requires minimal training of novice raters. In a pilot study the pairwise method for crowdsourcing evaluations is compared with crowdsourced evaluations using non-pairwise rating scales and with the evaluations of expert raters. The primary study incorporates written and empathic priming strategies to determine their impact on novice raters’ evaluation of concepts. Raters are asked to consider several criteria, including novelty, feasibility, clarity (of the concept), usefulness, ease of use, and overall worthiness of further development. Results offer insight into the criteria that are most relevant to novice raters and whether empathic priming has a significant effect on those evaluations.

scholarly journals Sharing communities – Community currency in the sharing economy

2020 ◽  
Author(s):  
Eszter Szemerédi ◽  
Tibor Tatay
Keyword(s):  
High Speed ◽  
Essential Element ◽  
Sharing Economy ◽  
Ease Of Use ◽  
Smart Contracts ◽  
Efficient Operation ◽  
Blockchain Technology ◽  
Community Currency ◽  
Efficient Alternative ◽  
Further Development

AbstractFor the further development and more efficient operation of the sharing economy, a fast and inexpensive peer-to-peer payment system is an essential element. The aim of this study is to outline a prototype that ensures the automation and decentralization of processes through smart contracts without blockchain technology. The model has been built based on the narrative that a community currency created through smart contracts can promote genuine practices of sharing as opposed to the profit-oriented approach that most of the currently operating sharing economy platforms have. Features of the model, such as ease of use, high-speed transactions without transaction cost are benefits that can provide a more efficient alternative to the traditional or to the cryptocurrency-based centralized sharing economy platforms.

scholarly journals A Mobile Web App to Improve Health Screening Uptake in Men (ScreenMen): Utility and Usability Evaluation Study (Preprint)

2018 ◽  
Author(s):  
Chin Hai Teo ◽  
Chirk Jenn Ng ◽  
Sin Kuang Lo ◽  
Chip Dong Lim ◽  
Alan White
Keyword(s):  
Quantitative Data ◽  
Qualitative Data ◽  
Health Screening ◽  
Screening Tests ◽  
Mobile Web ◽  
Screening Uptake ◽  
System Usability Scale ◽  
The Mean ◽  
Web App ◽  
Improve Health

BACKGROUND Globally, the uptake of health screening is suboptimal, especially in men and those of younger age. In view of the increasing internet access and mobile phone ownership, ScreenMen, a mobile Web app, was developed to improve health screening uptake in men. OBJECTIVE This study aimed to evaluate the utility and usability of ScreenMen. METHODS This study used both qualitative and quantitative methods. Healthy men working in a banking institution were recruited to participate in this study. They were purposively sampled according to job position, age, education level, and screening status. Men were asked to use ScreenMen independently while the screen activities were being recorded. Once completed, retrospective think aloud with playback was conducted with men to obtain their feedback. They were asked to answer the System Usability Scale (SUS). Intention to undergo screening pre- and postintervention was also measured. Qualitative data were analyzed using a framework approach followed by thematic analysis. For quantitative data, the mean SUS score was calculated and change in intention to screening was analyzed using McNemar test. RESULTS In total, 24 men participated in this study. On the basis of the qualitative data, men found ScreenMen useful as they could learn more about their health risks and screening. They found ScreenMen convenient to use, which might trigger men to undergo screening. In terms of usability, men thought that ScreenMen was user-friendly and easy to understand. The key revision done on utility was the addition of a reminder function, whereas for usability, the revisions done were in terms of attracting and gaining users’ trust, improving learnability, and making ScreenMen usable to all types of users. To attract men to use it, ScreenMen was introduced to users in terms of improving health instead of going for screening. Another important revision made was emphasizing the screening tests the users do not need, instead of just informing them about the screening tests they need. A Quick Assessment Mode was also added for users with limited attention span. The quantitative data showed that 8 out of 23 men (35%) planned to attend screening earlier than intended after using the ScreenMen. Furthermore, 4 out of 12 (33%) men who were in the precontemplation stage changed to either contemplation or preparation stage after using ScreenMen with P=.13. In terms of usability, the mean SUS score of 76.4 (SD 7.72) indicated that ScreenMen had good usability. CONCLUSIONS This study showed that ScreenMen was acceptable to men in terms of its utility and usability. The preliminary data suggested that ScreenMen might increase men’s intention to undergo screening. This paper also presented key lessons learned from the beta testing, which is useful for public health experts and researchers when developing a user-centered mobile Web app.

scholarly journals DEVELOPMENT STRATEGIES OF UBUD VILLAGE AS A CULTURAL M.I.C.E. (MEETING, INCENTIVES, CONVENTIONS, EXHIBITIONS) DESTINATION IN BALI

Jurnal IPTA ◽  
2018 ◽  
Vol 6 (1) ◽  
pp. 84
Author(s):  
I GPB Sasrawan Mananda ◽  
Luh Gede Leli Kusuma Dewi
Keyword(s):  
Qualitative Analysis ◽  
Development Strategy ◽  
Tourism Industry ◽  
Tourist Destination ◽  
Travel Agent ◽  
Mass Tourism ◽  
Tourist Destinations ◽  
Analysis Technique ◽  
High Season ◽  
Further Development

The concept of mass tourism has two seasons namely high season and low season to determine the number of tourist visits each year, therefore the tourism industry to try to conduct a vigorous promotion by carrying out activities that can bring tourists to stay in one tourist destination. One of the activities that entrepreneurs do in the low season is to conduct activities M.I.C.E. (Meetings, Incentives, Conventions and Exhibitions). This research uses descriptive qualitative analysis technique by applying the participatory principle involving M.I.C.E stakeholders, destination manager, travel agent managers and tourists. Ubud Village as a tourist destination also has potential for M.I.C.E activities has not had a convention bureau, this is due to the characteristics of the tourists who come to Ubud and the needs required by the tourism industry managers are different from other tourist destinations in Bali such as Badung regency and Denpasar municipality. During this time, the implementation activities of M.I.C.E. dominated by incentives tourism activities (56.57%), exhibitions (31.72%) and meetings (11.71%). The SWOT results concluded that Ubud Village is still S> W and O?T thus requiring internal consolidation, but seeing O?T has potential for further development. Development strategy were using grand strategy which make the results such as growth, dominance, and maximum investment.

scholarly journals Planning of People Management System in One of the Telecommunication Companies in Indonesia using the System Usability Scale Method

2019 ◽  
Vol 9 (2) ◽  
pp. 2704-2707
Keyword(s):  
Mobile Applications ◽  
Mobile Application ◽  
Management System ◽  
Current System ◽  
Development Planning ◽  
The People ◽  
System Usability Scale ◽  
System Usability ◽  
Telecommunication Companies ◽  
Further Development

At this time the application for mobile applications on an industrial scale and companies are still considered very lacking for it’s application, it is because the industry that is currently running is still likely to use a desktop. Which with the mobile application opportunity and understanding of technology from everyone in the company, business process automation can be done more efficiently through mobile applications. Planning of this people management system aims to resolve the problem experienced by one of the telecommunications companies in Indonesia, which at present employees find it very difficult to make requests for overtime, leave and claims, because the current system is still in desktop or manual form filling which still depends on the office network environment. Therefore, a mobile application-based People Management System (PMS) will be made in which the process will run in real time and can be done anywhere. For the initial stages of development planning Mobile applications for People Management System (PMS) will greatly help the company problems mentioned earlier. By using Heuristic Task Analysis (HTA) as a method for reviewing the effectiveness of work and activities that are not properly carried out, so it can be obtained desirable productivity (Stanton, 2006)., and the System Usability Scale (SUS) method for interface testing which is carried out directly by end users (Martoyo &amp; Falahah,2015). Based on the provisions of the System Usability Scale score, the assessment results of 10 respondents for the People management system application of 79.0 where the score is the Acceptability Ranges in the Acceptable category and are in grade B. From these results it is felt that there is still need for further development because current planning is for the initial planning phase, there needs to be further development to improve the performance of the company and comfort for employees.

scholarly journals PNSCares: The android based mobile application to manage student complaints

2020 ◽  
Vol 9 (3) ◽  
pp. 1276-1283
Author(s):  
N. Illias ◽  
N. H. Abdul Hamid ◽  
Z. A. Shaffiei
Keyword(s):  
Mobile Application ◽  
Mobile Apps ◽  
Ease Of Use ◽  
Perceived Usefulness ◽  
Application Development ◽  
Complaint Handling ◽  
Development Life Cycle ◽  
System Usability Scale ◽  
System Usability ◽  
Mobile Application Development

Managing the complaint is tough to handle, efficient response to the complaints from the customer can be an indicator to measure an organization’s performance. We’ve chosen Politeknik Nilai as one of the institutions that are facing daily complaints from the students and parents. Currently, they are using the manual form to lodge a complaint and receive the feedback via email. In this study, we developed an android based mobile application to manage the students’ complaint. With mobile apps, the management can prevent the loss of complaint forms and keep track of the records. This system will send feedback and notification directly via students’ mobile phone. This study referred to the ten principles for effective complaint handling by Ombudsman. We only referred to eight principles to construct the PNSCares. The methodology used to develop mobile apps is using the Mobile Application Development Life Cycle (MADLC). System Usability Scale (SUS) is used to measure the effectiveness of the mobile apps. The feedbacks from ten respondents on the PNSCares prototype are good with 72 scores in SUS for perceived usefulness and ease of use factor. Based on the result, the prototype is effective and easy to use.

scholarly journals Barriers and Facilitators to Implementation of Medication Decision Support Systems in Electronic Medical Records: Mixed Methods Approach Based on Structural Equation Modeling and Qualitative Analysis (Preprint)

2020 ◽  
Author(s):  
Se Young Jung ◽  
Hee Hwang ◽  
Keehyuck Lee ◽  
Ho-Young Lee ◽  
Eunhye Kim ◽  
...  
Keyword(s):  
Structural Equation Modeling ◽  
Decision Support ◽  
Quantitative Analysis ◽  
Qualitative Analysis ◽  
Structural Equation ◽  
Adverse Drug Events ◽  
Ease Of Use ◽  
Barriers And Facilitators ◽  
Equation Modeling ◽  
Successful Implementation

BACKGROUND Adverse drug events (ADEs) resulting from medication error are some of the most common causes of iatrogenic injuries in hospitals. With the appropriate use of medication, ADEs can be prevented and ameliorated. Efforts to reduce medication errors and prevent ADEs have been made by implementing a medication decision support system (MDSS) in electronic health records (EHRs). However, physicians tend to override most MDSS alerts. OBJECTIVE In order to improve MDSS functionality, we must understand what factors users consider essential for the successful implementation of an MDSS into their clinical setting. This study followed the implementation process for an MDSS within a comprehensive EHR system and analyzed the relevant barriers and facilitators. METHODS A mixed research methodology was adopted. Data from a structured survey and 15 in-depth interviews were integrated. Structural equation modeling was conducted for quantitative analysis of factors related to user adoption of MDSS. Qualitative analysis based on semistructured interviews with physicians was conducted to collect various opinions on MDSS implementation. RESULTS Quantitative analysis revealed that physicians’ expectations regarding ease of use and performance improvement are crucial. Qualitative analysis identified four significant barriers to MDSS implementation: alert fatigue, lack of accuracy, poor user interface design, and lack of customizability. CONCLUSIONS This study revealed barriers and facilitators to the implementation of MDSS. The findings can be applied to upgrade MDSS in the future.

scholarly journals Global Trends and Directions of Development of Industrial Robots

2020 ◽  
Vol 11 (3) ◽  
pp. 294-319
Author(s):  
A. E. Varshavsky ◽  
V. V. Dubinina
Keyword(s):  
Ease Of Use ◽  
Industrial Robots ◽  
Production Costs ◽  
Industrial Internet Of Things ◽  
Industrial Countries ◽  
Global Trends ◽  
Industrial Internet ◽  
Key Industries ◽  
Further Development

Purpose: the main purpose of this article is to analyze the main trends and directions of development of industrial robots, as well as the problems associated with their distribution. To achieve these goals, the following tasks were solved: analysis of the dynamics of the stock of industrial robots, the structure of the stock of robots by region (Europe, America, Asia / Australia), as well as the annual volumes and structure of world sales of robots by key industries; analysis of the main tasks of industrial robots, performed by them in these industries, and the directions of their use; analyze the dynamics of the robot fleet by industry in different countries (Japan, USA, South Korea, China, Germany, etc.); analysis of indicators and problems of using industrial robots in Russia.Methods: the research methodology consists in a comparative analysis of the use of industrial robots in different industries (automotive, food, chemical, electronic, etc.) based on statistical data by country. A systematic approach, tabular and graphical interpretation of information was applied, analysis of the dynamics of the levels of the time series, the calculation of growth indices of indicators.Results: the analysis showed that the use of industrial robots reduces injuries at the workplace, production costs and improves the quality of the final product, productivity, flexibility and safety, which contributes to a significant increase in their use in both developed and developing countries.Conclusions and Relevance: recently, robotization has become available even in non-industrial countries. The introduction of robotization into production processes increases the competitiveness of the economy. The acceleration of digitalization and automation, as well as the ease of use of industrial robots, are driving their proliferation. In Russia, the wider use of industrial robots, the development of the industrial Internet of things and the implementation of digitalization are possible only on the basis of the restoration and further development of mechanical engineering, electronic and other manufacturing industries.

scholarly journals Usability, usefulness, and acceptance of mRehab: A novel, portable rehabilitation system using smartphone and 3D print technology (Preprint)

2020 ◽  
Author(s):  
Sutanuka Bhattacharjya ◽  
Lora Anne Cavuoto ◽  
Brandon Reilly ◽  
Wenyao Xu ◽  
Heamchand Subryan ◽  
...  
Keyword(s):  
Technology Acceptance ◽  
Technology Use ◽  
Structured Interview ◽  
Ease Of Use ◽  
Perceived Usefulness ◽  
Home Exercise ◽  
3D Print ◽  
System Usability Scale ◽  
Rehabilitation System ◽  
At Home

BACKGROUND Smart technology use in rehabilitation is growing and can be used remotely to assist clients in self-monitoring their performance. With written home exercise programs being the commonly prescribed form of rehabilitation after discharge, mHealth technology coupled with task-oriented programs can enhance self-management of upper extremity training. In the current study, a functional rehabilitation system, namely mRehab, was designed which included a smartphone app and 3D printed household items such as mug, bowl, key, and doorknob embedded with a smartphone The app's user interface allowed the participant to select rehabilitation activities and receive feedback on the number of activity repetitions completed, time to complete each activity and quality of movement. OBJECTIVE To assess the usability, perceived usefulness, and acceptance of the mRehab system by individuals with stroke and identify the challenges experienced by them when using the system remotely in a home-based setting. METHODS A mixed-methods approach was used with 11 individuals with chronic stroke. Following training, individuals with stroke used the mRehab system for six weeks at home. Each participant completed surveys and engaged in a semi-structured interview. Participants’ qualitative reports regarding the usability of mRehab were integrated with their survey reports and quantitative performance data. RESULTS Ten of the eleven participants rated the mRehab system between 67.5 to 97.5 percentile on the System Usability Scale, indicating their satisfaction with the usability of the system. Participants also provided high ratings of perceived usefulness (median=6), and perceived ease of use (median=5.75), on a 7-point scale based on the Technology Acceptance Model. Common themes reported by participants showed a positive response to mRehab with some suggestions for improvements. Participants reported an interest in activities they perceived to be of ‘just right challenge’. Some participants indicated a need for customizing the feedback to be more interpretable. Overall, most participants indicated that they would like to continue using the mRehab system at home. CONCLUSIONS Assessing usability in the lived environment over a prolonged duration of time is essential to identify match between the system and users’ needs and preferences. While mRehab was well accepted, further customization is desired for a better fit with the end users. CLINICALTRIAL NCT04363944

Sign in / Sign up

Export Citation Format

Share Document