An Immersive Virtual Reality Training Game for Power Substations Evaluated in Terms of Usability and Engagement

Safety-focused training is essential for the operation and maintenance concentrated on the reliability of critical infrastructures, such as power grids. This paper introduces and evaluates a system for power substation operational training by exploring and interacting with realistic models in virtual worlds using serious games. The virtual reality (VR) simulator used building information modelling (BIM) from a 115 kV substation to develop a scenario with high technical detail suitable for professional training. This system created interactive models that could be explored using a first-person-perspective serious game in a cave automatic virtual environment (CAVE). Different operational missions could be carried out in the serious game, allowing several skills to be coached. The suitability for vocational training carried out by utility companies was evaluated in terms of usability and engagement. The evaluation used a System Usability Scale (SUS) and a Game Engagement Questionnaire (GEQ) filled by 16 power substation operators demonstrating marginally acceptable usability, with improvement opportunities and high acceptance (by utility technicians) of this system for operation training focused on safety in such hazardous tasks.

Preliminary Study on a Novel Protocol for Improving Familiarity with a Lower-Limb Robotic Exoskeleton in Able-Bodied, First-Time Users

Lower-limb exoskeletons have been created for different healthcare needs, but no research has been done on developing a proper protocol for users to get accustomed to moving with one. The user manuals provided also do not include such instructions. A pre-test was conducted with the TWIN (IIT), which is a lower-limb exoskeleton made for persons with spinal cord injury. In the pre-test, two healthy, able-bodied graduate students indicated a need for a protocol that can better prepare able-bodied, first-time users to move with an exoskeleton. TWIN was used in this preliminary study and nine users were divided to receive a tutorial or no tutorial before walking with the exoskeleton. Due to COVID-19 regulations, the study could only be performed with healthy, young-to-middle-aged lab members that do not require walking support. The proposed protocol was evaluated with the System Usability Scale, NASA Raw Task Load Index, and two custom surveys. The members who received the tutorial found it easy to follow and helpful, but the tutorial seemed to come at a price of higher perceived mental and physical demands, which could stem from the longer testing duration and the need to constantly recall and apply the things learned from the tutorial. All results presented are preliminary, and it is recommended to include biomechanical analysis and conduct the experiment with more participants in the future. Nonetheless, this proof-of-concept study lays groundwork for future related studies and the protocol will be adjusted, applied, and validated to patients and geriatric users.

An Interactive Voice Response System to Increase Physical Activity and Prevent Cancer in the Rural Alabama Black Belt: Design and Usability Study

Background Increased physical activity (PA) levels are associated with reduced risk and improved survival for several cancers; however, most Americans engage in less than the recommended levels of PA. Using interactive voice response (IVR) systems to provide personalized health education and counseling may represent a high-reach, low-cost strategy for addressing physical inactivity and cancer disparities in disproportionately burdened rural regions. However, there has been a paucity of research conducted in this area to date. Objective The aim of this study is to design, develop, and test the usability of an IVR system aimed at increasing PA levels in the rural Alabama Black Belt. Methods A pilot version of the IVR system was used to assess initial feasibility and acceptability. Detailed exit interviews were conducted to elicit participant feedback, which helped inform the development of a substantially upgraded in-house IVR system. This refined IVR system was then subjected to a sequential explanatory mixed methods evaluation. Participating rural county coordinators and research staff (N=10) tested the usability of the IVR system features for 2 weeks and then completed the System Usability Scale and qualitative semistructured interviews. Results The study sample comprised mostly African American people, women, rural county coordinators, and research staff (N=10). Participants rated the IVR system with a mean score of 81 (SD 5) on the System Usability Scale, implying excellent usability. In total, 5 overarching themes emerged from the qualitative interviews: likes or dislikes of the intervention, barriers to or facilitators of PA, technical difficulties, quality of calls, and suggestions for intervention improvement. Message framing on step feedback, call completion incentives, and incremental goal-setting challenges were areas identified for improvement. The positive areas highlighted in the interviews included the personalized call schedules, flexibility to call in or receive a call, ability to make up for missed calls, narration, and PA tips. Conclusions The usability testing and feedback received from the rural county coordinators and research staff helped inform a final round of refinement to the IVR system before use in a large randomized controlled trial. This study stresses the importance of usability testing of all digital health interventions and the benefits it can offer to the intervention.

Benchmarking of mobile apps on heart failure

ABSTRACT Objective: to analyze the mobile apps on heart failure available in the main operating systems and their usability. Methods: benchmarking of mobile applications, systematic research, comprising 38 mobile applications for analysis of general information, functionalities and usability. Usability was assessed using System Usability Scale and Smartphone Usability Questionnaire, followed by the calculation of the agreement index and the exact binomial distribution test, with a significance level of p> 0.05 and a proportion of 0.90. Results: mobile applications had English as the predominant language (73.7%), were directed to patients (71.1%) and the predominant theme was disease knowledge (34.2%). Functionalities ranged from general features to the need for an internet connection. In assessing usability, heart failure was shown to be 92.1% -94.7% and p <0.05. Final considerations: the mobile apps on heart failure have varied content and adequate usability. However, there is a need to develop more comprehensive mobile applications.

Evaluation of a Mobile Augmented Reality Game Application as an Outdoor Learning Tool

There is a discussion on the potential of augmented reality (AR), mobile technologies to enhance learning. This article presents: 1) the EduPARK project's first cycle of design-based research for the development of a mobile AR game-like app that aims to promote learning in an urban park, and 2) an experience of students using it in loco. The focus is the students' perceptions regarding the usability and functionality of the app. Data collection involved focus groups, questionnaires and app usage information. Data was submitted to content analysis and descriptive statistics. Results revealed an excellent usability of the EduPARK app, with an average system usability scale of 85.6. Overall, students reported that the app was enjoyable, easy to use and promoted learning; however, improvements and more evaluation experiences are needed to better understand mobile AR game-like learning in urban parks.

Design and usability assessment of DocManS: A document management system with security and social media features

A document management system (DMS) is required to handle any documents within an institution efficiently. However, several important features are lacking in the current DMS, such as security and social media features. This paper proposes a new solution to tackle the issues by developing a new document management system with security and social media features called DocManS. The development process and usability evaluation by users are presented in this paper. The usability assessment is performed with the use of the System Usability Scale (SUS) framework. The results show that the current version falls within the B range of the SUS framework and several enhancements for better usability in terms of social media sharing and privacy are recommended.

Pelatihan uji kegunaan website menggunakan System Usability Scale (SUS)

System Usability Scale (SUS) is a usability testing technique for a simple system using a Likert scale. Testing and usability analysis assess user satisfaction with the system or web. So, the purpose of this service activity is to train website usability testing with SUS, using the Dukcapil website as a test object. Dukcapil's website will be analyzed for its usability level as a real case for direct practice. In SUS, ten statements are used as parameters in assessing the usability of a website. This activity was attended by 20 people, including Bina Darma University students, vocational students, and IT staff from the Dukcapil Palembang City. The usability analysis of this website aims to assess how well user interaction with the website is going. Then, the results of this assessment and study produce an input as a reference for website development to be more optimal in the future. In testing the usefulness of the Dukcapil website in this PKM activity, it can be seen that the SUS score is at a score of 56.125, with the category Acceptable. Therefore, it shows that the Dukcapil website is ranked F, with a "Good" rating category. The training results show that the Dukcapil website is still very rarely accessed by users. Because it provides information lacking in updates, the features used are still in the beta version (still in the testing phase). Users or participants still do not understand how to use it. In addition, this activity provides participants with an understanding of the website usability test using the SUS model.

Video conferencing as a face-to-face online meeting app: user preference based on usability testing

The global pandemic of Corona Virus Disease (Covid-19) that hit Indonesia since March 2020 has changed the face-to-face system from offline to online. Video Conference (VC) becomes an alternative choice for delivering material, both learning and working. VC is a technology that allows users to hold face-to-face meetings at their respective places simultaneously. Various VC apps are becoming increasingly popular these days, such as Google Meet, Zoom, Youtube, Webex, Skype, GoTo Meeting, and Big Blue Button (BBB). This study is intended to provide a usability test of VC applications (such as Zoom, Google Meet, and BBB) and provide recommendations for VC as an online conference media based on user preferences. The usability measurement technique used is the System Usability Scale (SUS) and the USE questionnaire. The results of this study show that Zoom has the highest usability value compared to Google Meet and BBB, Google Meet is ranked second and BBB is ranked third.

EVM: An Educational Virtual Reality Modeling Tool; Evaluation Study with Freshman Engineering Students

Educational Virtual Modeling (EVM) is a novel VR-based application for sketching and modeling in an immersive environment designed to introduce freshman engineering students to modeling concepts and reinforce their understanding of the spatial connection between an object and its 2D projections. It was built on the Unity 3D game engine and Microsoft’s Mixed Reality Toolkit (MRTK). EVM was designed to support the creation of the typical parts used in exercises in basic engineering graphics courses with a special emphasis on a fast learning curve and a simple way to provide exercises and tutorials to students. To analyze the feasibility of using EVM for this purpose, a user study was conducted with 23 freshmen and sophomore engineering students that used both EVM and Trimble SketchUp to model six parts using an axonometric view as the input. Students had no previous experience in any of the two systems. Each participant went through a brief training session and was allowed to use each tool freely for 20 min. At the end of the modeling exercises with each system, the participants rated its usability by answering the System Usability Scale (SUS) questionnaire. Additionally, they filled out a questionnaire for assessment of the system functionality. The results demonstrated a very high SUS score for EVM (M = 92.93, SD = 6.15), whereas Trimble SketchUp obtained only a mean score of 76.30 (SD = 6.69). The completion time for the modeling tasks with EVM showed its suitability for regular class use, despite the fact that it usually takes longer to complete the exercises in the system than in Trimble SketchUp. There were no statistically significant differences regarding functionality assessment. At the end of the experimental session, participants were asked to express their opinion about the systems and provide suggestions for the improvement of EVM. All participants showed a preference for EVM as a potential tool to perform exercises in the engineering graphics course.

Pengembangan Sistem Informasi Geografis Kebun Binatang Berbasis Progressive Web Application (PWA) dengan Metode Prototype (Studi Kasus Kebun Binatang Bandung)

Kebun binatang merupakan tempat yang memiliki peran strategis terhadap aspek konservasi satwa, sosial ekonomi masyarakat, maupun lingkungan. Kebun Binatang Bandung sebagai salah satu kebun binatang di Indonesia sudah seharusnya dapat dikelola dengan baik dengan memberikan fasilitas pelayanan yang mumpuni. Namun pada saat ini Kebun Binatang Bandung masih belum memiliki fasilitas layanan petunjuk arah, peta, dan informasi satwa yang memadai. Hal tersebut melatarbelakangi adanya penelitian pengembangan aplikasi Sistem Informasi Geografis Kebun Binatang Bandung ini. Tujuannya agar pengunjung Kebun Binatang Bandung dapat lebih mudah dan nyaman dalam menjelajahi kebun binatang, serta bisa mendapatkan informasi lebih dalam mengenai satwa yang dilihatnya. Pengembangan aplikasi menggunakan metode pengembangan perangkat lunak Prototype yang dinilai baik untuk pengembangan aplikasi berskala kecil. Metode Prototype terdiri dari lima tahap pengembangan yakni Communication, Quick Plan, Modeling Quick Design, Construction of Prototype, dan Deployment Develivery Feedback. Sementara itu, aplikasi dibuat berbasis Progressive Web Application (PWA) yang mudah diakses namun tetap memberikan fitur-fitur yang menarik layaknya aplikasi native. Hasil pengembangan aplikasi kemudian diujicobakan dengan menggunakan metode System Usability Scale (SUS) dan Retrospective Think Aloud (RTA). Dari hasil pengujian, didapat didapat nilai usabilitas sebesar 81,43 (Skor SUS) yang tergolong ke dalam kategori Acceptable. Dengan demikian dapat disimpulkan bahwa aplikasi ini diterima dan layak untuk digunakan.