scholarly journals App-based Self-administrable Clinical Tests of Physical Function: Development and Usability Study (Preprint)

2019 ◽  
Author(s):  
Ronny Bergquist ◽  
Beatrix Vereijken ◽  
Sabato Mellone ◽  
Mattia Corzani ◽  
Jorunn L. Helbostad ◽  
...  
Keyword(s):  
Physical Function ◽  
The Self ◽  
Clinical Tests ◽  
Home Setting ◽  
The Third ◽  
Usability Problems ◽  
Home Based ◽  
System Usability Scale ◽  
System Usability ◽  
Experience Questionnaire

BACKGROUND Objective measures of physical function in older adults are widely used to predict health outcomes such as disability, institutionalization, and mortality. App-based clinical tests allow users to assess their own physical function and have objective tracking of changes over time by use of their smartphones. Such tests can potentially guide interventions remotely and provide more detailed prognostic information about the participant’s physical performance for the users, therapists, and other health care personnel. We developed 3 smartphone apps with instrumented versions of the Timed Up and Go (Self-TUG), tandem stance (Self-Tandem), and Five Times Sit-to-Stand (Self-STS) tests. OBJECTIVE This study aimed to test the usability of 3 smartphone app–based self-tests of physical function using an iterative design. METHODS The apps were tested in 3 iterations: the first (n=189) and second (n=134) in a lab setting and the third (n=20) in a separate home-based study. Participants were healthy adults between 60 and 80 years of age. Assessors observed while participants self-administered the tests without any guidance. Errors were recorded, and usability problems were defined. Problems were addressed in each subsequent iteration. Perceived usability in the home-based setting was assessed by use of the System Usability Scale, the User Experience Questionnaire, and semi-structured interviews. RESULTS In the first iteration, 7 usability problems were identified; 42 (42/189, 22.0%) and 127 (127/189, 67.2%) participants were able to correctly perform the Self-TUG and Self-Tandem, respectively. In the second iteration, errors caused by the problems identified in the first iteration were drastically reduced, and 108 (108/134, 83.1%) and 106 (106/134, 79.1%) of the participants correctly performed the Self-TUG and Self-Tandem, respectively. The first version of the Self-STS was also tested in this iteration, and 40 (40/134, 30.1%) of the participants performed it correctly. For the third usability test, the 7 usability problems initially identified were further improved. Testing the apps in a home setting gave rise to some new usability problems, and for Self-TUG and Self-STS, the rates of correctly performed trials were slightly reduced from the second version, while for Self-Tandem, the rate increased. The mean System Usability Scale score was 77.63 points (SD 16.1 points), and 80-95% of the participants reported the highest or second highest positive rating on all items in the User Experience Questionnaire. CONCLUSIONS The study results suggest that the apps have the potential to be used to self-test physical function in seniors in a nonsupervised home-based setting. The participants reported a high degree of ease of use. Evaluating the usability in a home setting allowed us to identify new usability problems that could affect the validity of the tests. These usability problems are not easily found in the lab setting, indicating that, if possible, app usability should be evaluated in both settings. Before being made available to end users, the apps require further improvements and validation.

scholarly journals App-based Self-administrable Clinical Tests of Physical Function: Development and Usability Study

10.2196/16507 ◽  
2020 ◽  
Vol 8 (4) ◽  
pp. e16507 ◽  
Author(s):  
Ronny Bergquist ◽  
Beatrix Vereijken ◽  
Sabato Mellone ◽  
Mattia Corzani ◽  
Jorunn L Helbostad ◽  
...  
Keyword(s):  
Physical Function ◽  
The Self ◽  
Clinical Tests ◽  
Home Setting ◽  
The Third ◽  
Usability Problems ◽  
Home Based ◽  
System Usability Scale ◽  
System Usability ◽  
Experience Questionnaire

Background Objective measures of physical function in older adults are widely used to predict health outcomes such as disability, institutionalization, and mortality. App-based clinical tests allow users to assess their own physical function and have objective tracking of changes over time by use of their smartphones. Such tests can potentially guide interventions remotely and provide more detailed prognostic information about the participant’s physical performance for the users, therapists, and other health care personnel. We developed 3 smartphone apps with instrumented versions of the Timed Up and Go (Self-TUG), tandem stance (Self-Tandem), and Five Times Sit-to-Stand (Self-STS) tests. Objective This study aimed to test the usability of 3 smartphone app–based self-tests of physical function using an iterative design. Methods The apps were tested in 3 iterations: the first (n=189) and second (n=134) in a lab setting and the third (n=20) in a separate home-based study. Participants were healthy adults between 60 and 80 years of age. Assessors observed while participants self-administered the tests without any guidance. Errors were recorded, and usability problems were defined. Problems were addressed in each subsequent iteration. Perceived usability in the home-based setting was assessed by use of the System Usability Scale, the User Experience Questionnaire, and semi-structured interviews. Results In the first iteration, 7 usability problems were identified; 42 (42/189, 22.0%) and 127 (127/189, 67.2%) participants were able to correctly perform the Self-TUG and Self-Tandem, respectively. In the second iteration, errors caused by the problems identified in the first iteration were drastically reduced, and 108 (108/134, 83.1%) and 106 (106/134, 79.1%) of the participants correctly performed the Self-TUG and Self-Tandem, respectively. The first version of the Self-STS was also tested in this iteration, and 40 (40/134, 30.1%) of the participants performed it correctly. For the third usability test, the 7 usability problems initially identified were further improved. Testing the apps in a home setting gave rise to some new usability problems, and for Self-TUG and Self-STS, the rates of correctly performed trials were slightly reduced from the second version, while for Self-Tandem, the rate increased. The mean System Usability Scale score was 77.63 points (SD 16.1 points), and 80-95% of the participants reported the highest or second highest positive rating on all items in the User Experience Questionnaire. Conclusions The study results suggest that the apps have the potential to be used to self-test physical function in seniors in a nonsupervised home-based setting. The participants reported a high degree of ease of use. Evaluating the usability in a home setting allowed us to identify new usability problems that could affect the validity of the tests. These usability problems are not easily found in the lab setting, indicating that, if possible, app usability should be evaluated in both settings. Before being made available to end users, the apps require further improvements and validation.

Pengembangan Front-End Website Perpustakaan Politeknik Negeri Jakarta dengan menggunakan Metode User Centered Design

2020 ◽  
Vol 6 (2) ◽  
pp. 89-95
Author(s):  
Cerah Ayunda Prawastiyo ◽  
Indra Hermawan
Keyword(s):  
User Interface ◽  
User Experience ◽  
Black Box ◽  
User Centered Design ◽  
Front End ◽  
System Usability Scale ◽  
System Usability ◽  
Experience Questionnaire ◽  
User Centered

Penggunaan internet di Indonesia khususnya di instansi pendidikan terutama perguruan tinggi yaitu mengandalkan internet untuk mencari kumpulan informasi dan referensi terkait dengan mata kuliah. Salah satu unit di sebuah perguruan tinggi yang menggunakan internet dengan memanfaatkan sistem informasi berbasis website adalah perpustakaan Politeknik Negeri Jakarta (PNJ). Website berperan penting untuk instansi sebagai acuan website yang baik salah satunya dapat dinilai dari sisi User Interface (UI) yang memiliki tampilan menarik dan User Experience (UX) untuk meningkatkan kenyamanan pengguna website. Dalam pengembangan front end website perpustakaan menggunakan metode User Centered Design (UCD), framework bootstrap, bahasa pemrograman HTML5, CSS dan Javascript. Pada tahap evaluasi design dalam bentuk wireframe menggunakan metode System Usability Scale (SUS) mendapatkan skor 83, pengujian black box untuk mengukur fungsionalitas website mendapatkan hasil sesuai dengan skenario, pengujian User Experience Questionnaire (UEQ) untuk mengukur tingkat kenyamanan pengguna website mendapatkan hasil positif.

scholarly journals ANALISIS USABILITAS PADA APLIKASI MANDIRI ONLINE

2020 ◽  
Vol 15 (1) ◽  
pp. 11
Author(s):  
Astrid Wahyu Adventri Wibowo
Keyword(s):  
Evaluation System ◽  
Internet Banking ◽  
Mobile Banking ◽  
Heuristic Evaluation ◽  
Online Application ◽  
Evaluation Approach ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
Search Feature

Internet banking atau mobile banking adalah salah satu bentuk aplikasi yang berbasis internet yang dapat digunakan sebagai pintu gerbang menuju dunia perbankan masa depan. Dalam memberikan layanan, pihak bank tidak ingin mengecewakan nasabahnya karena aplikasi internet banking yang sulit digunakan sehingga mengakibatkan nasabah gagal dalam mencari informasi atau gagal melakukan aktivitas perbankan. Melihat pentingnya usabilitas sebuah aplikasi, maka dilakukan penelitian terhadap aplikasi Mandiri Online untuk mengetahui kelayakan dari aplikasi tersebut, mengidentifikasi permasalahan usabilitas, serta menyusun rekomendasi perbaikan. Aplikasi tersebut diuji menggunakan System Usability Scale (SUS) dan pendekatan heuristic evaluation dengan responden sebanyak 40 orang untuk metode SUS dan 5 evaluator dengan kriteria single-expert untuk pendekatan heuristic evaluation. Hasil pengujian aplikasi Mandiri Online dengan instrumen SUS adalah sebesar 79,6 yang berarti aplikasi Mandiri Online dinyatakan dapat diterima (acceptable), termasuk dalam grade B dengan rating good. Dari penelitian ini juga diketahui bahwa terdapat beberapa permasalahan usabilitas mayor yang harus segera diperbaiki dan harus diberi prioritas tinggi. Dalam menyelesaikan permasalahan tersebut membutuhkan beberapa usaha, seperti  menambahkan fitur search untuk mencari nama bank, membuat pengelompokkan instansi pada menu multipayment, membuat atau menambahkan panduan penggunaan atau flowchart penggunaan Mandiri Online, dan menambahkan fitur help pada Mandiri Online. Abstract[Title: Usability Analysis of Mandiri Online Apllication] Internet banking or mobile banking is a form of internet-based application that can be used as a gateway to the future of banking. In providing services, banks won’t to let down their customers because of internet banking applications are difficult to use, resulting in failure to find information or fail to conduct banking activities. Seeing the importance of application usability, a study of Mandiri Online application was conducted to find out the appropriatness of the application, identify usability issues, and construct recommendations for application improvement. This application was tested using the System Usability Scale (SUS) and heuristic evaluation approach with 40 respondents for the SUS and 5 evaluators with single-expert criteria for the heuristic evaluation. The result of testing the Mandiri Online application with the SUS instrument amounted to 79,6 which means this application was declared acceptable, included in grade B, and with a good rating. From this study it is also known that there are some major usability problems that must be corrected immediately and must be given high priority. In solving these problems requires several efforts, such as adding search feature to search the bank’s name, creating agency groups on multipayment menu, creating or adding usage guidelines or flowcharts for using Mandiri Online, and adding help feature to Mandiri Online.Keywords: Heuristic Evaluation; System Usability Scale; Usability

scholarly journals Usability testing of a Digital Assessment Routing Tool: An Iterative Convergent Mixed Methods Study Protocol (Preprint)

2021 ◽  
Author(s):  
Cabella Lowe ◽  
Harry Hanuman-Sing ◽  
Mitchell Browne ◽  
Meshari F. Alwashmi ◽  
William Marsh ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Mixed Methods ◽  
Data Collection ◽  
Quantitative Data ◽  
Usability Testing ◽  
Manuscript Submission ◽  
Digital Assessment ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability

BACKGROUND Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on healthcare utilization. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials, the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials. OBJECTIVE This study will use the iterative-convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. This will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. METHODS We will collect qualitative and quantitative data from between 20-30 participants aged 18 and over four months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 Standard and the System Usability Scale (SUS), providing a benchmark usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles. RESULTS This study received approval from Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) in June 2020. At manuscript submission, the first round of individual interviews has been completed, with data collection to be completed and results published in 2021. CONCLUSIONS This study will provide evidence concerning mHealth DART system usability and acceptance determining system improvements required to support user adoption and minimize sub-optimal system usability as a potential confounder within subsequent non-inferiority clinical trials. This deliberately rigorous approach to mHealth innovation could be used as a guide for other developers of similar applications. Success should produce a safe, effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services.

Comparando métodos de avaliações de usabilidade, de encontrabilidade e de experiência do usuário

2018 ◽  
Vol 13 (2) ◽  
Author(s):  
Celio Andrade Santana ◽  
Rebeka Andrade Alcantra ◽  
Sandra Albuquerque Siebra ◽  
Bruno Tenório Ávila
Keyword(s):  
User Experience ◽  
System Usability Scale ◽  
System Usability ◽  
Level Method ◽  
Experience Questionnaire

Este artigo tem como objetivo identificar e comparar os aspectos considerados em métodos de avaliação de usabilidade, encontrabilidade e experiência do usuário em sistemas de informação. Para tanto, foram avaliados quatro tipos de testes, nos quais dois não consideravam as opiniões do usuário (Avaliação Heurística e a Avaliação de Encontrabilidade) e outros dois eram exclusivamente baseados nas impressões destes (Teste de Usabilidade - SUS e o Teste de Experiência do Usuário). Os métodos escolhidos foram: (i) avaliação heurística de Nielsen, (i) avaliação da encontrabilidade baseadas na análise da tarefa e Keystroke Level Method (KLM), (iii) avaliação de usabilidade SUS (System Usability Scale) e (iv) avaliação da experiência do usuário baseado no UEQ (User Experience Questionnaire). As avaliações foram realizadas em duas funcionalidades de um sistema de gestão acadêmico e para cada uma delas, foi analisado como sete aspectos eram avaliados: (i) interface, (ii) localização, (iii) efetividade, (iv) custo, (v) intuitividade, (vi) utilidade e (vii) experiência. Foi observado que cada método de avaliação, sozinho, observa um ou dois dos aspectos analisados e que a utilização conjunta dos métodos promove uma maior abrangência na avaliação dos aspectos escolhidos. Também foi observado que os métodos de avaliação são mais influenciados pelo seu propósito do que por quem fará a avaliação, reconhecendo que testes baseados nas respostas dos usuários são imprescindíveis para observar impressões qualitativas do usuário, tornando essa abordagem obrigatória em alguns testes.Palavras-chave: Usabilidade. Avaliação Heurística. Encontrabilidade. Experiência do Usuário.Link: http://www.periodicos.ufpb.br/ojs/index.php/itec/article/view/38411/20150

scholarly journals Usability testing to evaluate user experience on cyclers for automated peritoneal dialysis

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Thore Reitz ◽  
Stephanie Schwenke ◽  
Sebastian Hölzle ◽  
Adelheid Gauly
Keyword(s):  
Peritoneal Dialysis ◽  
User Experience ◽  
Ease Of Use ◽  
Usability Study ◽  
Automated Peritoneal Dialysis ◽  
Lay Persons ◽  
System Usability Scale ◽  
System Usability ◽  
Nasa Tlx ◽  
Experience Questionnaire

Abstract Background In the development of medical devices usability is an important aspect standing alongside performance and safety. Peritoneal dialysis (PD) can be provided by use of automated PD (APD), assisted by a cycler performing the solution exchanges. The present study has been executed to simulate training on APD cyclers to evaluate learnability and usability through established questionnaires. Methods Usability of two APD cyclers (sleep•safe harmony, Fresenius Medical Care, Bad Homburg, Germany and HomeChoice Pro, Baxter International Inc., Deerfield (IL), USA) were evaluated with the User Experience Questionnaire (UEQ), the NASA TLX Questionnaire, and the System Usability Scale (SUS), both after training and after experience sessions. Results Lay persons (n = 10) and health care personnel (HCPs, n = 11) participated in the study. The respondents consistently gave positive ratings in the UEQ after training and experience session. The ratings from the NASA TLX Questionnaire were mostly below 50 points indicating a low workload. Lay users and HCPs gave high ratings in the SUS evaluation both after the training and experience sessions confirming a good learnability and usability of the devices. Conclusions The usability study to assess learnability and use-related safety revealed consistent results with all applied instruments, which demonstrated good learnability and ease-of-use of the studied APD cyclers.

scholarly journals Design, development and deployment of a hand/wrist exoskeleton for home-based rehabilitation after stroke - SCRIPT project

Robotica ◽  
2014 ◽  
Vol 32 (8) ◽  
pp. 1331-1346 ◽  
Author(s):  
F. Amirabdollahian ◽  
S. Ates ◽  
A. Basteris ◽  
A. Cesario ◽  
J. Buurke ◽  
...  
Keyword(s):  
Health Care ◽  
Health Care Professional ◽  
New Technologies ◽  
Supporting Evidence ◽  
Design Development ◽  
Interactive Games ◽  
Home Based ◽  
System Usability Scale ◽  
System Usability

SUMMARYChanges in world-wide population trends have provided new demands for new technologies in areas such as care and rehabilitation. Recent developments in the the field of robotics for neurorehabilitation have shown a range of evidence regarding usefulness of these technologies as a tool to augment traditional physiotherapy. Part of the appeal for these technologies is the possibility to place a rehabilitative tool in one's home, providing a chance for more frequent and accessible technologies for empowering individuals to be in charge of their therapy.Objective:this manuscript introduces the Supervised Care and Rehabilitation Involving Personal Tele-robotics (SCRIPT) project. The main goal is to demonstrate design and development steps involved in a complex intervention, while examining feasibility of using an instrumented orthotic device for home-based rehabilitation after stroke.Methods:the project uses a user-centred design methodology to develop a hand/wrist rehabilitation device for home-based therapy after stroke. The patient benefits from a dedicated user interface that allows them to receive feedback on exercise as well as communicating with the health-care professional. The health-care professional is able to use a dedicated interface to send/receive communications and remote-manage patient's exercise routine using provided performance benchmarks. Patients were involved in a feasibility study (n=23) and were instructed to use the device and its interactive games for 180 min per week, around 30 min per day, for a period of 6 weeks, with a 2-months follow up. At the time of this study, only 12 of these patients have finished their 6 weeks trial plus 2 months follow up evaluation.Results:with the “use feasibility” as objective, our results indicate 2 patients dropping out due to technical difficulty or lack of personal interests to continue. Our frequency of use results indicate that on average, patients used the SCRIPT1 device around 14 min of self-administered therapy a day. The group average for the system usability scale was around 69% supporting system usability.Conclusions:based on the preliminary results, it is evident that stroke patients were able to use the system in their homes. An average of 14 min a day engagement mediated via three interactive games is promising, given the chronic stage of stroke. During the 2nd year of the project, 6 additional games with more functional relevance in their interaction have been designed to allow for a more variant context for interaction with the system, thus hoping to positively influence the exercise duration. The system usability was tested and provided supporting evidence for this parameter. Additional improvements to the system are planned based on formative feedback throughout the project and during the evaluations. These include a new orthosis that allows a more active control of the amount of assistance and resistance provided, thus aiming to provide a more challenging interaction.

Barriers and Enablers which Affect the Implementation of Intelligent Guidance Systems for Patients in Chinese Tertiary Transfer Hospitals: Usability Evaluation (Preprint)

2020 ◽  
Author(s):  
Hengkui Cao ◽  
Qiqing Bi ◽  
Richard Evans ◽  
Lining Shen
Keyword(s):  
Linear Regression ◽  
Multiple Linear Regression ◽  
User Satisfaction ◽  
Linear Regression Analysis ◽  
User Experiences ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
Hospital Visits ◽  
Guidance Systems

BACKGROUND Hospital information systems have been widely adopted across China, in recent years, significantly changing the way in which hospitals manage their processes and patient visits. Intelligent Guidance Systems for Patients (IGSP), which resemble humanoid characteristics using Artificial Intelligence (AI), assist patients in navigating hospital visits, obtaining medical guidance, consultation, and other medical services. Despite their widespread adoption in tertiary transfer hospitals in China, usability studies on such systems are scarce. To date, there is no practical or standardized measurement of system usability, leading to difficult inspection, maintenance and servicing processes. OBJECTIVE IGSP can improve user experiences pre, during and post hospital visits. This study aims to determine the usability deficiency of IGSP and understand how various factors influence users’ satisfaction during use. METHODS Employing the requirements set out in the ISO9214-11:2018 standard, two inspection methods were used with 3 experts and 360 recruited end-users. First, the Heuristic evaluation method was employed to detect usability problems and to demonstrate any violations of Nielsen’s 10 heuristic principles. Second, the System Usability Scale (SUS) was applied to evaluate participants’ satisfaction towards IGSP. Finally, analysis of variance tests and a multiple linear regression analysis was performed to establish correlations between user satisfaction and various characteristics. RESULTS A total of 78 problems violated the heuristic principles for 169 times. These problems were divided into five categories: voice interaction, in-hospital navigation, medical consultation, interactive interface design, and miscellaneous. The average SUS score for IGSP was 72.8 (SD 14.69), indicating a good usability level. User satisfaction scores differed among hospitals (F=3.513, P=.031), age of user (F=6.010, P=.000), and smartphone usage time (F=4.781, P=.000). The multiple linear regression model reflected participants’ education level (t=-2.41, p= .016) and gender (t=-2.080, p=.038), while medical industry (t=-2.074, p=0.039) had a negative effect on user satisfaction scores. Conversely, daily smartphone usage times (t= 2.470, p=.014) helped to increase user satisfaction scores. CONCLUSIONS This study demonstrates that IGSP can improve user experiences during interaction between patient and hospital. However, system usability deficiencies did exist; some of which must be addressed. Our findings are considered conducive to tertiary transfer hospitals in developing user-friendly IGSP for improving patient experiences. Tertiary hospitals should take full advantage of IGSP to help reduce waiting times and meet the various needs of patients pre, during and post hospital visit. User-centered conception should be integrated into the process of design and modification of IGSP.

scholarly journals Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study (Preprint)

2020 ◽  
Author(s):  
Christina Schüttler ◽  
Hans-Ulrich Prokosch ◽  
Martin Sedlmayr ◽  
Brita Sedlmayr
Keyword(s):  
Medical Informatics ◽  
Contact Point ◽  
Feasibility Studies ◽  
Wilcoxon Test ◽  
Web Based ◽  
Usability Test ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
User Friendly

BACKGROUND To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface. OBJECTIVE The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users. METHODS The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI’s (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors. RESULTS In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: <i>P</i>=.047; Sample Locator vs ATLAS: <i>P</i>=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: <i>P</i>=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools. CONCLUSIONS This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.

Sign in / Sign up

Export Citation Format

Share Document