scholarly journals Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study (Preprint)

2020 ◽  
Author(s):  
Christina Schüttler ◽  
Hans-Ulrich Prokosch ◽  
Martin Sedlmayr ◽  
Brita Sedlmayr
Keyword(s):  
Medical Informatics ◽  
Contact Point ◽  
Feasibility Studies ◽  
Wilcoxon Test ◽  
Web Based ◽  
Usability Test ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
User Friendly

BACKGROUND To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface. OBJECTIVE The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users. METHODS The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI’s (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors. RESULTS In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: <i>P</i>=.047; Sample Locator vs ATLAS: <i>P</i>=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: <i>P</i>=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools. CONCLUSIONS This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.

Addendum to the Acknowledgements: Evaluation of Three Feasibility Tools for Identifying Patient Dataand Biospecimen Availability:Comparative Usability Study (Preprint)

2021 ◽  
Author(s):  
Christina Schüttler ◽  
Hans-Ulrich Prokosch ◽  
Martin Sedlmayr ◽  
Brita Sedlmayr
Keyword(s):  
Medical Informatics ◽  
Contact Point ◽  
Feasibility Studies ◽  
Wilcoxon Test ◽  
Web Based ◽  
Usability Test ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
User Friendly

BACKGROUND To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface. OBJECTIVE The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users. METHODS The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI’s (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors. RESULTS In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: P=.047; Sample Locator vs ATLAS: P=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: P=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools. CONCLUSIONS This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.

scholarly journals Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study

10.2196/25531 ◽  
2021 ◽  
Vol 9 (7) ◽  
pp. e25531
Author(s):  
Christina Schüttler ◽  
Hans-Ulrich Prokosch ◽  
Martin Sedlmayr ◽  
Brita Sedlmayr
Keyword(s):  
Medical Informatics ◽  
Contact Point ◽  
Feasibility Studies ◽  
Wilcoxon Test ◽  
Web Based ◽  
Usability Test ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
User Friendly

Background To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface. Objective The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users. Methods The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI’s (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors. Results In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: P=.047; Sample Locator vs ATLAS: P=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: P=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools. Conclusions This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.

scholarly journals ANALISIS USABILITAS PADA APLIKASI MANDIRI ONLINE

2020 ◽  
Vol 15 (1) ◽  
pp. 11
Author(s):  
Astrid Wahyu Adventri Wibowo
Keyword(s):  
Evaluation System ◽  
Internet Banking ◽  
Mobile Banking ◽  
Heuristic Evaluation ◽  
Online Application ◽  
Evaluation Approach ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability ◽  
Search Feature

Internet banking atau mobile banking adalah salah satu bentuk aplikasi yang berbasis internet yang dapat digunakan sebagai pintu gerbang menuju dunia perbankan masa depan. Dalam memberikan layanan, pihak bank tidak ingin mengecewakan nasabahnya karena aplikasi internet banking yang sulit digunakan sehingga mengakibatkan nasabah gagal dalam mencari informasi atau gagal melakukan aktivitas perbankan. Melihat pentingnya usabilitas sebuah aplikasi, maka dilakukan penelitian terhadap aplikasi Mandiri Online untuk mengetahui kelayakan dari aplikasi tersebut, mengidentifikasi permasalahan usabilitas, serta menyusun rekomendasi perbaikan. Aplikasi tersebut diuji menggunakan System Usability Scale (SUS) dan pendekatan heuristic evaluation dengan responden sebanyak 40 orang untuk metode SUS dan 5 evaluator dengan kriteria single-expert untuk pendekatan heuristic evaluation. Hasil pengujian aplikasi Mandiri Online dengan instrumen SUS adalah sebesar 79,6 yang berarti aplikasi Mandiri Online dinyatakan dapat diterima (acceptable), termasuk dalam grade B dengan rating good. Dari penelitian ini juga diketahui bahwa terdapat beberapa permasalahan usabilitas mayor yang harus segera diperbaiki dan harus diberi prioritas tinggi. Dalam menyelesaikan permasalahan tersebut membutuhkan beberapa usaha, seperti  menambahkan fitur search untuk mencari nama bank, membuat pengelompokkan instansi pada menu multipayment, membuat atau menambahkan panduan penggunaan atau flowchart penggunaan Mandiri Online, dan menambahkan fitur help pada Mandiri Online. Abstract[Title: Usability Analysis of Mandiri Online Apllication] Internet banking or mobile banking is a form of internet-based application that can be used as a gateway to the future of banking. In providing services, banks won’t to let down their customers because of internet banking applications are difficult to use, resulting in failure to find information or fail to conduct banking activities. Seeing the importance of application usability, a study of Mandiri Online application was conducted to find out the appropriatness of the application, identify usability issues, and construct recommendations for application improvement. This application was tested using the System Usability Scale (SUS) and heuristic evaluation approach with 40 respondents for the SUS and 5 evaluators with single-expert criteria for the heuristic evaluation. The result of testing the Mandiri Online application with the SUS instrument amounted to 79,6 which means this application was declared acceptable, included in grade B, and with a good rating. From this study it is also known that there are some major usability problems that must be corrected immediately and must be given high priority. In solving these problems requires several efforts, such as adding search feature to search the bank’s name, creating agency groups on multipayment menu, creating or adding usage guidelines or flowcharts for using Mandiri Online, and adding help feature to Mandiri Online.Keywords: Heuristic Evaluation; System Usability Scale; Usability

scholarly journals IMPLEMENTASI METODE WATERFALL PADA PERANCANGAN SISTEM INFORMASI KOPERASI SIMPAN PINJAM BERBASIS WEB DAN ANDROID (STUDI KASUS PT. PEB)

2021 ◽  
Vol 13 (2) ◽  
pp. 133-146
Author(s):  
Galuh Saputri ◽  
Emi Sita Eriana
Keyword(s):  
Information System ◽  
Sequential Design ◽  
Microsoft Excel ◽  
Web Based ◽  
Scale Method ◽  
System Usability Scale ◽  
Savings And Loan ◽  
System Usability ◽  
Waterfall Model ◽  
Permanent Employees

PEB Cooperative is a savings and loan cooperative which is intended for employees of PT. PEB, is engaged in the garment industry. Established since 15 years with the number of cooperative members who are permanent employees of the company. This cooperative becomes an economical shelter to meet the needs of its employees. Technology in admin data processing is still simple using Microsoft Excel tools, in applications that connect members with admins on this system have not been designed, so from the background of this research will design a web-based and android-based savings and loan cooperative information system This design uses the waterfall model which will take a sequential design making it easier for developers and users. The hope is that this design will help make transactions for savings, loans, deposits, data collection, and reports to members, admins and leaders. The results obtained from the questionnaire with the System Usability Scale method in this savings and loan cooperative application are easy to use, faster, and practical, stated by the cooperative members by 84% and cooperative managers by 80%. It can be concluded that this application that has been designed can make it easier to carry out savings and loan transactions quickly and practically.

scholarly journals Usability testing of a Digital Assessment Routing Tool: An Iterative Convergent Mixed Methods Study Protocol (Preprint)

2021 ◽  
Author(s):  
Cabella Lowe ◽  
Harry Hanuman-Sing ◽  
Mitchell Browne ◽  
Meshari F. Alwashmi ◽  
William Marsh ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Mixed Methods ◽  
Data Collection ◽  
Quantitative Data ◽  
Usability Testing ◽  
Manuscript Submission ◽  
Digital Assessment ◽  
Usability Problems ◽  
System Usability Scale ◽  
System Usability

BACKGROUND Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on healthcare utilization. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials, the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials. OBJECTIVE This study will use the iterative-convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. This will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. METHODS We will collect qualitative and quantitative data from between 20-30 participants aged 18 and over four months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 Standard and the System Usability Scale (SUS), providing a benchmark usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles. RESULTS This study received approval from Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) in June 2020. At manuscript submission, the first round of individual interviews has been completed, with data collection to be completed and results published in 2021. CONCLUSIONS This study will provide evidence concerning mHealth DART system usability and acceptance determining system improvements required to support user adoption and minimize sub-optimal system usability as a potential confounder within subsequent non-inferiority clinical trials. This deliberately rigorous approach to mHealth innovation could be used as a guide for other developers of similar applications. Success should produce a safe, effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services.

scholarly journals A Federated Online Search Tool for Biospecimens (Sample Locator): Usability Study

10.2196/17739 ◽  
2020 ◽  
Vol 22 (8) ◽  
pp. e17739
Author(s):  
Christina Schüttler ◽  
Verena Huth ◽  
Magdaléna von Jagwitz-Biegnitz ◽  
Martin Lablans ◽  
Hans-Ulrich Prokosch ◽  
...  
Keyword(s):  
Sustainable Use ◽  
User Centered Design ◽  
Federated Search ◽  
Team Members ◽  
Related Data ◽  
System Usability Scale ◽  
System Usability ◽  
Usability Analysis ◽  
Search Tool ◽  
User Friendly

Background The German Biobank Alliance (GBA) aims to establish a cross-site biobank network. For this endeavor, the so-called Sample Locator, a federated search tool for biospecimens and related data, has been developed, forming the heart of its information technology (IT) infrastructure. Objective To ensure the sustainable use of such a tool, we included researchers as participants in an end user–based usability evaluation. Methods To develop a prototype ready for evaluation, we needed input from GBA IT experts. Thus, we conducted a 2-day workshop with 8 GBA IT team members. The focus was on the respective steps of a user-centered design process. With the acquired knowledge, the participants designed low-fidelity mock-ups. The main ideas of these mock-ups were discussed, extracted, and summarized into a comprehensive prototype using Microsoft PowerPoint. Furthermore, we created a questionnaire concerning the usability of the prototype, including the System Usability Scale (SUS), questions on negative and positive aspects, and typical tasks to be fulfilled with the tool. Subsequently, the prototype was pretested on the basis of this questionnaire with researchers who have a biobank background. Based on this preliminary work, the usability analysis was ultimately carried out with researchers and the results were evaluated. Results Altogether, 27 researchers familiar with sample requests evaluated the prototype. The analysis of the feedback certified a good usability, given that the Sample Locator prototype was seen as intuitive and user-friendly by 74% (20/27) of the participants. The total SUS score by the 25 persons that completed the questionnaire was 80.4, indicating good system usability. Still, the evaluation provided useful advice on optimization potential (eg, offering a help function). Conclusions The findings of this usability analysis indicate that the considerations regarding a user-friendly application that have been made in the development process so far strongly coincide with the perception of the study participants. Nevertheless, it was important to engage prospective end users to ensure that the previous development is going in the desired direction and that the Sample Locator will be used in the future. The user comments and suggestions for improvement will be considered in upcoming iterations for refinement.

scholarly journals A Federated Online Search Tool for Biospecimens (Sample Locator): Usability Study (Preprint)

2020 ◽  
Author(s):  
Christina Schüttler ◽  
Verena Huth ◽  
Magdaléna von Jagwitz-Biegnitz ◽  
Martin Lablans ◽  
Hans-Ulrich Prokosch ◽  
...  
Keyword(s):  
Sustainable Use ◽  
User Centered Design ◽  
Federated Search ◽  
Team Members ◽  
Related Data ◽  
System Usability Scale ◽  
System Usability ◽  
Usability Analysis ◽  
Search Tool ◽  
User Friendly

BACKGROUND The German Biobank Alliance (GBA) aims to establish a cross-site biobank network. For this endeavor, the so-called Sample Locator, a federated search tool for biospecimens and related data, has been developed, forming the heart of its information technology (IT) infrastructure. OBJECTIVE To ensure the sustainable use of such a tool, we included researchers as participants in an end user–based usability evaluation. METHODS To develop a prototype ready for evaluation, we needed input from GBA IT experts. Thus, we conducted a 2-day workshop with 8 GBA IT team members. The focus was on the respective steps of a user-centered design process. With the acquired knowledge, the participants designed low-fidelity mock-ups. The main ideas of these mock-ups were discussed, extracted, and summarized into a comprehensive prototype using Microsoft PowerPoint. Furthermore, we created a questionnaire concerning the usability of the prototype, including the System Usability Scale (SUS), questions on negative and positive aspects, and typical tasks to be fulfilled with the tool. Subsequently, the prototype was pretested on the basis of this questionnaire with researchers who have a biobank background. Based on this preliminary work, the usability analysis was ultimately carried out with researchers and the results were evaluated. RESULTS Altogether, 27 researchers familiar with sample requests evaluated the prototype. The analysis of the feedback certified a good usability, given that the Sample Locator prototype was seen as intuitive and user-friendly by 74% (20/27) of the participants. The total SUS score by the 25 persons that completed the questionnaire was 80.4, indicating good system usability. Still, the evaluation provided useful advice on optimization potential (eg, offering a help function). CONCLUSIONS The findings of this usability analysis indicate that the considerations regarding a user-friendly application that have been made in the development process so far strongly coincide with the perception of the study participants. Nevertheless, it was important to engage prospective end users to ensure that the previous development is going in the desired direction and that the Sample Locator will be used in the future. The user comments and suggestions for improvement will be considered in upcoming iterations for refinement.

scholarly journals App-based Self-administrable Clinical Tests of Physical Function: Development and Usability Study (Preprint)

2019 ◽  
Author(s):  
Ronny Bergquist ◽  
Beatrix Vereijken ◽  
Sabato Mellone ◽  
Mattia Corzani ◽  
Jorunn L. Helbostad ◽  
...  
Keyword(s):  
Physical Function ◽  
The Self ◽  
Clinical Tests ◽  
Home Setting ◽  
The Third ◽  
Usability Problems ◽  
Home Based ◽  
System Usability Scale ◽  
System Usability ◽  
Experience Questionnaire

BACKGROUND Objective measures of physical function in older adults are widely used to predict health outcomes such as disability, institutionalization, and mortality. App-based clinical tests allow users to assess their own physical function and have objective tracking of changes over time by use of their smartphones. Such tests can potentially guide interventions remotely and provide more detailed prognostic information about the participant’s physical performance for the users, therapists, and other health care personnel. We developed 3 smartphone apps with instrumented versions of the Timed Up and Go (Self-TUG), tandem stance (Self-Tandem), and Five Times Sit-to-Stand (Self-STS) tests. OBJECTIVE This study aimed to test the usability of 3 smartphone app–based self-tests of physical function using an iterative design. METHODS The apps were tested in 3 iterations: the first (n=189) and second (n=134) in a lab setting and the third (n=20) in a separate home-based study. Participants were healthy adults between 60 and 80 years of age. Assessors observed while participants self-administered the tests without any guidance. Errors were recorded, and usability problems were defined. Problems were addressed in each subsequent iteration. Perceived usability in the home-based setting was assessed by use of the System Usability Scale, the User Experience Questionnaire, and semi-structured interviews. RESULTS In the first iteration, 7 usability problems were identified; 42 (42/189, 22.0%) and 127 (127/189, 67.2%) participants were able to correctly perform the Self-TUG and Self-Tandem, respectively. In the second iteration, errors caused by the problems identified in the first iteration were drastically reduced, and 108 (108/134, 83.1%) and 106 (106/134, 79.1%) of the participants correctly performed the Self-TUG and Self-Tandem, respectively. The first version of the Self-STS was also tested in this iteration, and 40 (40/134, 30.1%) of the participants performed it correctly. For the third usability test, the 7 usability problems initially identified were further improved. Testing the apps in a home setting gave rise to some new usability problems, and for Self-TUG and Self-STS, the rates of correctly performed trials were slightly reduced from the second version, while for Self-Tandem, the rate increased. The mean System Usability Scale score was 77.63 points (SD 16.1 points), and 80-95% of the participants reported the highest or second highest positive rating on all items in the User Experience Questionnaire. CONCLUSIONS The study results suggest that the apps have the potential to be used to self-test physical function in seniors in a nonsupervised home-based setting. The participants reported a high degree of ease of use. Evaluating the usability in a home setting allowed us to identify new usability problems that could affect the validity of the tests. These usability problems are not easily found in the lab setting, indicating that, if possible, app usability should be evaluated in both settings. Before being made available to end users, the apps require further improvements and validation.

scholarly journals A Novel Educational Prescription Web-Based Application to Support Education for Caregivers of People Living With Dementia: Development and Usability Study With Clinicians

10.2196/23904 ◽  
2020 ◽  
Vol 7 (4) ◽  
pp. e23904
Author(s):  
Anthony J Levinson ◽  
John Bousfield ◽  
William Douglas ◽  
Stephanie Ayers ◽  
Richard Sztramko
Keyword(s):  
Field Trial ◽  
Trial Period ◽  
User Testing ◽  
Web Based ◽  
System Usability Scale ◽  
Net Promoter Score ◽  
System Usability ◽  
Net Promoter ◽  
Competing Priorities ◽  
Dementia Education

Background It is estimated that 564,000 Canadians are currently living with dementia and there are approximately 486,000 to 1.1 million informal family/friend caregivers. Family/friend caregivers often receive little to no education or training about dementia but are expected to provide ongoing support for a complex condition. Web-based family/friend caregiver interventions may be helpful, but little is known about how best to implement them. Objective The objectives of this study were to 1) design and develop a novel education prescription application to help scale and spread web-based dementia education to family/friend caregivers, 2) conduct user testing, and 3) conduct a larger-scale field trial. Methods A novel education prescription web-based application was designed and developed. Initial user testing used task completion and the “think aloud” technique with a small sample of representative clinicians who work with people living with dementia and family/friend caregivers. Following iterative incorporation of feedback, a larger field trial was conducted with a convenience sample of clinicians. Account invitations were sent to 55 clinicians and, following a 2-month trial period, surveys were administered to participants including the System Usability Scale and the Net Promoter Score. Results During the initial user testing phase, participants (N=7) from representative disciplines easily completed associated tasks, and had very positive feedback with respect to the usability of the application. The System Usability Scale score during this phase was 91.4. Suggestions from feedback were incorporated into the application. During the larger field trial phase, participants (total N=55; activated account n=17; did not activate account n=38) were given access to the iGeriCare education prescription application. During this period, 2 participants created educational prescriptions; a total of 3 educational prescriptions were sent. Survey completers who did not activate their account (n=5) identified that their lack of use was due to time constraints, competing priorities, or forgetting to use the application. Survey completers who activated their account (n=5) identified their lower use was due to lack of time, lack of eligible family/friend caregivers during trial period, and competing priorities due to the COVID-19 pandemic. The System Usability Scale score during this phase was 78.75, and the Net Promoter Score was 50. Conclusions Study findings indicate a generally positive response for the usability of a web-based application for clinicians to prescribe dementia education to family/friend caregivers. The dissonance between the promising data and widespread enthusiasm for the design and purpose of the education prescription application found in the initial user testing phase and subsequent lack of significant adoption in the field trial represents both an important lesson for other novel health technologies and a potential area for further investigation. Further research is required to better understand factors associated with implementation of this type of intervention and impact on dissemination of education to family/friend caregivers.

scholarly journals Evaluasi Usability Situs Web Kemenkumham Kantor Wilayah Jambi dengan Metode Usability Test dan System Usability Scale

2019 ◽  
Vol 2 (1) ◽  
pp. 30
Author(s):  
Beny Beny ◽  
Herti Yani ◽  
Gessy Mahargya Ningrum
Keyword(s):  
Usability Testing ◽  
Usability Test ◽  
System Usability Scale ◽  
System Usability

Situs Kemenkumham Jambi merupakan situs yang memberikan informasi mengenai profil Kanwil Kemenkumham Jambi dan memberikan layanan pengaduan yang dapat di akses oleh masyarakat. Permasalahan yang ditemukan adalah tidak semua informasi tersedia didalam situs tersebut dan sebagian masyarakat belum banyak yang mengetahui fungsi dari layanan yang ada pada situs tersebut. Tujuan dari penelitian ini adalah untuk mengetahui tingkat kegunaan (Usability) dari sebuah situs dengan menggunakan metode Usability Testing dan kuesioner System Usability Scale (SUS). Perhitungan dilakukan dengan cara  menganalisis skenario yang telah diselesaikan dan menganalisis kuesioner pada masyarakat Jambi, kemudian dihitung berdasarkan rumus System Usability Scale (SUS). Selanjutnya, hasil perhitungan dari kuesioner SUS dan Task Skenario yang telah dijalani dan disebarkan kepada 30 responden dijadikan dasar dalam merumuskan saran dan rekomendasi yang tepat. Hasil dari penelitian ini yaitu sebuah saran dan rekomendasi Usability dari tampilan Interface sebuah situs Kantor Wilayah Kementrian Hukum dan HAM Jambi

Sign in / Sign up

Export Citation Format

Share Document