Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation (Preprint)

BACKGROUND The System Usability Scale (SUS) is a common metric used to assess the usability of a system, and it was initially developed in English. The implementation of electronic systems for clinical counseling (eHealth and mobile health) is increasing worldwide. Therefore, tools are needed to evaluate these applications in the languages and regional contexts in which the electronic tools are developed. OBJECTIVE This study aims to translate, culturally adapt, and validate the original English version of the SUS into a Spanish version. METHODS The translation process included forward and backward translation. Forward translations were made by 2 native Spanish speakers who spoke English as their second language, and a backward translation was made by a native English speaker. The Spanish SUS questionnaire was validated by 10 experts in mobile app development. The face validity of the questionnaire was tested with 10 mobile phone users, and the reliability testing was conducted among 88 electronic application users. RESULTS The content validity index of the new Spanish SUS was good, as indicated by a rating of 0.92 for the relevance of the items. The questionnaire was easy to understand, based on a face validity index of 0.94. The Cronbach α was .812 (95% CI 0.748-0.866; <i>P</i><.001). CONCLUSIONS The new Spanish SUS questionnaire is a valid and reliable tool to assess the usability of electronic tools among Spanish-speaking users.

Download Full-text

Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation

JMIR Human Factors ◽

10.2196/21161 ◽

2020 ◽

Vol 7 (4) ◽

pp. e21161

Author(s):

Magdalena Del Rocio Sevilla-Gonzalez ◽

Lizbeth Moreno Loaeza ◽

Laura Sofia Lazaro-Carrera ◽

Brigette Bourguet Ramirez ◽

Anabel Vázquez Rodríguez ◽

...

Keyword(s):

Mobile App ◽

Spanish Version ◽

Face Validity ◽

Electronic Systems ◽

Validity Index ◽

Clinical Counseling ◽

System Usability Scale ◽

System Usability ◽

The Face ◽

Development And Validation

Background The System Usability Scale (SUS) is a common metric used to assess the usability of a system, and it was initially developed in English. The implementation of electronic systems for clinical counseling (eHealth and mobile health) is increasing worldwide. Therefore, tools are needed to evaluate these applications in the languages and regional contexts in which the electronic tools are developed. Objective This study aims to translate, culturally adapt, and validate the original English version of the SUS into a Spanish version. Methods The translation process included forward and backward translation. Forward translations were made by 2 native Spanish speakers who spoke English as their second language, and a backward translation was made by a native English speaker. The Spanish SUS questionnaire was validated by 10 experts in mobile app development. The face validity of the questionnaire was tested with 10 mobile phone users, and the reliability testing was conducted among 88 electronic application users. Results The content validity index of the new Spanish SUS was good, as indicated by a rating of 0.92 for the relevance of the items. The questionnaire was easy to understand, based on a face validity index of 0.94. The Cronbach α was .812 (95% CI 0.748-0.866; P<.001). Conclusions The new Spanish SUS questionnaire is a valid and reliable tool to assess the usability of electronic tools among Spanish-speaking users.

Download Full-text

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps (Preprint)

10.2196/preprints.10308 ◽

2018 ◽

Author(s):

Muhamad Fadhil Mohamad Marzuki ◽

Nor Azwany Yaacob ◽

Najib Majdi Yaacob

Keyword(s):

Cultural Adaptation ◽

Mobile Apps ◽

Mobile App ◽

Cross Cultural ◽

Face Validity ◽

Validity Index ◽

Cross Cultural Adaptation ◽

System Usability Scale ◽

System Usability ◽

The Face

BACKGROUND A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. OBJECTIVE The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. METHODS Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. RESULTS The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. CONCLUSIONS The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia.

Download Full-text

The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study (Preprint)

10.2196/preprints.11500 ◽

2018 ◽

Author(s):

Leming Zhou ◽

Jie Bao ◽

I Made Agus Setiawan ◽

Andi Saptono ◽

Bambang Parmanto

Keyword(s):

Reliability And Validity ◽

Correlation Coefficients ◽

Internal Consistency Reliability ◽

Mobile App ◽

Target User ◽

System Usability Scale ◽

System Usability ◽

Study Participants ◽

Development And Validation ◽

Mhealth Apps

BACKGROUND After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users’ feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS The newly created mHealth app usability questionnaire—MAUQ—has the reliability and validity required to assess mHealth app usability.

Download Full-text

Development and validation of the medical professionals resilience scale

BMC Health Services Research ◽

10.1186/s12913-021-06542-w ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Mardhati Ab Rahman ◽

Muhamad Saiful Bahri Yusoff ◽

Nurhanis Syazni Roslan ◽

Jamilah Al-Muhammady Mohammad ◽

Anisa Ahmad

Keyword(s):

Growth Control ◽

Questionnaire Development ◽

Factor Loading ◽

Face Validity ◽

Medical Professionals ◽

Validity Index ◽

Resilience Scale ◽

The Face ◽

Development And Validation ◽

Face Validation

Abstract Purpose Most of the resilience scales were developed for the non-medical population, therefore the purpose of this study was developing and validating a resilience scale for medical professionals – namely Medical Professionals Resilience Scale (MeRS). Methods A questionnaire development and validation study was conducted. The resilience domains and items were identified and generated through a literature review. The content validation was carried out by content experts and the content validity index (CVI) was calculated. The face validation was performed by medical officers and the face validity index (FVI) was calculated. The final MeRS was administered to 167 medical officers, exploratory factor analysis (EFA) and reliability analysis were performed to assess MeRS’s factorial structure and internal consistency. Results Four domains with 89 items of medical professionals’ resilience were developed. Following that, the content and face validation was conducted, and a total of 41-items remained for construct validation. EFA extracted four factors, namely growth, control, involvement, and resourceful, with a total of 37 items. The items’ CVI and FVI values were more than 0.80. The final MeRS’s items had factor loading values ranged from 0.41 to 0.76, and the Cronbach’s alpha values of the resilience domains ranged from 0.72 to 0.89. Conclusions MeRS is a promising scale for measuring medical professionals’ resilience as it showed good psychometric properties. This study provided validity evidence in terms of content, response process, and internal structure that supported the validity of MeRS in the measurement of resilience domains among medical professionals.

Download Full-text

Development and Validation of the Medical Professionals Resilience Scale

10.21203/rs.3.rs-154203/v1 ◽

2021 ◽

Author(s):

Mardhati Ab Rahman ◽

Muhamad Saiful Bahri Yusoff ◽

Nurhanis Syazni Roslan ◽

Jamilah Al-Muhammady Mohammad ◽

Anisa Ahmad

Keyword(s):

Growth Control ◽

Questionnaire Development ◽

Factor Loading ◽

Face Validity ◽

Medical Professionals ◽

Validity Index ◽

Resilience Scale ◽

The Face ◽

Development And Validation ◽

Face Validation

Abstract Purpose: Most of the resilience scales were developed for the non-medical population, therefore the purpose of this study was developing and validating a resilience scale for medical professionals – namely Medical Professionals Resilience Scale (MeRS).Methods: A questionnaire development and validation study was conducted. The resilience domains and items were identified and generated through a literature review. The content validation was carried out by content experts and the content validity index (CVI) was calculated. The face validation was performed by medical officers and the face validity index (FVI) was calculated. The final MeRS was administered to 167 medical officers, exploratory factor analysis (EFA) and reliability analysis were performed to assess MeRS’s factorial structure and internal consistency. Results: Four domains with 89 items of medical professionals’ resilience were developed. Following that, the content and face validation was conducted, and a total of 41-items remained for construct validation. EFA extracted four factors, namely growth, control, involvement, and resourceful, with a total of 37 items. The items’ CVI and FVI values were more than 0.80. The final MeRS’s items had factor loading values ranged from 0.41 to 0.76, and the Cronbach’s alpha values of the resilience domains ranged from 0.72 to 0.89. Conclusion: MeRS is a promising scale for measuring medical professionals’ resilience as it showed good psychometric properties. This study provided validity evidence in terms of content, response process, and internal structure that supported the validity of MeRS in the measurement of resilience domains among medical professionals.

Download Full-text

Development and Validation of a Modified Version of the Edmonton Symptom Assessment Scale in a Flemish Palliative Care Population

American Journal of Hospice and Palliative Medicine® ◽

10.1177/1049909111400724 ◽

2011 ◽

Vol 28 (7) ◽

pp. 475-482 ◽

Cited By ~ 12

Author(s):

Patricia Claessens ◽

Johan Menten ◽

Paul Schotsmans ◽

Bert Broeckaert

Keyword(s):

Palliative Care ◽

Symptom Assessment ◽

Assessment Scale ◽

Face Validity ◽

Patients With Cancer ◽

Edmonton Symptom Assessment Scale ◽

The Face ◽

Palliative Care Units ◽

Symptom Assessment Scale ◽

Development And Validation

Palliative cancer patients are faced with multiple symptoms that threaten their quality of life. To manage these symptoms, a reliable and valid way of registration is crucial. In this study, the Edmonton Symptom Assessment Scale (ESAS) has been translated, modified, and tested on content, face, criterion, construct validity, and internal consistency for patients admitted to Flemish palliative care units. These aspects are tested in a descriptive, comparative, longitudinal study based on 3 convenience samples. The first consisted of 8 palliative care experts. The second sample checked the face validity and consisted of 4 patients, 5 family members, and 5 nurses. The last sample involved 23 patients admitted to 3 Flemish palliative care units. Heedful of the “new-wave” vision on validity, the translated and altered ESAS seemed a suitable instrument for the symptom assessment of patients with cancer admitted to a palliative care unit.

Download Full-text

Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension

Investigación y Educación en Enfermería ◽

10.17533/udea.iee.v37n3e09 ◽

2019 ◽

Vol 37 (3) ◽

Cited By ~ 1

Author(s):

Natalia Esquivel Garzón ◽

Luz Patricia Díaz Heredia

Keyword(s):

Treatment Adherence ◽

Content Validity ◽

Statistical Tests ◽

Spanish Version ◽

Face Validity ◽

Validity And Reliability ◽

Cronbach’S Alpha ◽

Validity Index ◽

Content Validity Index ◽

Cronbach's Alpha

Objective. To determine the validity and reliability of the Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH), Spanish version, designed by Chunhua Ma et al.Methods. This study was carried out in the city of Ibagué (Colombia) and the test validation determined validity (face, content, and construct) and reliability. Face and content validity were conducted through expert judgment, using Fleiss’ Kappa Coefficient statistical tests and modified Lawshe’s content validity index. The construct validity and the reliability test had the participation of 220 people with diagnosis of primary hypertension. Reliability was calculated through Cronbach’s alpha statistical test.Results. In the face validity, the instrument reported a Fleiss’ Kappa index was 0.68 in comprehension, 0.76 in clarity, and 0.64 in accuracy, interpreted as a substantial agreement. The content validity index was satisfactory with 0.91; el exploratory factor analysis reported six factors with a total variance explained of 54%. Cronbach’s alpha for the total scale was 0.74.Conclusion. The Spanish version of the TAQPH is a valid and reliable scale to evaluate adherence to treatment in patients with primary hypertension.Descriptors: essential hypertension; treatment adherence and compliance; surveys and questionnaires; psychometrics; validation studies.How to cite this article: Esquivel N, Díaz LP. Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension. Invest. Educ. Enferm. 2019; 37(3):e09.

Download Full-text

Development and Validation of a Novel Surgical Simulation for Parotidectomy and Facial Nerve Dissection

Otolaryngology ◽

10.1177/0194599820913587 ◽

2020 ◽

Vol 163 (2) ◽

pp. 344-347

Author(s):

Fanny Gabrysz-Forget ◽

Samuel Rubin ◽

Dmitry Nepomnayshy ◽

Robert Dolan ◽

Bharat Yarlagadda

Keyword(s):

Facial Nerve ◽

Surgical Simulation ◽

Copper Wire ◽

Low Cost ◽

Face Validity ◽

Training Tool ◽

Parotid Surgery ◽

The Face ◽

Development And Validation ◽

Novel Model

We present the development and validation of a low-cost novel model for training of parotid surgery. The model consists of a 3-dimensionally printed skeleton, silicone-based soft tissue, and facial nerve replicated with copper wire, circuited to indicate contact with instruments. The face validity of the simulator was evaluated with a 21-item 5-point Likert survey. Content validity was evaluated through a survey completed by the trainees after their first live parotidectomy following the simulation. Twelve residents and 6 faculty completed the simulated procedure of superficial parotidectomy after watching a video demonstration. Completion of 16 surgical steps evaluated by this model was graded for each participant. The mean ± SD total assessment score for faculty was 15.83 ± 0.41, as compared with 13.33 ± 2.06 for residents ( P = .0081). The simulator as a training tool was well received by both faculty and residents (5 vs 4, P = .0206). Participants strongly agreed that junior residents would benefits from use of the model.

Download Full-text

Establishing Face and Content Validity of a Survey to Assess Users’ Perceptions of Automated Vehicles

Transportation Research Record Journal of the Transportation Research Board ◽

10.1177/0361198120930225 ◽

2020 ◽

Vol 2674 (9) ◽

pp. 538-547

Author(s):

Justin Mason ◽

Sherrilene Classen ◽

James Wersal ◽

Virginia P. Sisiopiku

Keyword(s):

Technology Acceptance ◽

Content Validity ◽

Reliability And Validity ◽

Face Validity ◽

Automated Vehicles ◽

Validity Index ◽

Adoption Of Technology ◽

Content Validity Index ◽

Technology Acceptance Models ◽

The Face

Fully automated vehicles hold promise for providing numerous societal benefits, including drastically reducing road fatalities. However, we know little about the adoption practices of individuals related to automated vehicles. To assess transportation users’ perceptions of automated vehicles, a 40-item survey was designed using guidance from several technology acceptance models. A focus group was used to assess face validity to ensure the items appeared credible and understandable to the layperson. Seven subject-matter experts rated items for their relevance to provide a content validity index for each item and for the overall survey. The final scale had a scale content validity index rating of 1.00, with 32 of 32 items rated greater than or equal to 0.86 and a scale content validity index of 0.96 (mean content validity index of all items), indicating acceptable content validity. The approach adopted in this study ensured the face and content validity of the survey and enhanced the items’ relevance, concision, and clarity. Future validation is required to assess scale reliability and validity. The paper provides an overview of models used for determining acceptance and adoption of technology and describes in detail the methodology used to establish face and content validity of the questionnaire survey developed for assessing adults’ perceptions of automated vehicles.

Download Full-text

Utilization of a Mobile App to Assess Psychiatric Patients With Limited English Proficiency

Hispanic Journal of Behavioral Sciences ◽

10.1177/0739986317707490 ◽

2017 ◽

Vol 39 (3) ◽

pp. 369-380 ◽

Cited By ~ 3

Author(s):

Oscar Villalobos ◽

Stephanie Lynch ◽

Conni DeBlieck ◽

Linda Summers

Keyword(s):

Limited English Proficiency ◽

English Proficiency ◽

Psychiatric Symptoms ◽

Psychiatric Patients ◽

Mobile App ◽

Practice Change ◽

Spanish Speaking ◽

System Usability Scale ◽

System Usability ◽

Wrong Diagnosis

The interactions in mental health involve a significant exchange of information to identify symptoms and formulate a working diagnosis. The inability of patients to communicate due to language limitations may lead to situations that will be detrimental, such as receiving the wrong diagnosis or treatment due to the inadequate translation from English to Spanish. A practice change was proposed where health care personnel utilized mobile technology such as the Canopy Translation App to assess the psychiatric symptoms of Spanish-speaking patients with limited English proficiency. Participants completed the System Usability Scale (SUS) to determine whether they found the Canopy Translation App useful during their assessments of Spanish-speaking patients. According to the SUS scores, participants found the Canopy Translation App useful during their interactions with Spanish-speaking patients. The findings emphasize the importance of exploring new resources and technologies to ameliorate language barriers.

Download Full-text