scholarly journals Malay Version of the mHealth App Usability Questionnaire (M-MAUQ): Translation, Adaptation, and Validation Study

10.2196/24457 ◽  
2021 ◽  
Vol 9 (2) ◽  
pp. e24457
Author(s):  
Norashikin Mustafa ◽  
Nik Shanita Safii ◽  
Aida Jaffar ◽  
Nor Samsiah Sani ◽  
Mohd Izham Mohamad ◽  
...  
Keyword(s):  
Reliability And Validity ◽  
General System ◽  
Kappa Statistic ◽  
Ease Of Use ◽  
Face Validity ◽  
Validity Index ◽  
Good Reliability ◽  
Target User ◽  
Forward Translation ◽  
Mhealth Apps

Background Mobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients’ health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness. Objective This study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia. Methods Forward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app. Results The content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app. Conclusions The M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

scholarly journals Malay Version of the mHealth App Usability Questionnaire (M-MAUQ): Translation, Adaptation, and Validation Study (Preprint)

2020 ◽  
Author(s):  
Norashikin Mustafa ◽  
Nik Shanita Safii ◽  
Aida Jaffar ◽  
Nor Samsiah Sani ◽  
Mohd Izham Mohamad ◽  
...  
Keyword(s):  
Reliability And Validity ◽  
General System ◽  
Kappa Statistic ◽  
Ease Of Use ◽  
Face Validity ◽  
Validity Index ◽  
Good Reliability ◽  
Target User ◽  
Forward Translation ◽  
Mhealth Apps

BACKGROUND Mobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients’ health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness. OBJECTIVE This study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia. METHODS Forward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app. RESULTS The content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app. CONCLUSIONS The M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

scholarly journals The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study (Preprint)

2018 ◽  
Author(s):  
Leming Zhou ◽  
Jie Bao ◽  
I Made Agus Setiawan ◽  
Andi Saptono ◽  
Bambang Parmanto
Keyword(s):  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Internal Consistency Reliability ◽  
Mobile App ◽  
Target User ◽  
System Usability Scale ◽  
System Usability ◽  
Study Participants ◽  
Development And Validation ◽  
Mhealth Apps

BACKGROUND After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users’ feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS The newly created mHealth app usability questionnaire—MAUQ—has the reliability and validity required to assess mHealth app usability.

scholarly journals Development and Validation of the Smartphone Addiction Scale for Children- Parent Version (SASC-P)

2021 ◽  
Author(s):  
Gopi Rajendhiran ◽  
Vikhram Ramasubramanian ◽  
P Bijulakshmi ◽  
S Mathumathi ◽  
M Kannan
Keyword(s):  
Children And Adolescents ◽  
Reliability And Validity ◽  
Small Sample ◽  
Face Validity ◽  
Smartphone Addiction ◽  
Cronbach’S Alpha ◽  
Good Reliability ◽  
Children And Adolescent ◽  
Cronbach's Alpha ◽  
Smartphone Use

Introduction: The use of smartphone among children and adolescents has been increasing steadily over the past decade and is becoming a cause of concern for parents and healthcare professionals alike. Excessive use of smartphone could make a child vulnerable to develop addictive behaviour leading to decrease in academic performance and impairments in social and personal environment. Early identification is key to addressing this issue and although there are scales to measure smartphone addiction in adults, there are no scales to measure smartphone use in children objectively. Aim: To construct a smartphone addiction scale for children that can be administered to parents. Materials and Methods: A set of statements were created to assess smartphone addiction in children. Initially, 43 statements were selected after identifying its content validity and face validity and the scale was administered to parents of children in the age group of 3-17 years after obtaining informed consent from the parents. The construct validity was examined by the exploratory factor analysis. The screen plot of ordered eigen values of a correlation matrix was used to decide the appropriate number of factors extracted. A factor loading of >0.30 was used to determine the items for each factor. Intra-class correlations were calculated for the test-retest reliability, and Cronbach's alpha was calculated for the internal consistency. The final questionnaire contained 24 statements across six subdomains of smartphone addiction and it was administered to a small sample group of 65 parents of children aged 3-17 years and the data was used to test for reliability and validity of the scale. Results: Alpha correlation for the Smartphone Addiction Scale for Children-Parent (SASC-P) ranged from 0.670 to 0.823. The intrinsic validity for the domains was calculated using Cronbach’s alpha and it ranged from 0.819 to 0.907 for the domains and was 0.972 for the whole questionnaire. Thus the scale was found to be reliable and valid for use in children and adolescents. Conclusion: The SASC-P has good reliability and validity and can be used to measure smartphone use in children and adolescent.

Diagnostic Interview for Genetic Studies (DIGS): Inter-rater and test-retest reliability and validity in a Spanish population

2007 ◽  
Vol 22 (1) ◽  
pp. 44-48 ◽  
Author(s):  
Miguel Roca ◽  
Rocio Martin-Santos ◽  
Jerónimo Saiz ◽  
Jordi Obiols ◽  
Maria J. Serrano ◽  
...  
Keyword(s):  
Major Depression ◽  
Reliability And Validity ◽  
Kappa Statistic ◽  
Diagnostic Interview ◽  
Spanish Version ◽  
Spanish Population ◽  
Good Reliability ◽  
Retest Reliability ◽  
Kappa Value ◽  
Test Retest Reliability

AbstractObjectiveTo test the reliability and validity of the DIGS in Spanish population.MethodsInter-rater and test-retest reliability of the Spanish version of DIGS was tested in 95 inpatients and outpatients. The resultant diagnoses were compared with diagnoses obtained by the LEAD (Longitudinal Expert All Data) procedure as “gold standard”. The kappa statistic was used to measure concordance between blind inter-raters and between the diagnoses obtained by LEAD procedure and through the DIGS.ResultsOverall kappa coefficient for inter-rater reliability was 0.956. The kappa value for individual diagnosis varied from major depression = 0.877 to schizophrenia = 1. Test-retest reliability was 0.926. Kappa for all individual target diagnoses ranged from 0.776 (major depression) to 1. Kappa between LEAD procedure and DIGS ranged from 0.704 (major depression) to 0.825 (bipolar I disorder).ConclusionMost of the DSM-IV major psychiatric disorders can be assessed with acceptable to excellent reliability with the Spanish version of the DIGS interview. The Spanish version of DIGS showed an acceptable to excellent concurrent validity. Giving the good reliability and validity of Spanish version of DIGS it should be considered to identify psychiatric phenotypes for genetics studies.

Development and validation of Nurses’ Moral Courage Scale

2018 ◽  
Vol 26 (7-8) ◽  
pp. 2438-2455 ◽  
Author(s):  
Olivia Numminen ◽  
Jouko Katajisto ◽  
Helena Leino-Kilpi
Keyword(s):  
Internal Consistency ◽  
Reliability And Validity ◽  
Principal Component ◽  
Moral Courage ◽  
Face Validity ◽  
University Hospital ◽  
Moral Competence ◽  
Good Reliability ◽  
Cross Sectional ◽  
Convenience Sample

Background: Moral courage is required at all levels of nursing. However, there is a need for development of instruments to measure nurses’ moral courage. Objectives: The objective of this study is to develop a scale to measure nurses’ self-assessed moral courage, to evaluate the scale’s psychometric properties, and to briefly describe the current level of nurses’ self-assessed moral courage and associated socio-demographic factors. Research design: In this methodological study, non-experimental, cross-sectional exploratory design was applied. The data were collected using Nurses’ Moral Courage Scale and analysed statistically. Participants and research context: The data were collected from a convenience sample of 482 nurses from four different clinical fields in a major university hospital in Finland for the final testing of the scale. The pilot comprised a convenience sample of 129 nurses. Ethical considerations: The study followed good scientific inquiry guidelines. Ethical approval was obtained from the university ethics committee and permission to conduct the study from the participating hospital. Findings: Psychometric evaluation showed that the 4-sub-scale, 21-item Nurses’ Moral Courage Scale demonstrates good reliability and validity at its current state of development showing a good level of internal consistency for a new scale, the internal consistency values ranging from 0.73 to 0.82 for sub-scales and 0.93 for the total scale, thus well exceeding the recommended Cronbach’s alpha value of >0.7. Principal component analysis and confirmatory factor analysis supported the theoretical construct of Nurses’ Moral Courage Scale. Face validity and expert panel assessments markedly contributed to the relevance of items in establishing content validity. Discussion and conclusion: Nurses’ Moral Courage Scale provides a new generic instrument intended for measuring nurses’ self-assessed moral courage. Recognizing the importance of moral courage as a part of nurses’ moral competence and its assessment offers possibilities to develop interventions and educational programs for enhancement of moral courage. Research should focus on further validation measures of Nurses’ Moral Courage Scale in international contexts.

scholarly journals Design and Preliminary Testing of the Caregiver-Centered Communication Questionnaire (CCCQ)

2019 ◽  
Vol 35 (3) ◽  
pp. 154-160
Author(s):  
George Demiris ◽  
Freda DeKeyser Ganz ◽  
Claire J. Han ◽  
Kenneth Pike ◽  
Debra Parker Oliver ◽  
...  
Keyword(s):  
Family Caregivers ◽  
Family Caregiver ◽  
Reliability And Validity ◽  
Ease Of Use ◽  
Face Validity ◽  
Patient Centered ◽  
Study Objective ◽  
Serious Illness ◽  
Domain Experts ◽  
Initial Questionnaire

The study objective was to develop and test a new survey instrument that measures caregiver-centered communication. We developed a questionnaire inspired by the National Cancer Institute framework on patient-centered communication, focusing on family caregiver communication for this tool. The questionnaire includes 5 subscales: exchange of information, relationship with team, emotions, managing care, and decision-making. The initial questionnaire was reviewed by domain experts for face validity and edited further to include 30 items. We administered the modified questionnaire to 115 family caregivers of patients with serious illness in various settings. Cronbach α for the entire scale was 0.97 and ranged from 0.82 to 0.93 for the 5 subscales. Participants found that the survey addressed important concepts and that items were in most cases easy to understand. This instrument provides a structured way to assess caregiver-centered communication, addressing a pressing need for tools that measure the extent to which communication is responsive to the needs and preferences of family caregivers. Further testing and refinement are needed to improve the ease of use and examine the reliability and validity of this measure.

Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity

2018 ◽  
Vol 62 (1) ◽  
pp. 1414-1418 ◽  
Author(s):  
Meiyuzi Gao ◽  
Philip Kortum ◽  
Frederick Oswald
Keyword(s):  
Factor Model ◽  
High Reliability ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Ease Of Use ◽  
Face Validity ◽  
Four Dimensions ◽  
System Sensitivity ◽  
Microsoft Word ◽  
System Usability Scale

The Usefulness, Satisfaction, and Ease of Use Questionnaire (USE, Lund, 2001) measures the subjective usability of a product or service. It is a 30-item survey that examines four dimensions of usability: usefulness, ease of use, ease of learning, and satisfaction. This metric can be applied to various scenarios of usability assessment because it is non-proprietary and technology-agnostic. Items in the USE also have good face validity with unambiguous and relevant descriptions. However, little published research has reported reliability or validity of the USE. The current study aims to address this issue by investigating psychometric properties of the USE. One hundred and fifty-one participants from Mechanical Turk (MTurk) evaluated Microsoft Word and Amazon.com on the USE and the System Usability Scale (SUS, Brooke, 1996). Ignoring the four dimensions in the USE, Cronbach’s alpha was .98, which indicates high reliability of overall USE score. The scale-reliability of dropping any item was .98 in both products. In terms of correlations between the USE dimensions and the SUS, validity was statistically and practically significant ( r between .60 and .82, p < .001). System sensitivity of the USE was also demonstrated via significant t-tests on the USE scores between Microsoft Word and Amazon.com . A principal axis factor analysis revealed a four-factor model that is different from the original model. Three factors resembled the original dimensions, and a fourth factor was related to multiple dimensions. Overall, the USE is a valid and reliable instrument that needs further refinement.

scholarly journals Development and preliminary validation of the competency model for rural general practitioner in China

2020 ◽  
Author(s):  
Yun Wei ◽  
Yanli Liu ◽  
Xuexue Zhao ◽  
Guanghui Jin ◽  
Yali Zhao ◽  
...  
Keyword(s):  
General Practitioner ◽  
Pilot Study ◽  
Rural Areas ◽  
Panel Discussion ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Competency Model ◽  
Face Validity ◽  
Validity And Reliability ◽  
Good Reliability

Abstract Background There is a shortage of rural general practitioners (GPs) in China. Training programs have been initiated to meet the needs of GP workforce in the rural areas; however, there is an absence of validated tool to assess their competencies. Objective This study aimed to develop a competency model for rural general practitioner (CMRGP) after training in China and to examine its validity and reliability. Methods A multistage process was adopted to develop the CMRGP comprised literature review, panel discussion and expert consultation, and the initial version of CMRGP was reduced from 10 domains and 77 items to 7 domains and 54 items. A pilot study was conducted among 202 rural GPs for the psychometric evaluation and application of the initial version of CMRGP, in which a questionnaire on the importance of items and self-evaluation was completed by the GPs. Results In the pilot study, 132 completed questionnaires (65.3%) were returned. Acceptability and face validity of the CMRGP were supported by high importance scores of the items, in which 52 out of 54 items achieved score higher than 4.00 (possible score from 0 to 5). Factor analysis supported the construct validity. After the modification, the final version of CMRGP contained 6 domains and 47 items. Good reliability was supported by internal consistency reliability (Cronbach’s α was 0.98) and split-half reliability (Spearman–Brown coefficient was 0.99). Conclusions The CMRGP demonstrated good reliability and validity. Pilot study showed its potential for application in the rural general practice and training program.

scholarly journals Development and Evaluation of Inexpensive Ultrasound Using A-Mode and M-Mode Signals to Identify Lung Depth and Avoid Risk of Pneumothorax in Acupuncture

2020 ◽  
Author(s):  
Ying-Ling Chen ◽  
Mark C. Hou ◽  
Shun-Chang Chang ◽  
Kai-Wen Chuang ◽  
Po-Yang Lee ◽  
...  
Keyword(s):  
Patient Safety ◽  
Coefficient Of Variation ◽  
Content Validity ◽  
Reliability And Validity ◽  
Acupuncture Points ◽  
Medical Ultrasound ◽  
Validity Index ◽  
Good Reliability ◽  
Content Validity Index ◽  
Good Identification

Abstract Purpose To increase patient safety, ultrasound detection acupuncture (UDA) has been developed, which can detect a safe depth for acupuncturists to avoid causing pneumothorax. This study aims to develop and evaluate a single-transducer ultrasound for acupuncture (UFA) to promote UDA. Methods Special A-mode and M-mode signals were analyzed to identify the depth of the lung. Six subjects were recruited to test the reliability and validity of UFA on GB21, LV14 and BL43 acupuncture points. Results The result showed UFA’s coefficient of variation was less than 0.2 and no difference in age, gender, and BMI of the subjects statistically, demonstrating excellent reliability. However, the content validity index of 0.51 did not meet expectations. UFA has good reliability, but it cannot reach the level of medical ultrasound. UFA uses A-mode and the seashore sign of M-mode to make a good identification of the lung, and it would be useful in the promotion of UDA.

scholarly journals Health of the Nation Outcome Scales for People with Learning Disabilities (HoNOS–LD)

2002 ◽  
Vol 180 (1) ◽  
pp. 61-66 ◽  
Author(s):  
Ashok Roy ◽  
Helen Matthews ◽  
Paul Clifford ◽  
Vanessa Fowler ◽  
David M. Martin
Keyword(s):  
Mental Health ◽  
Learning Disabilities ◽  
Mental Health Problems ◽  
Reliability And Validity ◽  
Ease Of Use ◽  
Mental Health Needs ◽  
Good Reliability ◽  
Aberrant Behavior Checklist ◽  
Physical Conditions ◽  
Reliability Sensitivity

BackgroundThe Health of the Nation Outcomes Scales (HoNOS) have been developed to measure outcomes in people with mental health problems.AimsFrequent impaired social functioning, problems with communication and associated physical conditions meant that a bespoke instrument was needed for people with learning disabilities. We describe the development of the Health of the Nation Outcomes Scales for People with Learning Disabilities (HoNOS–LD).MethodHoNOS-LD was piloted at 26 sites. Two raters, at two points in time, rated 372 subjects. Analysis determined acceptability, ease of use, interrater reliability, sensitivity to change and reliability with the Aberrant Behavior Checklist (ABC).ResultsThe resulting 18-item instrument demonstrated good reliability and validity characteristics and is generally acceptable to clinicians.ConclusionsHoNOS-LD is an appropriate instrument for measuring outcome in people with learning disabilities with additional mental health needs.

Sign in / Sign up

Export Citation Format

Share Document