Psychometric evaluation of the Mobile Application Rating Scale (MARS) (Preprint)

2020 ◽  
Author(s):  
Yannik Terhorst ◽  
Paula Philippi ◽  
Lasse Sander ◽  
Dana Schultchen ◽  
Sarah Paganini ◽  
...  
Keyword(s):  
Health Care ◽  
Construct Validity ◽  
Mobile Application ◽  
Concurrent Validity ◽  
Rating Scale ◽  
Psychometric Evaluation ◽  
Confirmatory Factor ◽  
Health Domains ◽  
Psychometric Quality

BACKGROUND Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Consequently, instruments of high psychometric quality for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA in various health domains. Only few validation studies investigating its psychometric quality exist with selected samples of MHAs. No study has evaluated the construct validity of the MARS and concurrent validity to other instruments. OBJECTIVE This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS. METHODS MARS scoring data was pooled from 15 international app quality reviews to evaluate the psychometric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. App quality is determined for each dimension and overall. Construct validity was evaluated by assessing related competing confirmatory models that were explored by confirmatory factor analysis (CFA). A combination of non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices was used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations between the MARS and 1) another quality assessment tool called ENLIGHT, and 2) user star-rating extracted from app stores were investigated. Reliability was determined using Omega. Objectivity was assessed in terms of intra-class correlation. RESULTS In total, MARS ratings from 1,299 MHA covering 15 different health domains were pooled for the analysis. Confirmatory factor analysis confirmed a bifactor model with a general quality factor and an additional factor for each subdimension (RMSEA=0.074, TLI=0.922, CFI=0.940, SRMR=0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC=0.82). The overall MARS rating was positively associated with ENLIGHT (r=0.91, P<0.01) and user-ratings (r=0.14, P<0.01). CONCLUSIONS he psychometric evaluation of the MARS demonstrated its suitability for the quality assessment of MHAs. As such, the MARS could be used to make the quality of MHA transparent to health care stakeholders and patients. Future studies could extend the present findings by investigating the re-test reliability and predictive validity of the MARS.

scholarly journals Assessing Apps for Patients with Genitourinary Tumors Using the Mobile Application Rating Scale (MARS): Systematic Search in App Stores and Content Analysis (Preprint)

2019 ◽  
Author(s):  
Miguel Ángel Amor-García ◽  
Roberto Collado-Borrell ◽  
Vicente Escudero-Vilaplana ◽  
Alejandra Melgarejo-Ortuño ◽  
Ana Herranz-Alonso ◽  
...  
Keyword(s):  
Prostate Cancer ◽  
Health Care ◽  
Health Professionals ◽  
Health Care Professionals ◽  
Mobile Application ◽  
Rating Scale ◽  
Cross Sectional ◽  
Cancer Symptoms ◽  
Genitourinary Cancers

BACKGROUND The large number of available cancer apps and their impact on the population necessitates a transparent, objective, and comprehensive evaluation by app experts, health care professionals, and users. To date, there have been no analyses or classifications of apps for patients with genitourinary cancers, which are among the most prevalent types of cancer. OBJECTIVE The objective of our study was to analyze the quality of apps for patients diagnosed with genitourinary cancers using the Mobile Application Rating Scale (MARS) and identify high-quality apps. METHODS We performed an observational cross-sectional descriptive study of all smartphone apps for patients diagnosed with genitourinary cancers available on iOS and Android platforms. In July 2019, we searched for all available apps for patients with genitourinary cancers (bladder, prostate, cervical, uterine, endometrial, kidney, testicular, and vulvar) or their caregivers. Apps were downloaded and evaluated, and the general characteristics were entered into a database. The evaluation was performed by 2 independent researchers using the MARS questionnaire, which rates 23 evaluation criteria clustered in 5 domains (Engagement, Functionality, Esthetics, Information, and Subjective Quality) on a scale from 1 to 5. RESULTS In total, 46 apps were analyzed. Of these, 31 (67%) were available on Android, 6 (13%) on iOS, and 9 (20%) on both platforms. The apps were free in 89% of cases (41/46), and 61% (28/46) had been updated in the previous year. The apps were intended for prostate cancer in 30% of cases (14/46) and cervical cancer in 17% (8/46). The apps were mainly informative (63%, 29/46), preventive (24%, 11/46), and diagnostic (13%, 6/46). Only 7/46 apps (15%) were developed by health care organizations. The mean MARS score for the overall quality of the 46 apps was 2.98 (SD 0.77), with a maximum of 4.63 and a minimum of 1.95. Functionality scores were quite similar for most of the apps, with the greatest differences in Engagement and Esthetics, which showed acceptable scores in one-third of the apps. The 5 apps with the highest MARS score were the following: “Bladder cancer manager,” “Kidney cancer manager,” “My prostate cancer manager,” “Target Ovarian Cancer Symptoms Diary,” and “My Cancer Coach.” We observed statistically significant differences in the MARS score between the operating systems and the developer types (<i>P</i>&lt;.001 and <i>P</i>=.01, respectively), but not for cost (<i>P</i>=.62). CONCLUSIONS MARS is a helpful methodology to decide which apps can be prescribed to patients and to identify which features should be addressed to improve these tools. Most of the apps designed for patients with genitourinary cancers only try to provide data about the disease, without coherent interactivity. The participation of health professionals in the development of these apps is low; nevertheless, we observed that both the participation of health professionals and regular updates were correlated with quality.

scholarly journals Assessing Apps for Patients with Genitourinary Tumors Using the Mobile Application Rating Scale (MARS): Systematic Search in App Stores and Content Analysis

10.2196/17609 ◽  
2020 ◽  
Vol 8 (7) ◽  
pp. e17609 ◽  
Author(s):  
Miguel Ángel Amor-García ◽  
Roberto Collado-Borrell ◽  
Vicente Escudero-Vilaplana ◽  
Alejandra Melgarejo-Ortuño ◽  
Ana Herranz-Alonso ◽  
...  
Keyword(s):  
Prostate Cancer ◽  
Health Care ◽  
Health Professionals ◽  
Health Care Professionals ◽  
Mobile Application ◽  
Rating Scale ◽  
Cross Sectional ◽  
Cancer Symptoms ◽  
Genitourinary Cancers

Background The large number of available cancer apps and their impact on the population necessitates a transparent, objective, and comprehensive evaluation by app experts, health care professionals, and users. To date, there have been no analyses or classifications of apps for patients with genitourinary cancers, which are among the most prevalent types of cancer. Objective The objective of our study was to analyze the quality of apps for patients diagnosed with genitourinary cancers using the Mobile Application Rating Scale (MARS) and identify high-quality apps. Methods We performed an observational cross-sectional descriptive study of all smartphone apps for patients diagnosed with genitourinary cancers available on iOS and Android platforms. In July 2019, we searched for all available apps for patients with genitourinary cancers (bladder, prostate, cervical, uterine, endometrial, kidney, testicular, and vulvar) or their caregivers. Apps were downloaded and evaluated, and the general characteristics were entered into a database. The evaluation was performed by 2 independent researchers using the MARS questionnaire, which rates 23 evaluation criteria clustered in 5 domains (Engagement, Functionality, Esthetics, Information, and Subjective Quality) on a scale from 1 to 5. Results In total, 46 apps were analyzed. Of these, 31 (67%) were available on Android, 6 (13%) on iOS, and 9 (20%) on both platforms. The apps were free in 89% of cases (41/46), and 61% (28/46) had been updated in the previous year. The apps were intended for prostate cancer in 30% of cases (14/46) and cervical cancer in 17% (8/46). The apps were mainly informative (63%, 29/46), preventive (24%, 11/46), and diagnostic (13%, 6/46). Only 7/46 apps (15%) were developed by health care organizations. The mean MARS score for the overall quality of the 46 apps was 2.98 (SD 0.77), with a maximum of 4.63 and a minimum of 1.95. Functionality scores were quite similar for most of the apps, with the greatest differences in Engagement and Esthetics, which showed acceptable scores in one-third of the apps. The 5 apps with the highest MARS score were the following: “Bladder cancer manager,” “Kidney cancer manager,” “My prostate cancer manager,” “Target Ovarian Cancer Symptoms Diary,” and “My Cancer Coach.” We observed statistically significant differences in the MARS score between the operating systems and the developer types (P<.001 and P=.01, respectively), but not for cost (P=.62). Conclusions MARS is a helpful methodology to decide which apps can be prescribed to patients and to identify which features should be addressed to improve these tools. Most of the apps designed for patients with genitourinary cancers only try to provide data about the disease, without coherent interactivity. The participation of health professionals in the development of these apps is low; nevertheless, we observed that both the participation of health professionals and regular updates were correlated with quality.

An Analysis of Apps with a Medication List Functionality for Older People with Heart Failure: Evaluation using the Mobile Application Rating Scale (MARS) and the IMS Institute for Healthcare Informatics Functionality Score (Preprint)

2021 ◽  
Author(s):  
Yohanca Maria Diaz-Skeete ◽  
David McQuaid ◽  
Adewale Samuel Akinosun ◽  
Idongesit Ekerete ◽  
Natacha Carragher ◽  
...  
Keyword(s):  
Heart Failure ◽  
Mobile Application ◽  
Rating Scale ◽  
Scientific Evidence ◽  
Medication List ◽  
Healthcare Informatics ◽  
Medication History ◽  
Clinic Efficiency ◽  
Google Play

BACKGROUND Managing the care of older patients with heart failure (HF) largely centres on medication management. Due to their frequent medication or dosing changes, an app supporting them to keep an up-to-date list of medication could be advantageous. During COVID-19 times, HF outpatients’ consultations are taking place virtually or by phone. An app with the capability to share the medication list with healthcare professionals before consultation could support the clinic efficiency, for example, reducing consultation time. However, the influence of apps on maintaining an up to date medication history for older adults with HF in Ireland remains largely unexplored. OBJECTIVE The objectives of this review are twofold: to review apps with a medication list functionality and to evaluate the quality of the apps included in the review using the Mobile Application Rating Scale (MARS) and the IMS Institute for Healthcare Informatics functionality scale. METHODS A systematic search of apps was conducted in June 2019 using the Google Play StoreTM and iTunes App StoreTM. The MARS was used independently by four researchers to assess the quality of the apps using an Android phone and an iPad. Apps were also evaluated using the IMS Institute for Healthcare Informatics functionality score. RESULTS Google play and iOS app stores searches identified 483 potential apps (292 from Android stores and 191 from Apple stores). Six apps met the inclusion criteria. Medisafe app had the highest overall MARS score (4/5) and the medication list & medical records app had the lowest overall score (2.5/5). Five out of the six apps achieved an acceptable quality MARS score (>3.0). Two apps scored the maximum number of features (n=11) according to the IMS Institute for Healthcare Informatics functionality score and two scored the lowest (n=5). The apps had on average 8 functions based on the IMS functionality criteria (range 5 to 11). CONCLUSIONS The quality of current apps with a medication list functionality varies regarding their technical aspects. Most of the apps reviewed have an acceptable MARS objective quality. However, the subjective quality or satisfaction with the apps was poor. Only three apps are based on scientific evidence and have been previously tested. Two apps featured all the IMS Institute for Healthcare Informatics functionalities and half do not provide clear instructions on how to enter medication data, do not display vital parameters data in an easy to understand format and do not guide users on how or when to take their medication. CLINICALTRIAL N/A

scholarly journals PENILAIAN MENOPAUSAL RATING SCALE (MRS) PADA WANITA MENOPAUSE DI KOTA PEMATANGSIANTAR TAHUN 2019

2019 ◽  
Vol 14 (2) ◽  
pp. 108-113
Author(s):  
Dame Evalina Simangunsong
Keyword(s):  
Quality Of Life ◽  
Health Care ◽  
Rating Scale ◽  
Weight Category ◽  
Physical Complaints ◽  
Difficult Time ◽  
Menopausal Women

Climacterium syndrome is a collection of symptoms experienced by a woman who started at the end of the reproductives until the five years after menopause. This time is a difficult time that women must be passed on with different complaints from each individual. The complaint can be categorized into four complaints such as physical complaints, vasomotor complaints, psychosocial complaints, urogenital complaints. Various complaints experienced can decrease the quality of life of women. Complaints experienced by menopause women can be assessed by Menopausal Rating Scale (MRS).This research is a descriptive type of research with a crosssectional design that aims to determine the description of menopausal complaints experienced by menopausal women in two locations in Pematangsiantar City. The results of the study illustrate that women who are examined in two research locations experience menopausal complaints in the weight category, especially in psychological and urogenital complaints. There is a health care effort in women before the menopause arrives. It is very important to prepare women in receiving the menopause and face the various complaints that will be experienced.

scholarly journals A New Perspective on the Multidimensionality of Divergent Thinking Tasks

2018 ◽  
Author(s):  
Boris Forthmann ◽  
Paul - Christian Bürkner ◽  
Mathias Benedek ◽  
Carsten Szardenings ◽  
Heinz Holling
Keyword(s):  
Latent Variables ◽  
Divergent Thinking ◽  
Rating Scale ◽  
Latent Trait ◽  
Subjective Ratings ◽  
Task Instructions ◽  
New Perspective ◽  
Psychometric Quality

In the presented work, a shift of perspective with respect to the dimensionality of divergent thinking tasks is introduced moving from the question of multidimensionality across divergent thinking scores to the question of multidimensionality across the scale of divergent thinking scores. We apply IRTree models to test if the same latent trait can be assumed can be assumed across the whole scale in snapshot scoring of divergent thinking tests and holds for different task instructions and varying levels of fluency. This way, multidimensionality can be explored across scale points of a Likert-type rating scale and also multidimensionality due to differences in number of responses of ideational pools can be assessed. It was found that evidence for unidimensionality across scale points was stronger with be-creative instructions as compared to be-fluent instructions which suggests better psychometric quality of ratings when be-creative instructions are used. In addition, latent variables pertaining to low-fluency and high-fluency ideational pools shared around 50% of variance which suggests both strong overlap and evidence for differentiation. The presented approach allows to further examine the psychometric quality of subjective ratings and to examine new questions with respect to within-item multidimensionality in divergent thinking.

scholarly journals Evaluating the measurement properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) with a multicenter cohort

2019 ◽  
Vol 14 (4) ◽  
Author(s):  
R. Trafford Crump ◽  
Alex Peterson ◽  
Camille Charbonneau ◽  
Kevin V. Carlson ◽  
Jason M. Sutherland ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Prostate Cancer ◽  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Localized Prostate Cancer ◽  
Measurement Properties ◽  
Confirmatory Factor ◽  
Ceiling Effects

Introduction: We aimed to evaluate the psychometric properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) for measuring the quality of life in patients treated for localized prostate cancer. The EPIC-26 is a patient-reported outcome instrument recommended for use with patients treated for localized prostate cancer. Methods: This study is based on data collected prospectively between September 2014 and February 2017 in Alberta, Canada. Men were treated with either radical prostatectomy or radiation therapy and administered the EPIC-26. Responses to the EPIC-26 were the primary outcome. Construct validity was measured using confirmatory factor analysis. Reliability was measured using Chronbach’s alpha and item-total correlation. Ceiling and floor effects were also investigated. Results: EPIC-26 response data from 205 participants (prostatectomy =138; radiation=60; both=7) were used in this analysis. The EPIC-26 was administered an average of 33.8 weeks after treatment. The confirmatory factor analysis model did not meet the threshold for adequate fit. Several items had near-zero factor loadings and were non-significant. Four out of the EPIC- 26’s five domains met the acceptable reliability threshold based on Cronbach’s alpha. Ceiling effects were observed in four out of five domains. Conclusions: The EPIC-26 demonstrated poor construct validity, adequate reliability, and large ceiling effects. Several issues were observed, suggesting that the instrument’s five domains were not well-defined by their respective items. The original EPIC’s conceptual framework should be reviewed and the shortened instrument revised to improve its performance for measuring post-treatment quality of life.

scholarly journals Review of the Content and Quality of Mobile Applications About Alzheimer’s Disease and Related Dementias

2018 ◽  
Vol 39 (6) ◽  
pp. 601-608 ◽  
Author(s):  
Seul Ki Choi ◽  
Brooks Yelton ◽  
Victor K. Ezeanya ◽  
Kristie Kannaley ◽  
Daniela B. Friedman
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Health Care ◽  
Health Care Providers ◽  
Mobile Applications ◽  
Rating Scale ◽  
Care Providers ◽  
Technical Functions ◽  
Public Collaboration

This study reviewed the content of mobile applications (apps) providing Alzheimer’s disease or related dementias (ADRD) information and assessed quality of the apps. Characteristics, content, and technical aspects of 36 apps in the U.S. Google Play Store and App Store were coded, and quality of the apps was evaluated using the Mobile Application Rating Scale. Caregiving (62.1%) and disease management (55.6%) content was frequently provided. Few apps had an app community (8.3%) or a reminder function (8.3%). Overall, quality of the apps was acceptable; apps by health care–related developers had higher quality scores than those by non-health care–related developers. This analysis showed that ADRD-related apps provide a range of content and have potential to benefit caregivers, individuals with ADRD, health care providers, and the general public. Collaboration of ADRD experts and technology experts is needed to provide evidence-based information using effective technical functions that make apps to meet users’ needs.

scholarly journals Questionnaire measuring patient participation in health care: Scale development and psychometric evaluation

2020 ◽  
Vol 19 (7) ◽  
pp. 600-608
Author(s):  
Selina Kikkenborg Berg ◽  
Jane Færch ◽  
Pernille Fevejle Cromhout ◽  
Marianne Tewes ◽  
Preben Ulrich Pedersen ◽  
...  
Keyword(s):  
Health Care ◽  
Factor Analysis ◽  
Construct Validity ◽  
Factor Structure ◽  
Internal Consistency ◽  
Patient Participation ◽  
Cardiac Disease ◽  
Psychometric Evaluation ◽  
Mixed Group ◽  
Convergent Construct Validity

Background: Patient participation in treatment and care is often encouraged and is desirable because of its proven positive impact on treatment, quality of care and patient safety. Aims: To develop an instrument to measure patient participation in health care and to investigate the measurement properties of the Patient Participation Questionnaire (PPQ). Methods: A literature review was conducted to develop a model of patient participation. The PPQ was constructed consisting of 17 items organized into four subscales. Psychometric evaluation of factor structure, convergent construct validity by hypothesis testing and analyses of internal consistency using Cronbach’s alpha were performed on data from a hospitalised mixed group of patients with cardiac disease, pulmonary disease and cancer ( N=378 patients). Results: Confirmatory factor analysis did not show a clear model fit, which is why an exploratory factor analysis was performed, suggesting a different four subscale structure consisting of a total of 16 items. The four subscales were labelled Shared decision power, Adapted and individualized knowledge, Collaboration and Human approach. There were strong ceiling effects on all items. Analysis of convergent construct validity showed a moderate correlation (0.59) between the PPQ and another instrument measuring patient participation. Internal consistency for the total PPQ score was high: 0.89. Conclusion: In a mixed group of patients with cardiac disease, pulmonary disease and cancer, the PPQ showed promising psychometric properties in terms of factor structure, convergent construct validity and internal consistency. The PPQ may be used to shed light on the experience of patient participation and guide quality improvements.

scholarly journals Psychometric Properties of the Italian Versions of the Gambling Urge Scale (GUS) and the Gambling Refusal Self-Efficacy Questionnaire (GRSEQ)

2019 ◽  
Author(s):  
Paolo Iliceto ◽  
Emanuele Fino ◽  
Mauro Schiavella ◽  
Tian Po Oei
Keyword(s):  
Construct Validity ◽  
Pathological Gambling ◽  
Factor Structure ◽  
Internal Consistency ◽  
Self Efficacy ◽  
Concurrent Validity ◽  
Positive Emotions ◽  
One Dimension ◽  
Confirmatory Factor ◽  
And Gender

AbstractGambling urges and gambling refusal self-efficacy beliefs play a major role in the development and maintenance of problem gambling. This study aimed to translate the Gambling Urge Scale (GUS) and the Gambling Refusal Self-Efficacy Questionnaire (GRSEQ) from English to Italian (GUS-I, GRSEQ-I) and to test their factor structure, internal consistency, construct validity, concurrent validity, and gender differences in 513 individuals from the Italian community. Factor structure and construct validity were tested through Confirmatory Factor Analysis, internal consistency through Cronbach’s alpha, concurrent validity through correlations with gambling-related cognitions (GRCS-I), probable pathological gambling (SOGS-I), and gambling functioning (GFA-R-I). Results confirmed that the 6 items of the GUS-I load highly on one dimension of Gambling Urge, and each of the 26 items of the GRSEQ-I load highly on their relevant sub-dimension, among the following: situations/thoughts, drugs, positive emotions, negative emotions. Both scales are internally consistent and show concurrent validity with gambling-related cognitions, probable pathological gambling, and gambling functioning. Males score higher than females at the GUS-I; females score higher than males at the GRSEQ-I. The findings from the present study suggest that the GUS-I and the GRSEQ-I are internally consistent and valid scales for the assessment of gambling urges and gambling refusal self-efficacy in Italian individuals from the community, with significant repercussions in terms of assessment, prevention, and intervention.

Sign in / Sign up

Export Citation Format

Share Document