Assessing Quality Factors and User Preference of Drug Reference Apps in Taiwan: Systematic Search and Evaluation (Preprint)

2021 ◽  
Author(s):  
Yu-Chun Chen ◽  
Wei-Wei Liao ◽  
Mei-Chin Su ◽  
Yen-Hsi Lin
Keyword(s):  
Regression Model ◽  
Rating Scale ◽  
Drug Information ◽  
Mobile App ◽  
Influential Factors ◽  
Systematic Search ◽  
Visual Appeal ◽  
User Ratings ◽  
Drug Reference

BACKGROUND Drug reference apps play various distinct and vital roles through the medication use process. A drug reference app that carried out comprehensive localized drug information would greatly improve the efficiency and quality of work for physicians, nurses, pharmacists, and patients. OBJECTIVE This current study aimed to describe a systematic and stepwise process to identify drug reference apps with localized drug information in Taiwan. Moreover, we assessed the quality of these apps by using a reliable quality assessment tool and further analyzing the influential factors for user ratings. METHODS A two-step algorithm (KESS) consisting of keyword growing and systematic search was proposed. Apps were divided into two groups: higher user ratings and lower user ratings. Seven independent reviewers were trained to evaluate these apps using Mobile App Rating Scale (MARS). A logistic regression model was fitted, and average marginal effects (AME) were calculated to identify the effects of factors for higher user ratings. A p-value< 0.05 was considered statistically significant. RESULTS A total of 23 drug reference apps in Taiwan had been identified and analyzed. Ten apps had higher user star ratings (>=4 stars), and 13 apps had lower user star ratings ( < 4 stars). These drug reference apps had acceptable quality with an average MARS score of 3.23. Apps with higher user star ratings had higher MARS scores than the lowers (engagement (2.70 v.s. 2.50, P= .005), functionality (3.85 v.s. 3.49, P= .003), aesthetics (3.39 v.s. 2.98, P < .001), and information (3.55 v.s. 3.25, P= .005)). The regression model showed five influential factors for higher user ratings (navigation, AME, 13.15%; performance, AME, 11.03%; visual appeal, AME, 10.87%; credibility, AME, 10.67%; quantity of information, AME, 10.42%). CONCLUSIONS The proposed KESS algorithm could be a valuable and unbiased framework for systematic search for app. While the higher engagement, more functionality, better aesthetics, and more information associated with higher user ratings, there are five most influential factors, navigation, performance, visual appeal, credibility, and quantity of information among the four elements.

scholarly journals Personalized and Self-Management: Systematic Search and Evaluation Quality Factors and User Preference of Drug Reference Apps in Taiwan

2021 ◽  
Vol 11 (8) ◽  
pp. 790
Author(s):  
Yu-Chun Chen ◽  
Wei-Wei Liao ◽  
Mei-Chin Su ◽  
Yen-Hsi Lin
Keyword(s):  
Rating Scale ◽  
Mobile App ◽  
Influential Factors ◽  
Systematic Search ◽  
Influential Factor ◽  
User Preference ◽  
Self Management ◽  
User Ratings ◽  
Drug Reference

Background: Drug reference apps promote self-management and improve the efficiency and quality of work for physicians, nurses, pharmacists, and patients. This study aimed to describe a systematic and stepwise process to identify drug reference apps in Taiwan, assess the quality of these apps, and analyze the influential factors for user ratings. Methods: A two-step algorithm (KESS) consisting of keyword growing and systematic search was proposed. Seven independent reviewers were trained to evaluate these apps using Mobile App Rating Scale (MARS). A logistic regression model was fitted and average marginal effects (AME) were calculated to identify the effects of factors for higher user ratings. Results: A total of 23 drug reference apps in Taiwan were identified and analyzed. Generally, these drug reference apps were evaluated as acceptable quality with an average MARS score of 3.23. Higher user engagement, more functionality, better aesthetics, and more information associated with higher user ratings. Navigation is the most influential factor on higher user ratings (AME: 13.15%) followed by performance (AME: 11.03%), visual appeal (AME: 10.87%), credibility (AME: 10.67%), and quantity of information (AME: 10.42%). Conclusions: User experience and information clearly affect user ratings of drug reference apps. Five key factors should be considered when designing drug reference apps.

scholarly journals Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales (Preprint)

2020 ◽  
Author(s):  
Tehmina Gladman ◽  
Grace Tylee ◽  
Steve Gallagher ◽  
Jonathan Mair ◽  
Rebecca Grainger
Keyword(s):  
Student Learning ◽  
Teaching And Learning ◽  
Rating Scale ◽  
Clinical Skills ◽  
Mobile Apps ◽  
Mobile App ◽  
Systematic Search ◽  
Measurement Scales ◽  
High Quality

BACKGROUND Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning. OBJECTIVE This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures—the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning—to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning. METHODS Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL. RESULTS The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; <i>P</i>&lt;.001 and MARuL ICC [two-way]=0.68; <i>P</i>&lt;.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality. CONCLUSIONS This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps—Geeky Medics-OSCE revision and OSCE PASS: Medical Revision—rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL’s incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS’s more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning. CLINICALTRIAL

scholarly journals Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales

10.2196/25377 ◽  
2021 ◽  
Vol 9 (4) ◽  
pp. e25377
Author(s):  
Tehmina Gladman ◽  
Grace Tylee ◽  
Steve Gallagher ◽  
Jonathan Mair ◽  
Rebecca Grainger
Keyword(s):  
Student Learning ◽  
Teaching And Learning ◽  
Rating Scale ◽  
Clinical Skills ◽  
Mobile Apps ◽  
Mobile App ◽  
Systematic Search ◽  
Measurement Scales ◽  
High Quality

Background Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning. Objective This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures—the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning—to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning. Methods Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL. Results The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; P<.001 and MARuL ICC [two-way]=0.68; P<.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality. Conclusions This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps—Geeky Medics-OSCE revision and OSCE PASS: Medical Revision—rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL’s incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS’s more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning.

The quality and potential of Apps to promote behaviour change in patients with a chronic condition or multimorbidity: A systematic search in App Store and Google Play (Preprint)

2021 ◽  
Author(s):  
Alessio Bricca ◽  
Alessandro Pellegrini ◽  
Graziella Zangger ◽  
Jonas Ahler J ◽  
Madalina Jäger ◽  
...  
Keyword(s):  
Behaviour Change ◽  
Chronic Conditions ◽  
Chronic Condition ◽  
Rating Scale ◽  
Mobile App ◽  
Systematic Search ◽  
Chronic Obstructive ◽  
App Store ◽  
Google Play

BACKGROUND Mobile applications (Apps) offer an opportunity to improve the lifestyle of patients with chronic conditions or multimorbidity. However, for Apps to be recommended in clinical practice, their quality and potential for behaviour change are important. OBJECTIVE To investigate the quality and potential for behaviour change of health Apps for patients with a chronic condition or multimorbidity (defined as two or more chronic conditions). METHODS We followed the Cochrane Handbook guidelines to conduct and report this study. A systematic search of Apps available in English or Danish on App Store and Google Play for patients with one or more of the following common and disabling conditions: osteoarthritis, heart condition (heart failure and ischaemic heart disease), hypertension, type 2 diabetes mellitus, depression and chronic obstructive pulmonary disease was conducted. The search strategy combined keywords related to these conditions. One author screened the title and content of the identified apps. Subsequently, three authors independently downloaded the Apps in a smartphone and assessed the quality of the Apps and their potential for behaviour change using the Mobile App Rating Scale (MARS-21 items, score ranging 0-5, higher is better) and the App Behavior Change Scale (ABACUS-21 items, score ranging 0-21, higher is better), respectively. We included the five highest-rated and the five most downloaded apps but only assessed the quality and potential for behaviour change of the free content. RESULTS We screened 453 Apps and ultimately included 60. Most of the Apps were available in both the App Store and Google Play (58%). The overall average quality of the Apps was 3.48 (SD 0.28) on the MARS scale, and the overall potential for behaviour change was 8.07 (SD 2.30) on the ABACUS scale. Apps for depression and patients with multimorbidity tended to have higher overall MARS and ABACUS scores, respectively. The most common self-monitoring features presented in the Apps in support of behaviour change were physiological (e.g., blood pressure monitoring) in 64% of the Apps, weight/diet, or physical activity in 41% and 36%, respectively, and stress management in 37%. Only 14% of the Apps were completely free, while 86% had in-app-purchase for some content. CONCLUSIONS Apps for patients with a chronic condition or multimorbidity appear to be of acceptable quality but have a low-to-moderate potential for behaviour change. Our results provide a useful overview for patients and clinicians who would like to use Apps for managing chronic conditions and suggest the need to improve the Apps in terms of quality and potential for behaviour change. CLINICALTRIAL https://osf.io/nvhuy/

scholarly journals Measuring the Quality of Mobile Apps for the Management of Pain: Systematic Search and Evaluation Using the Mobile App Rating Scale

10.2196/10718 ◽  
2018 ◽  
Vol 6 (10) ◽  
pp. e10718 ◽  
Author(s):  
Alejandro Salazar ◽  
Helena de Sola ◽  
Inmaculada Failde ◽  
Jose Antonio Moral-Munoz
Keyword(s):  
Rating Scale ◽  
Mobile Apps ◽  
Mobile App ◽  
Systematic Search

scholarly journals The Arabic Version of the Mobile App Rating Scale: Development and Validation Study (Preprint)

2019 ◽  
Author(s):  
Marco Bardus ◽  
Nathalie Awada ◽  
Lilian A Ghandour ◽  
Elie-Jacques Fares ◽  
Tarek Gherbal ◽  
...  
Keyword(s):  
Weight Management ◽  
Information Quality ◽  
Rating Scale ◽  
Arab World ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Mobile App ◽  
Health Apps ◽  
Highly Correlated

BACKGROUND With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic. OBJECTIVE This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders. METHODS We followed a well-established and defined “universalist” process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps. RESULTS MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (<i>P</i>&lt;.001). The lowest correlation was observed in the area of usability (<i>r</i>=0.685), followed by aesthetics (<i>r</i>=0.827), information quality (<i>r</i>=0.854), engagement (<i>r</i>=0.894), and total app quality (<i>r</i>=0.897). Subjective quality was also highly correlated (<i>r</i>=0.820). CONCLUSIONS MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.

scholarly journals Quality of Mobile Apps for Care Partners of People with Alzheimer’s Disease and Related Dementias: Mobile App Rating Scale Evaluation (Preprint)

2021 ◽  
Author(s):  
Nicole E Werner ◽  
Janetta C Brown ◽  
Priya Loganathar ◽  
Richard J Holden
Keyword(s):  
Rating Scale ◽  
Mobile Apps ◽  
Mobile App ◽  
Future Research ◽  
App Development ◽  
Care Partners ◽  
Acceptable Quality ◽  
The Us ◽  
Google Play

BACKGROUND The over 11 million care partners in the US who provide care to people living with Alzheimer’s disease and related dementias (ADRD) cite persistent and pervasive unmet needs related to all aspects of their caregiving role. The proliferation of mobile applications (apps) for care partners has potential to meet the care partners’ needs, but the quality of apps is unknown. OBJECTIVE The present study aimed to 1) evaluate the quality of publicly available apps for care partners of people living with ADRD and 2) identify design features of low- and high-quality apps to guide future research and app development. METHODS We searched the US Apple and Google Play app stores with the criteria that the app needed to be 1) available in US Google play or Apple app stores, 2) directly accessible to users “out of the box”, 3) primarily intended for use by an informal (family, friend) caregiver or caregivers of a person with dementia. The included apps were then evaluated using the Mobile App Rating Scale (MARS), which includes descriptive app classification and rating using 23 items across five dimensions: engagement, functionality, aesthetics, information, and subjective quality. Next, we computed descriptive statistics for each rating. To identify recommendations for future research and app development, we categorized rater comments on the score driving factors for each item and what the app could have done to improve the score for that item. RESULTS We evaluated 17 apps (41% iOS only, 12% Android only, 47% both iOS and Android). We found that on average, the apps are of minimally acceptable quality. Although we identified apps above and below minimally acceptable quality, many apps had broken features and were rated as below acceptable for engagement and information. CONCLUSIONS Minimally acceptable quality is likely insufficient to meet care partner needs. Future research should establish minimum quality standards across dimensions for mobile apps for care partners. The design features of high-quality apps we identified in this research can provide the foundation for benchmarking those standards.

Quality of a Supporting Mobile App for Rheumatic Patients: Assessment Using the User Version of the Mobile Application Scale (uMARS) and Associated Patient Characteristics (Preprint)

2021 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Psoriatic Arthritis ◽  
Rating Scale ◽  
End Users ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
Ehealth Literacy ◽  
Rheumatic Patients

BACKGROUND Mobile applications promise to improve current health care. A growing number app quality studies exist to help patients and physicians choose appropriate, helpful and useful applications. However, current mobile app quality ratings are mostly physician-based. They exclude patients although as end-users, patients are able to provide the most relevant feedback. In a recent physician-based review of rheumatic apps, Rheuma Auszeit received the best overall rating (4.2/5), however this app has never been systematically evaluated by the intended end-users, rheumatic patients. OBJECTIVE The aim of this study was (1) to assess the quality of Rheuma Auszeit by rheumatic patients and (2) to evaluate the association between uMARS (User Version of the Mobile App Rating Scale) scores and patients’ characteristics. METHODS Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to evaluate the app Rheuma Auszeit using the uMARS and to complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. The association between uMARS scores and patients’ characteristics was further explored. RESULTS Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P<.004). Older male rheumatic patients reported a higher subjective quality score (P<.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho=0.18; P<.042). Preferred time of app usage significantly correlated with engagement (Rho=0.20; P<.024), functionality (Rho=0.19; P<.029), total uMARS score (Rho=0.21; P<.017) and subjective quality score (Rho=0.21; P<.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%). CONCLUSIONS Rheuma Auszeit was well accepted by patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. The study highlights the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

Mobile Applications in Otolaryngology: A Systematic Review of the Literature, Apple App Store and the Google Play Store

2020 ◽  
Vol 130 (1) ◽  
pp. 78-91
Author(s):  
Eleonora M. C. Trecca ◽  
Antonio Lonigro ◽  
Matteo Gelardi ◽  
Brandon Kim ◽  
Michele Cassano
Keyword(s):  
Rating Scale ◽  
Case Reports ◽  
Mobile App ◽  
App Store ◽  
Literature Reviews ◽  
Scientific Associations ◽  
Conference Papers ◽  
Further Development ◽  
Google Play

Objectives: Although the last few years have seen an increased number of smartphone applications (apps) disseminated in the field of Otolaryngology (ORL), these apps vary widely in quality. The aim of this paper, therefore, is to systematically review ORL apps directed towards patients in mobile app stores and the current literature. Methods: The Google Play Store, Apple App Store and PubMed were searched for ORL apps for patients using various keywords pertaining to different ORL subspecialties. Apps not relevant to the scope of this research and/or duplicates, educational apps, apps promoting a business, apps requiring specific separate hardware, and apps in non-English were excluded. In PubMed, keywords pertaining to the subspecialties were combined with “mobile app” in a search query; literature reviews, editorials, case reports, conference papers, duplicate articles, and articles irrelevant to ORL apps were excluded. The quality of apps with the highest number of reviews was assessed using the “Mobile App Rating Scale” (MARS), while the quality of the articles was rated using “The Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) Statement. Results: After searching the app stores, 1074 apps were included and grouped according to their ORL subspecialties. The overall MARS score of the ten most popular apps in each category was 3.65 out of 5. A total of 636 articles were identified in the literature, and 193 were included. The mean adherence percentage of the articles to the STROBE checklist was of 84.37%. Conclusions: Although the apps currently available need further development, their application in ORL appears promising. Further dialogue between physicians and patients, as well as formal support from professional and scientific associations, should be encouraged.

scholarly journals Mobile Phone Apps for Food Allergies or Intolerances in App Stores: Systematic Search and Quality Assessment Using the Mobile App Rating Scale (MARS) (Preprint)

2020 ◽  
Author(s):  
Floriana Mandracchia ◽  
Elisabet Llauradó ◽  
Lucia Tarro ◽  
Rosa Maria Valls ◽  
Rosa Solà
Keyword(s):  
Food Allergy ◽  
Mobile Phone ◽  
Critical Points ◽  
Rating Scale ◽  
Food Product ◽  
Mobile App ◽  
Systematic Search ◽  
Food Allergies ◽  
Objective Quality ◽  
Specific Section

BACKGROUND Food allergies and intolerances are increasing worldwide, and mobile phone apps could be a promising tool for self-management of these issues. OBJECTIVE This study aimed to systemically search and assess food allergy or intolerance apps in app stores using the multidimensional Mobile App Rating Scale (MARS) to rate the objective and subjective quality and to identify critical points for future improvements. METHODS This systematic search identified apps through the keywords “food allergy,” “food intolerance,” and “allergens” in English, Spanish, and Italian in the Apple App Store (iOS) and Google Play Store (Android). The inclusion criteria were a user star rating of ≥3 (of 5 stars) to limit the selection to the most highly rated apps; ≥1000 reviews as an indicator of reliability; and the most recent update performed up to 2017. Then, the apps were divided according to their purpose (searching for allergen-free “food products,” “restaurants,” or recipes in “meal planners”) and evaluated on a scale of 1 to 5 points using the MARS in terms of (1) app classification category with a descriptive aim; (2) app subjective and objective quality categories comprised of engagement, functionality, esthetics, and information sections (Medline was searched for eligible apps to check whether they had been tested in trials); and (3) an optional app-specific section. Furthermore, the output and input features were evaluated. Differences between MARS sections and between app purposes and correlations among MARS sections, star ratings, and numbers of reviews were evaluated. RESULTS Of the 1376 apps identified, 14 were included: 12 related to food allergies and intolerances that detect 2-16 food allergens and 2 related only to gluten intolerance. The mean (SD) MARS scores (maximum 5 points) were 3.8 (SD 0.4) for objective quality, highlighting whether any app had been tested in trials; 3.5 (SD 0.6) for subjective quality; and 3.6 (SD 0.7) for the app-specific section. Therefore, a rating ≥3 points indicated overall acceptable quality. From the between-section comparison, engagement (mean 3.5, SD 0.6) obtained significantly lower scores than functionality (mean 4.1, SD 0.6), esthetics (mean 4, SD 0.5), and information (mean 3.8, SD 0.4). However, when the apps were compared by purpose, critical points were identified: meal planner apps showed significantly higher engagement (mean 4.1, SD 0.4) than food product (mean 3.0, SD 0.6; <i>P</i>=.05) and restaurant (mean 3.2, SD 0.3; <i>P</i>=.02) apps. CONCLUSIONS In this systematic search of food allergy or intolerance apps, acceptable MARS quality was identified, although the engagement section for food product and restaurant purpose apps should be improved and the included apps should be tested in trials. The critical points identified in this systematic search can help improve the innovativeness and applicability of future food allergy and intolerance apps.

Sign in / Sign up

Export Citation Format

Share Document