scholarly journals The Characteristics and Quality of Mobile Phone Apps Targeted at Men Who Have Sex With Men in China: A Window of Opportunity for Health Information Dissemination? (Preprint)

2018 ◽  
Author(s):  
Guoli Yang ◽  
Jian Long ◽  
Dan Luo ◽  
Shuiyuan Xiao ◽  
Atipatsa Chiwanda Kaminga

BACKGROUND A number of mobile phone apps has been developed specifically for men who have sex with men (MSM). We will call these mobile phone apps MSM apps for simplicity. At present, the characteristics and quality and purpose of these MSM apps are unclear. OBJECTIVE The aim of this study was to objectively and comprehensively evaluate the characteristics and quality of the MSM apps to assess whether they disseminated health information among the MSM in China. METHODS We searched 2 dominant mobile phone app stores (Apple Store and Android Market) to obtain MSM apps using the keywords MSM, gay, lesbian, gay, bisexual, and transgender (LGBT), 男同,同志,男男性接触者,同性恋,基友, and 双性恋. Apps were excluded if they did not have a Chinese language interface or if their target population was not MSM. Basic information about the eligible apps for this study, such as app name, app store category, and date of last update was gathered from the specified app stores. The quality of apps was rated by 2 independent raters using Mobile App Rating Scale (MARS). The intraclass correlation coefficient (ICC) between raters was computed as a measure for interrater reliability of the MARS. All analyses were conducted using SPSS version 20.0 (SPSS Inc). RESULTS A total of 575 apps were reviewed between September 15, 2018 and September 30, 2018, out of which, 532 apps were excluded. Finally, 43 apps were included. Of the 43 apps, 16 were from the Apple Store, 10 were from Android Market, and 17 were available in both app stores. In addition, 39 out of 43 apps were for social and sexual networking, whereas 10 contained sexual health information, for example, HIV/sexually transmitted diseases knowledge, HIV test, and condom use. The average rating was 4 stars. The number of downloads for 21 apps exceeded 10,000. A total of 31 apps had acceptable quality (as defined by a MARS score of >3), with functionality as the highest scoring domain, followed by information quality, esthetics, and engagement. Interrater reliability was excellent for the overall mean app quality scores (ICC=.946; 95% CI 0.904-0.970) and the subjective quality scores (ICC=.910; 95% CI 0.841-0.950). CONCLUSIONS By reviewing the available apps, we found that MSM apps are popular. The majority of MSM apps are for dating, whereas few of them contain HIV prevention and health information. The overall quality of the apps is acceptable. The utilization of mobile phone technologies is a promising way for delivering HIV prevention messages to MSM. We recommend that researchers and app developers should work together to disseminate health information for MSM via mobile technologies.

10.2196/17300 ◽  
2020 ◽  
Vol 8 (5) ◽  
pp. e17300 ◽  
Author(s):  
Heilok Cheng ◽  
Alison Tutt ◽  
Catherine Llewellyn ◽  
Donna Size ◽  
Jennifer Jones ◽  
...  

Background Parents use apps to access information on child health, but there are no standards for providing evidence-based advice, support, and information. Well-developed apps that promote appropriate infant feeding and play can support healthy growth and development. A 2015 systematic assessment of smartphone apps in Australia about infant feeding and play found that most apps had minimal information, with poor readability and app quality. Objective This study aimed to systematically evaluate the information and quality of smartphone apps providing information on breastfeeding, formula feeding, introducing solids, or infant play for consumers. Methods The Google Play store and Apple App Store were searched for free and paid Android and iPhone Operating System (iOS) apps using keywords for infant feeding, breastfeeding, formula feeding, and tummy time. The apps were evaluated between September 2018 and January 2019 for information content based on Australian guidelines, app quality using the 5-point Mobile App Rating Scale, readability, and suitability of health information. Results A total of 2196 unique apps were found and screened. Overall, 47 apps were evaluated, totaling 59 evaluations for apps across both the Android and iOS platforms. In all, 11 apps had affiliations to universities and health services as app developers, writers, or editors. Furthermore, 33 apps were commercially developed. The information contained within the apps was poor: 64% (38/59) of the evaluations found no or low coverage of information found in the Australian guidelines on infant feeding and activity, and 53% (31/59) of the evaluations found incomplete or incorrect information with regard to the depth of information provided. Subjective app assessment by health care practitioners on whether they would use, purchase, or recommend the app ranged from poor to acceptable (median 2.50). Objective assessment of the apps’ engagement, functionality, aesthetics, and information was scored as acceptable (median 3.63). The median readability score for the apps was at the American Grade 8 reading level. The suitability of health information was rated superior or adequate for content, reading demand, layout, and interaction with the readers. Conclusions The quality of smartphone apps on infant feeding and activity was moderate based on the objective measurements of engagement, functionality, aesthetics, and information from a reliable source. The overall quality of information on infant feeding and activity was poor, indicated by low coverage of topics and incomplete or partially complete information. The key areas for improvement involved providing evidence-based information consistent with the Australian National Health and Medical Research Council’s Infant Feeding Guidelines. Apps supported and developed by health care professionals with adequate health service funding can ensure that parents are provided with credible and reliable resources.


2019 ◽  
Author(s):  
Heilok Cheng ◽  
Alison Tutt ◽  
Catherine Llewellyn ◽  
Donna Size ◽  
Jennifer Jones ◽  
...  

BACKGROUND Parents use apps to access information on child health, but there are no standards for providing evidence-based advice, support, and information. Well-developed apps that promote appropriate infant feeding and play can support healthy growth and development. A 2015 systematic assessment of smartphone apps in Australia about infant feeding and play found that most apps had minimal information, with poor readability and app quality. OBJECTIVE This study aimed to systematically evaluate the information and quality of smartphone apps providing information on breastfeeding, formula feeding, introducing solids, or infant play for consumers. METHODS The Google Play store and Apple App Store were searched for free and paid Android and iPhone Operating System (iOS) apps using keywords for infant feeding, breastfeeding, formula feeding, and tummy time. The apps were evaluated between September 2018 and January 2019 for information content based on Australian guidelines, app quality using the 5-point Mobile App Rating Scale, readability, and suitability of health information. RESULTS A total of 2196 unique apps were found and screened. Overall, 47 apps were evaluated, totaling 59 evaluations for apps across both the Android and iOS platforms. In all, 11 apps had affiliations to universities and health services as app developers, writers, or editors. Furthermore, 33 apps were commercially developed. The information contained within the apps was poor: 64% (38/59) of the evaluations found no or low coverage of information found in the Australian guidelines on infant feeding and activity, and 53% (31/59) of the evaluations found incomplete or incorrect information with regard to the depth of information provided. Subjective app assessment by health care practitioners on whether they would use, purchase, or recommend the app ranged from poor to acceptable (median 2.50). Objective assessment of the apps’ engagement, functionality, aesthetics, and information was scored as acceptable (median 3.63). The median readability score for the apps was at the American Grade 8 reading level. The suitability of health information was rated superior or adequate for content, reading demand, layout, and interaction with the readers. CONCLUSIONS The quality of smartphone apps on infant feeding and activity was moderate based on the objective measurements of engagement, functionality, aesthetics, and information from a reliable source. The overall quality of information on infant feeding and activity was poor, indicated by low coverage of topics and incomplete or partially complete information. The key areas for improvement involved providing evidence-based information consistent with the Australian National Health and Medical Research Council’s Infant Feeding Guidelines. Apps supported and developed by health care professionals with adequate health service funding can ensure that parents are provided with credible and reliable resources.


2020 ◽  
Author(s):  
Jordi Miró ◽  
Pere Llorens-Vernet

BACKGROUND There is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed. OBJECTIVE The main aim of this study was to study the interrater reliability of a new guide — the Mobile App Development and Assessment Guide (MAG) — and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders. METHODS In order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability. RESULTS Only a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were “Security” (<i>α</i>=0.78) and “Privacy” (<i>α</i>=0.73). In addition, 2 other categories, “Usability” and “Safety,” were very close to compliance (health care professionals: <i>α</i>=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29. CONCLUSIONS This study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.


10.2196/26471 ◽  
2021 ◽  
Vol 9 (4) ◽  
pp. e26471
Author(s):  
Jordi Miró ◽  
Pere Llorens-Vernet

Background There is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed. Objective The main aim of this study was to study the interrater reliability of a new guide — the Mobile App Development and Assessment Guide (MAG) — and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders. Methods In order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability. Results Only a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were “Security” (α=0.78) and “Privacy” (α=0.73). In addition, 2 other categories, “Usability” and “Safety,” were very close to compliance (health care professionals: α=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29. Conclusions This study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Laura Tucker ◽  
Alan Cuevas Villagomez ◽  
Tamar Krishnamurti

Abstract Background The United States is currently facing a maternal morbidity and mortality crisis, with the highest rates of any resource-rich nation. In efforts to address this, new guidelines for postpartum care suggest that mobile health (mHealth) apps can help provide complementary clinical support for new mothers during the postpartum period. However, to date no study has evaluated the quality of existing mHealth tools targeted to this time period in terms of sufficiency of maternal health information, inclusivity of people of color, and app usability. Methods Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) standards were used to review the peripartum apps from the Apple and Google Play stores in either the Health/Fitness, Medical, or Education categories. Apps were evaluated for extent and quality of maternal health information and inclusivity of people of color using an a priori coding scheme. App usability was evaluated using the Mobile Application Rating Scale (MARS) score. Results Of the 301 apps from the Apple and Google Play stores, 25 met criteria for final evaluation. Of the 30 maternal health topics coded for, the median number addressed by apps was 19.5 (65%). Peripartum behaviors were more frequently addressed than peripartum outpatient care topics and peripartum acute health risks. The coverage of maternal health information and inclusivity of people of color in app imagery both correlated positively with the MARS usability score of the app. Only 8 apps (32%) portrayed greater than 24% images of people of color- the percent of non-white Americans according to 2019 census estimates. There was no correlation between MARS usability score and number of app users, as estimated by number of ratings for the app available on the app store. In addition, apps with evidence-based maternal health information had greater MARS engagement, information, and aesthetics scores. However, presence of evidence-based information did not correlate with greater numbers of app users. Conclusions Current commercially available peripartum apps range widely in quality. Overall current app offerings generally do not provide adequate maternal health information and are not optimally accessible to the target users in terms of inclusivity of women of color or app usability. Apps delivering evidence-based information and more usable design are more likely to meet these standards but are not more likely to be downloaded by users.


2021 ◽  
Author(s):  
Paul Macharia ◽  
Antoni Pérez-Navarro ◽  
Irene Inwani ◽  
Ruth Nduati ◽  
Carme Carrion

BACKGROUND Adolescent pregnancies and sexually-transmitted infections continue to impact 15 – 19-year-olds across the globe. The lack of sexual reproductive health information in resource-limited settings can often be due to cultural and societal attitudes to adolescent sexual reproductive health. Innovative approaches, including mobile phone technologies, are needed to address the need for adolescent reproductive health information. OBJECTIVE To design and develop a mobile app prototype to provide confidential adolescent reproductive health information on demand and evaluate its usability and user experience. METHODS A human-centered design methodology was applied. This practice framework allowed the perspectives and feedback of adolescent users to be included in the iterative design process. Field usability testing enabled the adolescents to provide feedback on the functionality, usability, and usefulness of the app. RESULTS During the usability test, 62 (54.9%) of the adolescents that were followed-up had used the app at least once, 30 (48.4%) of these were male participants and 32 (51.6%) female. The app was described as ‘very interesting’ to use by 44 (70.9%) participants, 20 male and 24 female. The content was deemed to be either ‘perfectly’ or ‘well targeted’ on sexual reproductive health by 60 (96.7%) adolescents, and the app was rated ‘best app’ by 45 (72.6%) adolescents, 27 female and 18 male, with a p-value = 0.011. CONCLUSIONS A mobile phone app is a feasible and acceptable way to deliver adolescent sexual reproductive health information in resource-limited settings. The USSD mobile phone technology could deliver confidential information on demand.


2019 ◽  
Author(s):  
Marco Bardus ◽  
Nathalie Awada ◽  
Lilian A Ghandour ◽  
Elie-Jacques Fares ◽  
Tarek Gherbal ◽  
...  

BACKGROUND With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic. OBJECTIVE This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders. METHODS We followed a well-established and defined “universalist” process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps. RESULTS MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (<i>P</i>&lt;.001). The lowest correlation was observed in the area of usability (<i>r</i>=0.685), followed by aesthetics (<i>r</i>=0.827), information quality (<i>r</i>=0.854), engagement (<i>r</i>=0.894), and total app quality (<i>r</i>=0.897). Subjective quality was also highly correlated (<i>r</i>=0.820). CONCLUSIONS MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.


2021 ◽  
Author(s):  
Nicole E Werner ◽  
Janetta C Brown ◽  
Priya Loganathar ◽  
Richard J Holden

BACKGROUND The over 11 million care partners in the US who provide care to people living with Alzheimer’s disease and related dementias (ADRD) cite persistent and pervasive unmet needs related to all aspects of their caregiving role. The proliferation of mobile applications (apps) for care partners has potential to meet the care partners’ needs, but the quality of apps is unknown. OBJECTIVE The present study aimed to 1) evaluate the quality of publicly available apps for care partners of people living with ADRD and 2) identify design features of low- and high-quality apps to guide future research and app development. METHODS We searched the US Apple and Google Play app stores with the criteria that the app needed to be 1) available in US Google play or Apple app stores, 2) directly accessible to users “out of the box”, 3) primarily intended for use by an informal (family, friend) caregiver or caregivers of a person with dementia. The included apps were then evaluated using the Mobile App Rating Scale (MARS), which includes descriptive app classification and rating using 23 items across five dimensions: engagement, functionality, aesthetics, information, and subjective quality. Next, we computed descriptive statistics for each rating. To identify recommendations for future research and app development, we categorized rater comments on the score driving factors for each item and what the app could have done to improve the score for that item. RESULTS We evaluated 17 apps (41% iOS only, 12% Android only, 47% both iOS and Android). We found that on average, the apps are of minimally acceptable quality. Although we identified apps above and below minimally acceptable quality, many apps had broken features and were rated as below acceptable for engagement and information. CONCLUSIONS Minimally acceptable quality is likely insufficient to meet care partner needs. Future research should establish minimum quality standards across dimensions for mobile apps for care partners. The design features of high-quality apps we identified in this research can provide the foundation for benchmarking those standards.


2021 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  

BACKGROUND Mobile applications promise to improve current health care. A growing number app quality studies exist to help patients and physicians choose appropriate, helpful and useful applications. However, current mobile app quality ratings are mostly physician-based. They exclude patients although as end-users, patients are able to provide the most relevant feedback. In a recent physician-based review of rheumatic apps, Rheuma Auszeit received the best overall rating (4.2/5), however this app has never been systematically evaluated by the intended end-users, rheumatic patients. OBJECTIVE The aim of this study was (1) to assess the quality of Rheuma Auszeit by rheumatic patients and (2) to evaluate the association between uMARS (User Version of the Mobile App Rating Scale) scores and patients’ characteristics. METHODS Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to evaluate the app Rheuma Auszeit using the uMARS and to complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. The association between uMARS scores and patients’ characteristics was further explored. RESULTS Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P<.004). Older male rheumatic patients reported a higher subjective quality score (P<.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho=0.18; P<.042). Preferred time of app usage significantly correlated with engagement (Rho=0.20; P<.024), functionality (Rho=0.19; P<.029), total uMARS score (Rho=0.21; P<.017) and subjective quality score (Rho=0.21; P<.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%). CONCLUSIONS Rheuma Auszeit was well accepted by patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. The study highlights the potential and feasibility of therapeutic complementary digital solutions in rheumatology.


Sign in / Sign up

Export Citation Format

Share Document