scholarly journals The Mobile App Development and Assessment Guide (MAG): Delphi-Based Validity Study (Preprint)

2020 ◽  
Author(s):  
Pere Llorens-Vernet ◽  
Jordi Miró

BACKGROUND In recent years, there has been an exponential growth of mobile health (mHealth)–related apps. This has occurred in a somewhat unsupervised manner. Therefore, having a set of criteria that could be used by all stakeholders to guide the development process and the assessment of the quality of the apps is of most importance. OBJECTIVE The aim of this paper is to study the validity of the Mobile App Development and Assessment Guide (MAG), a guide recently created to help stakeholders develop and assess mobile health apps. METHODS To conduct a validation process of the MAG, we used the Delphi method to reach a consensus among participating stakeholders. We identified 158 potential participants: 45 patients as potential end users, 41 health care professionals, and 72 developers. We sent participants an online survey and asked them to rate how important they considered each item in the guide to be on a scale from 0 to 10. Two rounds were enough to reach consensus. RESULTS In the first round, almost one-third (n=42) of those invited participated, and half of those (n=24) also participated in the second round. Most items in the guide were found to be important to a quality mHealth-related app; a total of 48 criteria were established as important. “Privacy,” “security,” and “usability” were the categories that included most of the important criteria. CONCLUSIONS The data supports the validity of the MAG. In addition, the findings identified the criteria that stakeholders consider to be most important. The MAG will help advance the field by providing developers, health care professionals, and end users with a valid guide so that they can develop and identify mHealth-related apps that are of quality.

10.2196/17760 ◽  
2020 ◽  
Vol 8 (7) ◽  
pp. e17760 ◽  
Author(s):  
Pere Llorens-Vernet ◽  
Jordi Miró

Background In recent years, there has been an exponential growth of mobile health (mHealth)–related apps. This has occurred in a somewhat unsupervised manner. Therefore, having a set of criteria that could be used by all stakeholders to guide the development process and the assessment of the quality of the apps is of most importance. Objective The aim of this paper is to study the validity of the Mobile App Development and Assessment Guide (MAG), a guide recently created to help stakeholders develop and assess mobile health apps. Methods To conduct a validation process of the MAG, we used the Delphi method to reach a consensus among participating stakeholders. We identified 158 potential participants: 45 patients as potential end users, 41 health care professionals, and 72 developers. We sent participants an online survey and asked them to rate how important they considered each item in the guide to be on a scale from 0 to 10. Two rounds were enough to reach consensus. Results In the first round, almost one-third (n=42) of those invited participated, and half of those (n=24) also participated in the second round. Most items in the guide were found to be important to a quality mHealth-related app; a total of 48 criteria were established as important. “Privacy,” “security,” and “usability” were the categories that included most of the important criteria. Conclusions The data supports the validity of the MAG. In addition, the findings identified the criteria that stakeholders consider to be most important. The MAG will help advance the field by providing developers, health care professionals, and end users with a valid guide so that they can develop and identify mHealth-related apps that are of quality.


2018 ◽  
Author(s):  
Ying-Li Lee ◽  
Yan-Yan Cui ◽  
Ming-Hsiang Tu ◽  
Yu-Chi Chen ◽  
Polun Chang

BACKGROUND Chronic kidney disease (CKD) is a global health problem with a high economic burden, which is particularly prevalent in Taiwan. Mobile health apps have been widely used to maintain continuity of patient care for various chronic diseases. To slow the progression of CKD, continuity of care is vital for patients’ self-management and cooperation with health care professionals. However, the literature provides a limited understanding of the use of mobile health apps to maintain continuity of patient-centered care for CKD. OBJECTIVE This study identified apps related to the continuity of patient-centered care for CKD on the App Store, Google Play, and 360 Mobile Assistant, and explored the information and frequency of changes in these apps available to the public on different platforms. App functionalities, like patient self-management and patient management support for health care professionals, were also examined. METHODS We used the CKD-related keywords “kidney,” “renal,” “nephro,” “chronic kidney disease,” “CKD,” and “kidney disease” in traditional Chinese, simplified Chinese, and English to search 3 app platforms: App Store, Google Play, and 360 Mobile Assistant. A total of 2 reviewers reached consensus on coding guidelines and coded the contents and functionalities of the apps through content analysis. After coding, Microsoft Office Excel 2016 was used to calculate Cohen kappa coefficients and analyze the contents and functionalities of the apps. RESULTS A total of 177 apps related to patient-centered care for CKD in any language were included. On the basis of their functionality and content, 67 apps were recommended for patients. Among them, the most common functionalities were CKD information and CKD self-management (38/67, 57%), e-consultation (17/67, 25%), CKD nutrition education (16/67, 24%), and estimated glomerular filtration rate (eGFR) calculators (13/67, 19%). In addition, 67 apps were recommended for health care professionals. The most common functionalities of these apps were comprehensive clinical calculators (including eGFR; 30/67; 45%), CKD medical professional information (16/67, 24%), stand-alone eGFR calculators (14/67, 21%), and CKD clinical decision support (14/67, 21%). A total of 43 apps with single- or multiple-indicator calculators were found to be suitable for health care professionals and patients. The aspects of patient care apps intended to support self-management of CKD patients were encouraging patients to actively participate in health care (92/110, 83.6%), recognizing and effectively responding to symptoms (56/110, 50.9%), and disease-specific knowledge (53/110, 48.2%). Only 13 apps contained consulting management functions, patient management functions or teleconsultation functions designed to support health care professionals in CKD patient management. CONCLUSIONS This study revealed that the continuity of patient-centered care for CKD provided by mobile health apps is inadequate for both CKD self-management by patients and patient care support for health care professionals. More comprehensive solutions are required to enhance the continuity of patient-centered care for CKD.


2020 ◽  
Author(s):  
Jordi Miró ◽  
Pere Llorens-Vernet

BACKGROUND There is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed. OBJECTIVE The main aim of this study was to study the interrater reliability of a new guide — the Mobile App Development and Assessment Guide (MAG) — and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders. METHODS In order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability. RESULTS Only a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were “Security” (<i>α</i>=0.78) and “Privacy” (<i>α</i>=0.73). In addition, 2 other categories, “Usability” and “Safety,” were very close to compliance (health care professionals: <i>α</i>=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29. CONCLUSIONS This study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.


10.2196/26471 ◽  
2021 ◽  
Vol 9 (4) ◽  
pp. e26471
Author(s):  
Jordi Miró ◽  
Pere Llorens-Vernet

Background There is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed. Objective The main aim of this study was to study the interrater reliability of a new guide — the Mobile App Development and Assessment Guide (MAG) — and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders. Methods In order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability. Results Only a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were “Security” (α=0.78) and “Privacy” (α=0.73). In addition, 2 other categories, “Usability” and “Safety,” were very close to compliance (health care professionals: α=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29. Conclusions This study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.


10.2196/18513 ◽  
2020 ◽  
Vol 8 (12) ◽  
pp. e18513
Author(s):  
Alejandro Plaza Roncero ◽  
Gonçalo Marques ◽  
Beatriz Sainz-De-Abajo ◽  
Francisco Martín-Rodríguez ◽  
Carlos del Pozo Vegas ◽  
...  

Background Mobile health apps are used to improve the quality of health care. These apps are changing the current scenario in health care, and their numbers are increasing. Objective We wanted to perform an analysis of the current status of mobile health technologies and apps for medical emergencies. We aimed to synthesize the existing body of knowledge to provide relevant insights for this topic. Moreover, we wanted to identify common threads and gaps to support new challenging, interesting, and relevant research directions. Methods We reviewed the main relevant papers and apps available in the literature. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology was used in this review. The search criteria were adopted using systematic methods to select papers and apps. On one hand, a bibliographic review was carried out in different search databases to collect papers related to each application in the health emergency field using defined criteria. On the other hand, a review of mobile apps in two virtual storage platforms (Google Play Store and Apple App Store) was carried out. The Google Play Store and Apple App Store are related to the Android and iOS operating systems, respectively. Results In the literature review, 28 papers in the field of medical emergency were included. These studies were collected and selected according to established criteria. Moreover, we proposed a taxonomy using six groups of applications. In total, 324 mobile apps were found, with 192 identified in the Google Play Store and 132 identified in the Apple App Store. Conclusions We found that all apps in the Google Play Store were free, and 73 apps in the Apple App Store were paid, with the price ranging from US $0.89 to US $5.99. Moreover, 39% (11/28) of the included studies were related to warning systems for emergency services and 21% (6/28) were associated with disaster management apps.


2020 ◽  
Vol 4 (Supplement_2) ◽  
pp. 1325-1325
Author(s):  
Jun Hao Lim ◽  
Cordelia Kheng May Lim ◽  
Imliya Ibrahim ◽  
Jazlina Shahrul ◽  
Mohd Hazli Mohd Zabil ◽  
...  

Abstract Objectives Dietary non-adherence is highly prevalent among maintenance hemodialysis (HD) patients resulting in multitudes health complications and poor treatment outcomes. Given high penetration of smartphone, well-designed mobile health apps emerged as a potential tool to empower HD patients with dietary self-management skills. This need analysis study determined the perception and expectation of patients and dietitians on the features and the use of apps in dialysis care to foster development of evidence-based renal diet apps. Methods This was a mixed-method study with concurrent triangulation design. The quantitative arm involved HD patients (n = 184) through face-to-face interview and dietitians (n = 120) via anonymous online survey. While the qualitative arm consisted of 10 in-depth interviews (HD patients) and 8 email interviews (dietitians). Descriptive and thematic analyses were used, and the results were compared. Results A total of 69.6% of HD patients owned a smartphone. More than half (53.9%) of the smartphone users had the experience of searching health information especially nutrition-related topics (91.3%). Majority of them (78.9%) perceived renal diet apps as very important and were willing to use (80.5%). They agreed that renal diet apps can help them in preventing nutrition complications (82.0%), planning menu (78.9%) and monitoring nutrient intakes (82.8%). In the context of practising dietitians, 60.8% aware of the existence of renal diet apps but only 38.3% of them would recommend existing renal diet apps to their patients due to lack of local content (42.5%) and unsure credibility (37.5%). Most of them (88.3%) perceived that local-based renal diet app is needed and agreed that it can enhance dietetics care in HD population (90.8%). Top features anticipated by both patients and dietitians included plan or order, tailored assistance, usability and tracker. Conclusions Dietary self-management via mobile health apps seems to be feasible in the dialysis population given the high smartphone penetration, strong desire to use and positive perceptions from patients and dietitians. Features valued by patients and dietitians will be integrated into the design of the apps to promote acceptance and usage. Funding Sources This project is funded by the internal grant of Universiti Putra Malaysia (Inisiatif Putra Muda).


Author(s):  
Justine Seymour ◽  
Jennifer L. Barnes ◽  
Julie Schumacher ◽  
Rachel L. Vollmer

The purpose of this study was to determine whether weight bias exhibited by health care professionals (HCPs) impacts quality of health care provided to individuals with obesity. HCPs (n = 220; 88% female, 87% nurses) in the Midwest region of the United States were recruited to complete an online survey. In this within-subjects study design, participants completed the Attitudes Towards Obese Persons (ATOP) scale to assess weight bias and responded to 2 (1 person with obesity and 1 person without obesity) hypothetical patient scenarios to evaluate quality of care. A median split was calculated for ATOP scores to divide participants into high or low weight bias groups. Within these groups, thematic analysis was used to uncover themes in quality of care based on participants’ responses to each scenario. The analysis revealed that HCPs in the high weight bias group gave specific diet and exercise recommendations, offered health advice regarding weight loss, and used less teaching discourse when responding to the patient with obesity. In addition, in both weight bias groups, patients with obesity were started on pharmaceutical therapies sooner. The findings of this study suggest a need to educate HCPs on the importance of empathy and compassion when providing treatment to all patients, regardless of weight, to increase quality of care and ultimately improve patient outcomes.


2019 ◽  
Vol 4 ◽  
Author(s):  
Nick Noguez And Michael Gonzalez

  Despite the ubiquity of smartphone ownership and the increasing integration of social engagement features in smoking cessation apps to engage users, thesocial engagement features that exist in current smoking cessation apps and how effective these social features are in engaging users remain unclear. To fill the gap in the literature, a content analysis of free and paid smoking cessation mobile apps isconducted to examine a) the presence of socialengagement features(e.g., social support, social announcement, social referencing) and non-social engagement features (e.g., personal environmental changes, goal setting), and b) their relationship with user ratingsand engagement scores (e.g., Mobile App rating scale [MARS]). The findings will not only extend the mobile health apps engagement typology,but also inform smoking cessation mobile apps design.


10.2196/13236 ◽  
2019 ◽  
Vol 7 (11) ◽  
pp. e13236 ◽  
Author(s):  
Jie Shang ◽  
Shaoming Wei ◽  
Jianbo Jin ◽  
Puhong Zhang

Background Mental disorders have been a great burden on health care systems, affecting the quality of life of millions of people worldwide. Developing countries, including China, suffer from the double burden of both the increasing mental health issues in population and the deficiency in mental health care resources. The use of mobile health technologies, especially for mobile phone apps, can be a possible solution. Objective This review aimed to describe the features and assess the quality of mental health apps in major mobile phone app markets in China and further discuss the priorities for mental health app development. Methods Keywords including psychology, psychological health, psychological hygiene, psychological health service(s), mental, mental health, mental hygiene, mental health service(s), depression, and anxiety were searched in Chinese in 3 Android app markets (Baidu Mobile Assistant, Tencent MyApp, and 360 Mobile Assistant) and iOS App Store independently. Mental health apps were then selected according to established criteria for in-depth analysis and quality assessment by the Mobile App Rating Scale. Results In total, 63 of 997 mental health apps were analyzed in depth, of which 78% (49/63) were developed by commercial entities for general population, 17% (11/63) were for patients or clients of specialized psychiatric hospitals or counseling agencies, 3% (2/63) were by government or local Centers for Disease Control and Prevention for general information, and 2% (1/63) for students of a university. Major built-in features of the apps included counseling services, mental health education, and self-assessment of mental health status by validated self-rating scales. The overall quality score of the MH apps was acceptable. Conclusions Mental health apps are emerging in the area of mobile health in China. Popular mental health apps usually provide a synthetic platform organizing resources of information, knowledge, counseling services, self-tests, and management for the general population with mental health-related inquiries. The quality of the apps was rated as acceptable on average, suggesting some space for improvement. Official guidelines and regulations are urgently required for the field in the future.


2019 ◽  
Author(s):  
Miguel Angel Mayer ◽  
Octavi Rodríguez Blanco ◽  
Antonio Torrejon

BACKGROUND In the last few years, the number of mobile apps for health professionals has increased exponentially. Nevertheless, there is a lack of knowledge about the professional use, training requirements, and quality perception of these apps among health care professionals such as nurses. Considering that the nursing profession is the largest segment of health care workforce in many countries such as Spain, the impact of the use of health apps by these professionals can be critical to the future of modern health care. OBJECTIVE The main objective of this study was to determine if nurses were using health apps professionally and what types of apps they were using. The secondary objectives were (1) to find out if, among nurses, there is a need for training in the use of health apps and (2) to explore nurses’ perceptions of health professional apps, determining whether there is a need for a certification process for health apps and the type of institution or organization that should review and validate these apps for professional use. METHODS After an initial piloting survey, all registered nurses at the Nursing Association of Barcelona were invited to participate in a 34-item online survey. Eventually, 1293 nurses participated in the survey; however, 52 did not complete the survey properly, omitting both age or gender information, and they were excluded from the analysis. RESULTS About half of the respondents (600/1241, 48.35%) had health professional apps installed on their devices and were included for analysis. Most participants in the survey were women (474/600, 79.0%) and the remaining were men (126/600, 21.0%). The most popular types of apps used and installed among nurses were related to drug information, health calculators, and health guidelines. Overall, 97.0% (582/600) of nurses thought that the health apps should be certified, and 80.0% (480/600) agreed that the certification process should be carried out by professional or health institutions. Furthermore, 14.5% (87/600) of participants mentioned that they were asked by their patients to prescribe a health app and only 6.5% (28/430) recommended them often. Most nurses (354/433, 81.8%) who answered the question about the importance of receiving specific training on using and prescribing health apps considered this point a very relevant issue. CONCLUSIONS About half of the nurses in Catalonia use health apps for professional purposes, and they believe that these types of tools should be validated and certified by health or professional institutions before using them in clinical environments. Although the prescription of health apps in clinical environments is infrequent among nurses, they would be willing to prescribe apps if they were certified by a health organization. Finally, among nurses, there is a need for training in using and prescribing health apps for health care purposes.


Sign in / Sign up

Export Citation Format

Share Document