scholarly journals Assessing the Quality of skin Healthcare Mobile Apps: a systematic review and scoring using the MARS

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
H Woo ◽  
G h Kim ◽  
Y w Kim
Keyword(s):  
Rating Scale ◽  
Mobile Apps ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
High Quality ◽  
Simple Task ◽  
Content Quality ◽  
Assessment Scores ◽  
Static Correlation

Abstract Background With the number of skin healthcare-related apps users increasing, the selection of high-quality apps is not a simple task. The aim of this study was to (1)describe the content of available skin healthcare apps, (2)evaluate their objective quality regarding engagement, functionality, aesthetics, information and subjective quality. Methods The App Store and Google Play store were systematically searched to identify skin healthcare mobile apps for general population use. Eligible apps were downloaded and independently evaluated for quality by 4 reviewers using the Mobile App Rating Scale(MARS). The MARS is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality. MARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. In addition, the correlation between MARS score and user score was analyzed. Results The overall 37 apps obtained a mean quality score of 2.77(SD.62). 'Trove skin(Android: 4.13)' received the highest score, while 'Complete Beauty Guides(Android: 1.8)' received the lowest score. User scores were found to have no significant correlation between overall quality scores through MARS and content scores(r= .240, p= .153)(r= .290, p= .081), the overall quality score through MARS and the Content Score were significant static correlation(r= .487, p= .002). Conclusions As the use, and introduction, of mobile apps continue to grow, it will become increasingly important for consumers to adopt high-quality apps. Understanding the effectiveness of high-quality apps compared with low-quality apps can make it easier and more accurate for consumers decisions about using related to skin healthcare apps. Furthermore, qualities of apps that ranked higher could be used to improve existing apps or help with the development of new ones. Key messages Consumers refer to the User Score when selecting skin healthcare-related apps. However, User Score was not correlated with MARS content quality assessment scores evaluated by experts. This study is a significant help that enables consumers to select good-quality skin healthcare apps by high-quality content information through MARS.

Nutrition-Related Mobile Apps in the French App Store: Assessment of Functionality and Quality (Preprint)

2021 ◽  
Author(s):  
Florence Carrouel ◽  
Prescilla Martinon ◽  
Ina Saliasi ◽  
Denis Bourgeois ◽  
Colette Smenteck ◽  
...  
Keyword(s):  
Rating Scale ◽  
Mobile Apps ◽  
Intraclass Correlation ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
App Store ◽  
Nutritional Health ◽  
Long Term Impact ◽  
Poor Nutrition

BACKGROUND The global burden of disease attributes 20% of deaths to poor nutrition. Although hundreds of nutrition-related mobile applications have been created to help improve this situation and these have been downloaded by millions of users, the effectiveness of integrating these technologies on the adoption of healthy eating remains mixed. Similarly, no significant evaluation of nutrition applications in French, spoken by approximately 300 million people, has yet been identified in the literature. OBJECTIVE The aim of this study is to review which nutrition mobile apps are currently available on the French market, and to carry out an exhaustive assessment of their quality using the Mobile App Rating Scale (MARS) tool. METHODS A screening of apps related to nutritional health was conducted from March 10 to 17, 2021, on the Google Play Store and the French App Store. A shortlist of 15 apps was identified and assessed using the French version of MARS. Eight dietitian nutritionists assigned to assess seven apps. Remaining apps were randomly allocated to ensure four ratings per app. Intraclass correlation was used to evaluate inter-rater agreement. Mean ± SD scores and their distributions for each section and item were calculated. RESULTS The top scores for quality were obtained by Yazio (mean 3.84 ± standard deviation 0.32), FeelEat (3.71 ± 0.47) and BonneApp (3.65 ± 0.09). The engagement scores (Section A) ranged from 1.95 ± 0.5 for iEatBetter to 3.85 ± 0.44 for Feeleat. The functionality scores (Section B) ranged from 2.25 ± 0.54 for Naor to 4.25 ± 0.46 for Yazio. The Aesthetics scores (Section C) ranged from 2.17 ± 0.34 for Naor to 3.88 ± 0.47 for Yazio. The information scores (Section D) ranged from 2.38 ± 0.60 for iEatBetter:Journal alimentaire to 3.73 ± 0.29 for Yazio. The MARS subjective quality (Section E) varied from 1.13 ± 0.26 for Naor and 1.13 ± 0.25 iEatBetter:Journal alimentaire to 2.28 ± 0.88 for Compteur de calories Fatsecret. The specificity of apps varied from 1.38 ± 0.64 for iEatBetter:Journal alimentaire to 3.50 ± 0.91 for Feeleat. The app-specific score was always lower than the subjective quality score that was always lower than the quality score and that was lower than the rating score from the iOS or Android app stores. CONCLUSIONS Although the prevention and information messages regarding nutritional habits are not scientifically verified before marketing, dieteticians-nutritionists evaluated that the apps quality was quite relevant. The subjective quality and mobile app specificities were associated with lower ratings. Further investigations are needed to assess their alignment with recommendations and their long-term impact on users.

Quality of a Supporting Mobile App for Rheumatic Patients: Assessment Using the User Version of the Mobile Application Scale (uMARS) and Associated Patient Characteristics (Preprint)

2021 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Psoriatic Arthritis ◽  
Rating Scale ◽  
End Users ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
Ehealth Literacy ◽  
Rheumatic Patients

BACKGROUND Mobile applications promise to improve current health care. A growing number app quality studies exist to help patients and physicians choose appropriate, helpful and useful applications. However, current mobile app quality ratings are mostly physician-based. They exclude patients although as end-users, patients are able to provide the most relevant feedback. In a recent physician-based review of rheumatic apps, Rheuma Auszeit received the best overall rating (4.2/5), however this app has never been systematically evaluated by the intended end-users, rheumatic patients. OBJECTIVE The aim of this study was (1) to assess the quality of Rheuma Auszeit by rheumatic patients and (2) to evaluate the association between uMARS (User Version of the Mobile App Rating Scale) scores and patients’ characteristics. METHODS Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to evaluate the app Rheuma Auszeit using the uMARS and to complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. The association between uMARS scores and patients’ characteristics was further explored. RESULTS Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P<.004). Older male rheumatic patients reported a higher subjective quality score (P<.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho=0.18; P<.042). Preferred time of app usage significantly correlated with engagement (Rho=0.20; P<.024), functionality (Rho=0.19; P<.029), total uMARS score (Rho=0.21; P<.017) and subjective quality score (Rho=0.21; P<.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%). CONCLUSIONS Rheuma Auszeit was well accepted by patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. The study highlights the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

scholarly journals Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales (Preprint)

2020 ◽  
Author(s):  
Tehmina Gladman ◽  
Grace Tylee ◽  
Steve Gallagher ◽  
Jonathan Mair ◽  
Rebecca Grainger
Keyword(s):  
Student Learning ◽  
Teaching And Learning ◽  
Rating Scale ◽  
Clinical Skills ◽  
Mobile Apps ◽  
Mobile App ◽  
Systematic Search ◽  
Measurement Scales ◽  
High Quality

BACKGROUND Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning. OBJECTIVE This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures—the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning—to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning. METHODS Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL. RESULTS The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; <i>P</i>&lt;.001 and MARuL ICC [two-way]=0.68; <i>P</i>&lt;.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality. CONCLUSIONS This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps—Geeky Medics-OSCE revision and OSCE PASS: Medical Revision—rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL’s incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS’s more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning. CLINICALTRIAL

scholarly journals Quality of a Supporting Mobile App for Rheumatic Patients: Patient-Based Assessment Using the User Version of the Mobile Application Scale (uMARS)

2021 ◽  
Vol 8 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Psoriatic Arthritis ◽  
Rating Scale ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
University Hospital ◽  
Ehealth Literacy ◽  
Rheumatic Patients

Introduction: Mobile applications promise to improve current health care. However, current mobile app quality ratings are mostly physician-based. The aim of this study was (1) to assess the quality of the self-management app Rheuma Auszeit using the validated uMARS (User Version of the Mobile App Rating Scale) app quality assessment tool and (2) to evaluate the association between uMARS scores and patients' characteristics.Materials and Methods: Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to test Rheuma Auszeit, evaluate its quality using uMARS and complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. The association between uMARS scores and patients' characteristics was further explored.Results: Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P &lt; 0.004). Older male rheumatic patients reported a higher subjective quality score (P &lt; 0.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho = 0.18; P &lt; 0.042). Preferred time of app usage significantly correlated with engagement (Rho = 0.20; P &lt; 0.024), functionality (Rho = 0.19; P &lt; 0.029), total uMARS score (Rho = 0.21; P &lt; 0.017) and subjective quality score (Rho = 0.21; P &lt; 0.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%).Conclusion: Rheuma Auszeit was well-accepted by German patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. Lower functionality scores among older female rheumatic patients highlight the need for patient education. The study underlines the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

Preliminary assessment of content, behavior change techniques, and quality of pregnancy apps in Spain: Systematic search on app stores (Preprint)

2021 ◽  
Author(s):  
Aranzazu Muñoz-Mancisidor ◽  
Ruben Martin-Payo ◽  
Xana Gonzalez-Mendez ◽  
María Del Mar Fernández-Álvarez
Keyword(s):  
Behavior Change ◽  
Rating Scale ◽  
Mobile Apps ◽  
Median Number ◽  
Subjective Quality ◽  
Systematic Search ◽  
Behavior Change Techniques ◽  
Content Quality ◽  
Objective Quality ◽  
Behavior Strategies

BACKGROUND Women consult information in mobile apps (apps) during pregnancy, and even obstetrics specialists highlight that pregnancy is the ideal moment for the use of apps as consultation sources. However, the high number of apps designed for pregnancy requires a careful assessment to determine their suitability before recommendation. OBJECTIVE To identify the apps available in Spanish that can be recommended based on their content, behavior change techniques (BCTs), and quality as a complementary tool during pregnancy. METHODS A systematic search on app stores to identify apps was performed in the Apple App Store and Google Play, and the subject term pregnancy. The apps meeting the following criteria were chosen: i. pregnancy-related content; ii. free; iii. available in Spanish. They were excluded if: i. the app was classified as game/entertainment, and therefore had no educational or health aim; iii. they did not target the population under study. The selected apps were downloaded, and their quality was assessed using the Mobile Application Rating Scale (MARS), the BCTs included using the taxonomy Behavior Change Techniques Taxonomy v.1 and its content. RESULTS A total of 457 apps were identified, 25 of which were downloaded for assessment (5.6%). The median for objective and subjective quality was 2.94 (IR=2,71-3.46) and 1.75 (IR=1.25-2.25) respectively. Regarding content, the median of topics included in the apps was 23 (IR=16050-23.50) being weight gain, nutrition, fetal development and physical activity the most common. The median number of BCTs was 12 (RI=0.50-3.50). Statistically significant correlations were observed between objective quality and content (0.634), subjective quality and content (0.641), objective quality and BCTs (0.672), subjective quality and BCT (0.623), and BCTs and content (0.563). CONCLUSIONS The results of this study suggest that only a small percentage of free pregnancy apps available in Spanish should be recommended. The apps with the best quality score were those where a higher number of topics were addressed and included a larger quantity of BCT. While apps can potentially influence pregnant women’s behavior and contribute to pregnancy, a previous assessment of their content, quality, and behavior strategies is necessary in order to determine which apps could potentially be beneficial, and therefore, can be recommended.

scholarly journals A systematic review of dialectical behavior therapy mobile apps for content and usability

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Chelsey R. Wilks ◽  
Kyrill Gurtovenko ◽  
Kevin Rebmann ◽  
James Williamson ◽  
Josh Lovell ◽  
...  
Keyword(s):  
Behavior Therapy ◽  
Dialectical Behavior Therapy ◽  
Rating Scale ◽  
Mobile Apps ◽  
Skills Training ◽  
Mobile App ◽  
Star Rating ◽  
Content Quality ◽  
The Mean ◽  
Google Play

Abstract Background The gap between treatment need and treatment availability is particularly wide for individuals seeking Dialectical Behavior Therapy (DBT), and mobile apps based on DBT may be useful in increasing access to care and augmenting in-person DBT. This review examines DBT based apps, with a specific focus on content quality and usability. Methods All apps referring to DBT were identified in Google Play and iOS app stores and were systematically reviewed for app content and quality. The Mobile App Rating Scale (MARS) was used to evaluate app usability and engagement. Results A total of 21 free to download apps were identified. The majority of apps (71%) included a component of skills training, five apps included a diary card feature. Most (76.19%) apps were designed to function without help from a therapist. The average user “star” rating was 4.39 out of 5. The mean overall MARS score was 3.41, with a range of 2.15 to 4.59, and 71.43% were considered minimally ‘acceptable,’ as defined by a score of 3 or higher. The average star rating was correlated with the total MARS score (r = .51, p = .02). Estimates of app usage differed substantially between popular and unpopular apps, with the three most popular apps accounting for 89.3% of monthly active users. Conclusions While the present study identified many usable and engaging apps in app stores designed based on DBT, there are limited apps for clinicians. DBT based mobile apps should be carefully developed and clinically evaluated.

scholarly journals Measuring the Quality of Mobile Apps for the Management of Pain: Systematic Search and Evaluation Using the Mobile App Rating Scale (Preprint)

2018 ◽  
Author(s):  
Alejandro Salazar ◽  
Helena de Sola ◽  
Inmaculada Failde ◽  
Jose Antonio Moral-Munoz
Keyword(s):  
New Technologies ◽  
Rating Scale ◽  
Mobile Apps ◽  
Scientific Evidence ◽  
Mobile App ◽  
Subjective Quality ◽  
Global Quality ◽  
Final Score ◽  
Biopsychosocial Model Of Pain

BACKGROUND Chronic pain is a major health issue requiring an approach that not only considers medication, but also many other factors included in the biopsychosocial model of pain. New technologies, such as mobile apps, are tools to address these factors, although in many cases they lack proven quality or are not based on scientific evidence, so it is necessary to review and measure their quality. OBJECTIVE The aim is to evaluate and measure the quality of mobile apps for the management of pain using the Mobile App Rating Scale (MARS). METHODS This study included 18 pain-related mobile apps from the App Store and Play Store. The MARS was administered to measure their quality. We list the scores (of each section and the final score) of every app and we report the mean score (and standard deviation) for an overall vision of the quality of the pain-related apps. We compare the section scores between the groups defined according to the tertiles via analysis of variance (ANOVA) or Kruskal-Wallis test, depending on the normality of the distribution (Shapiro-Wilk test). RESULTS The global quality ranged from 1.74 (worst app) to 4.35 (best app). Overall, the 18 apps obtained a mean score of 3.17 (SD 0.75). The best-rated sections were functionality (mean 3.92, SD 0.72), esthetics (mean 3.29, SD 1.05), and engagement (mean 2.87, SD 1.14), whereas the worst rated were app specific (mean 2.48, SD 1.00), information (mean 2.52, SD 0.82), and app subjective quality (mean 2.68, SD 1.22). The main differences between tertiles were found on app subjective quality, engagement, esthetics, and app specific. CONCLUSIONS Current pain-related apps are of a certain quality mainly regarding their technical aspects, although they fail to offer information and have an impact on the user. Most apps are not based on scientific evidence, have not been rigorously tested, and the confidentiality of the information collected is not guaranteed. Future apps would need to improve these aspects and exploit the capabilities of current devices.

scholarly journals Content analysis of behavior change techniques in popular mobile apps for smoking cessation in France. (Preprint)

2020 ◽  
Author(s):  
Luz Bustamante ◽  
Cédric Gill Ménard ◽  
Sabrina Julien ◽  
Lucia Romo
Keyword(s):  
Smoking Cessation ◽  
Content Analysis ◽  
Rating Scale ◽  
Mobile Apps ◽  
Mobile App ◽  
Smoking Cessation Treatment ◽  
Content Quality ◽  
Cessation Treatment ◽  
General Quality

BACKGROUND The mobile app market differs from country to country, and to date no previous review of smoking cessation applications (apps) content quality has been conducted in France. OBJECTIVE The current review aims to examine the general quality of the most popular smoking cessation apps in France and also determine the degree to which apps adhere to established behavioral and cognitive techniques (BCT’s) proven effective in clinical practice. METHODS A systematic research of smoking cessation apps was conducted in both Google Play and Apple store in the French market. The general quality of popular apps was rated with the Mobile App Rating Scale (MARS) and the therapeutical quality was assessed with the ratio of adherence of the BCT taxonomy for smoking cessation treatment. RESULTS 14 mobile apps met all the inclusion criteria of the content analysis. The inter-rater reliability varies from “substantial’ (0,79) to “almost perfect” (0,9) for both measures. The mean MARS score was 3,5 out of 5 (median 3,1- IQR 1,3). Findings suggest that popular apps focused primary on the functionality dimension of the MARS scale (4.2 out of 5). The average number of BCT techniques was 22, with a huge difference between apps (min=4/max=38). At least half of the apps addressed motivation (63%) and advise on using behavioral skills in order to quit or stay nonsmoker (62%). However, only a handful of apps gathered important information (42%) in order to deliver proper advice regarding the use of approved medication or the implementation of the behavioral techniques (31%). The average MARS score was positively correlated with the price (r = .70, p = < .001), and with the number of BCT’s used (r = .66, p = < .005). User rating was not correlated with any quality scale. CONCLUSIONS Content quality of popular smoking cessation apps in France varied by app type and price. Most popular apps propose in general a good quality content but lack the implementation of evidence based BCT’s associated with effectiveness on smoking cessation treatment. Further research is needed to evaluate the improvement of the quality content of smoking cessation apps in France.

scholarly journals Evaluation of Mobile Apps Targeted at Patients With Spondyloarthritis for Disease Monitoring: Systematic App Search (Preprint)

2019 ◽  
Author(s):  
Yu Heng Kwan ◽  
Wei Jie Ong ◽  
Mengfei Xiong ◽  
Ying Ying Leung ◽  
Jie Kie Phang ◽  
...  
Keyword(s):  
Psoriatic Arthritis ◽  
Disease Activity ◽  
Rating Scale ◽  
Mobile Apps ◽  
Mobile App ◽  
Activity Monitoring ◽  
Activity Measurement ◽  
Measurement Instruments ◽  
High Quality ◽  
Disease Activity Measurement

BACKGROUND There are many apps developed for patients with spondyloarthritis in the market, but their purpose and quality are not objectively evaluated. OBJECTIVE The objective of this study was to identify and evaluate existing publicly available, high-quality apps that use validated measurement instruments for monitoring spondyloarthritis disease activity. METHODS We conducted a review of apps available on the Apple App Store and the Google Play Store based on a combination of keywords and inclusion and exclusion criteria. Validated disease activity measurement instruments were identified. Data regarding app characteristics, including the presence of validated disease activity measurement, were extracted. The Mobile App Rating Scale (MARS) was used to review the apps for user experience. RESULTS A total of 1253 apps were identified in the app stores, and 5 apps met the criteria and were further analyzed. Moreover, 2 apps (MySpA and Group for Research and Assessment of Psoriasis and Psoriatic Arthritis App) contained some of the validated disease activity monitoring instruments for specific spondyloarthritis subtypes. These 2 apps were also rated good on the MARS (with total mean scores ≥4 out of 5), whereas the other apps scored poorly in comparison. CONCLUSIONS There are 2 high-quality spondyloarthritis disease activity monitoring apps publicly available, but they only target 2 spondyloarthritis subtypes—ankylosing spondylitis and psoriatic arthritis. There is a lack of high-quality apps that can measure disease activity for other spondyloarthritis subtypes, and no app that consolidates all validated disease activity instruments across subtypes was available.

scholarly journals Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales

10.2196/25377 ◽  
2021 ◽  
Vol 9 (4) ◽  
pp. e25377
Author(s):  
Tehmina Gladman ◽  
Grace Tylee ◽  
Steve Gallagher ◽  
Jonathan Mair ◽  
Rebecca Grainger
Keyword(s):  
Student Learning ◽  
Teaching And Learning ◽  
Rating Scale ◽  
Clinical Skills ◽  
Mobile Apps ◽  
Mobile App ◽  
Systematic Search ◽  
Measurement Scales ◽  
High Quality

Background Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning. Objective This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures—the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning—to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning. Methods Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL. Results The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; P<.001 and MARuL ICC [two-way]=0.68; P<.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality. Conclusions This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps—Geeky Medics-OSCE revision and OSCE PASS: Medical Revision—rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL’s incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS’s more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning.

Sign in / Sign up

Export Citation Format

Share Document