A new tool for assessing the quality of online health information on the McMaster Optimal Aging Portal

2017 ◽  
Author(s):  
Maureen Dobbins ◽  
Susannah Watson ◽  
Kristin Read ◽  
Kelly Graham ◽  
Reza Yousefi Nooraie ◽  
...  
2021 ◽  
Author(s):  
Anagha Kulkarni ◽  
Mike Wong ◽  
Tejasvi Belsare ◽  
Risha Shah ◽  
Diana Yu Yu ◽  
...  

BACKGROUND The Internet has become a major source of health information especially for adolescents and young adults. Unfortunately, inaccurate, incomplete or outdated health information is widespread online. Often adolescents and young adults turn to authoritative websites such as the student health center (SHC) website of the university they are attending to obtain reliable health information. Although most on-campus SHC clinics comply with the American College Health Association (ACHA) standards, their websites are not subject to any standards or code of conduct. In the absence of quality standards or guidelines, the monitoring and compliance processes do not exist for SHC websites either. As such, there is no oversight on the health information published on the SHC websites by any central governing body. OBJECTIVE Our objective is to enable researchers to monitor online information quality at scale. We have created a tool that can efficiently quantify the quality of information posted on SHC websites about a health topic. Specifically, this quantitative tool provides information on quality, such as reading ease, coverage of the topic, and the degree of fact-based objective information. METHODS Our cross-functional team has designed and developed an open-source software, QMOHI: Quantitative Measures of Online Health Information, using the Agile software development methodology. The QMOHI tool finds the SHC website and gathers information on the specific health topic of interest from a prespecified list of university websites. Based on the retrieved text, the tool computes eight different quality metrics. The QMOHI tool is a fully automated tool that is designed to be scalable, generalizable, and robust. RESULTS The first empirical evaluation shows that the QMOHI tool is highly scalable and substantially more efficient than the manual approach of assessing online information quality. The second experimental results demonstrate QMOHI’s ability to work effectively with starkly different health topics (COVID, Cancer, LARC, and Condom) and with narrowly focused topics (hormonal IUD and copper IUD); thereby establishing the generalizability and versatility of the tool. The results from the last experiment demonstrate that QMOHI is not vulnerable to typical structural changes that SHC websites may undergo (e.g. URL changes) over a long period of time. QMOHI is able to support longitudinal studies by being robust to such website changes. CONCLUSIONS QMOHI allows public health researchers and practitioners to conduct large-scale studies of SHC websites that were previously too time intensive. The capability to generalize broadly or focus narrowly allows for wide applications of QMOHI, equipping researchers to study both mainstream and underexplored health topics. QMOHI’s ability to robustly analyze SHC websites periodically facilitates longitudinal investigations and monitor SHC progress. QMOHI serves as a launching pad for our future work that aims to develop a broadly applicable public health tool for online health information studies with potential applications far beyond SHC websites.


2021 ◽  
Vol 8 (1) ◽  
pp. 1
Author(s):  
Leela Raj ◽  
Denise Smith ◽  
James Heilman

Background Wikipedia is frequently used as a source of health information. However, the quality of its content varies widely across articles. The DISCERN tool is a brief questionnaire developed in 1996 by the Division of Public Health and Primary Health Care of the Institute of Health Sciences of the University of Oxford. They claim it provides users with a valid and reliable way of assessing the quality of written information. However, the DISCERN instrument’s reliability in measuring the quality of online health information, particularly whether or not its scores are affected by reader biases about specific publication sources, has not yet been explored. Methods This study is a double-blind randomized assessment of a Wikipedia article versus a BMJ literature review using a modified version of the DISCERN tool. Participants will include physicians and medical residents from four university campuses in Ontario and British Columbia and will be randomized into one of four study arms. Inferential statistics tests (paired t-test, multi-level ordinal regression, and one-way ANOVA) will be conducted with the data collected from the study. Outcomes The primary outcome of this study will be to determine whether a statistically significant difference in DISCERN scores exists, which could suggest whether or not how health information is packaged influences how it is assessed for quality. Plain Language Summary The internet, and in particular Wikipedia, is an important way for professionals, students and the public to obtain health information. For this reason, the DISCERN tool was developed in 1996 to help users assess the quality of the health information they find. The ability of DISCERN to measure the quality of online health information has been supported with research, but the role of bias has not necessarily been accounted for. Does how the information is packaged influence how the information itself is evaluated? This study will compare the scores assigned to articles in their original format to the same articles in a modified format in order to determine whether the DISCERN tool is able to overcome bias. A significant difference in ratings between original and inverted articles will suggest that the DISCERN tool lacks the ability to overcome bias related to how health information is packaged.


Author(s):  
Izabella Lejbkowicz

The exponential development of Information Technologies revolutionized healthcare. A significant aspect of this revolution is the access to health information in the Internet. The Internet World Stats estimates that 56.8% of the world population used the Internet in March 2019, an increase of 1,066% from 2000. According to The Pew Research Center survey of 2012 81% of Americans used the internet and 72% of them searched for health information. Even though there is a lack in more recent data on the percentage of online health information seekers, it is clear that this trend is on the rise. This chapter focuses on the characteristics of the search for online health information by patients and providers, investigates features related to the quality of health web sites, and discusses the impact of these searches on healthcare.


2020 ◽  
Vol 10 (9) ◽  
pp. 3214
Author(s):  
Muhammad Tahir ◽  
Muhammad Usman ◽  
Fazal Muhammad ◽  
Shams ur Rehman ◽  
Imran Khan ◽  
...  

High Blood Pressure (BP) is a vital factor in the development of cardiovascular diseases worldwide. For more than a decade now, patients search for quality and easy-to-read Online Health Information (OHI) for symptoms, preventions, therapy and other medical conditions. In this paper, we evaluate the quality and readability of OHI about high BP. In order that the first 20 clicks of three top-rated search engines have been used to collect the pertinent data. Using the exclusion criteria, 25 unique websites are selected for evaluation. The quality of all included links is evaluated through DISCERN checklist, a questionnaire for assessing the quality of written information for a health problem. To enhance the reliability of evaluation, all links are separately assessed by two different groups—a group of Health Professional (HPs) and a group of Lay Subjects (LS). A readability test is performed using Flesch-Kincaid tool. Fleiss’ kappa has been calculated before considering average value of each group. After evaluation, the average DISCERN value of HPs is 49.43 ± 14.0 (fair quality) while for LS, it is 48.7 ± 12.2; the mean Flesch-Reading Ease Score (FRES) is 58.5 ± 11.1, which is fairly difficult to read and the Average Grade Level (AGL) is 8.8 ± 1.9. None of the websites scored more than 73 (90%). In both groups, only 4 (16%) websites achieved DISCERN score over 80%. Mann-Whitney and Cronbach’s alpha have been computed to check the statistical significance of the difference between two groups and internal consistency of DISCERN checklist, respectively. Normality and homoscedasticity tests have been performed to check the distribution of scores of both evaluating groups. In both groups, information category websites achieved high DISCERN score but their readability level is worse. Highest scoring websites have clear aim, succinct source and high quality of information on treatment options. High BP is a pervasive disease, yet most of the websites did not produce precise or high-quality information on treatment options.


The Lancet ◽  
1999 ◽  
Vol 353 (9168) ◽  
pp. 1980-1981
Author(s):  
Marilynn Larkin

2016 ◽  
Vol 15 (3) ◽  
pp. e359 ◽  
Author(s):  
J. Brever ◽  
C. Rothbauer ◽  
B. Ludwig ◽  
B. Dotzler ◽  
C. Wolff ◽  
...  

2019 ◽  
Vol 64 (2) ◽  
pp. S42-S43
Author(s):  
Steffi Shilly ◽  
Jane Lindahl ◽  
Dava Szalda ◽  
Caren Steinway ◽  
Sophia Jan

2018 ◽  
Vol 22 (4) ◽  
pp. 313-322
Author(s):  
Islam I. Bedaiwi ◽  
Sukayna Z. Alfaraj ◽  
Jesse M. Pines

2019 ◽  
Author(s):  
Jingchun Fan ◽  
Jean Craig ◽  
Na Zhao ◽  
Fujian Song

BACKGROUND Increasingly people seek health information from the Internet, in particular, health information on diseases that require intensive self-management, such as diabetes. However, the Internet is largely unregulated and the quality of online health information may not be credible. OBJECTIVE To assess the quality of online information on diabetes identified from the Internet. METHODS We used the single term “diabetes” or equivalent Chinese characters to search Google and Baidu respectively. The first 50 websites retrieved from each of the two search engines were screened for eligibility using pre-determined inclusion and exclusion criteria. Included websites were assessed on four domains: accessibility, content coverage, validity and readability. RESULTS We included 26 websites from Google search engine and 34 from Baidu search engine. There were significant differences in website provider (P<0.0001), but not in targeted population (P=0.832) and publication types (P=0.378), between the two search engines. The website accessibility was not statistically significantly different between the two search engines, although there were significant differences in items regarding website content coverage. There was no statistically significant difference in website validity between the Google and Baidu search engines (mean Discern score 3.3 vs 2.9, p=0.156). The results to appraise readability for English website showed that that Flesch Reading Ease scores ranged from 23.1 to 73.0 and the mean score of Flesch-Kincaid Grade Level ranged range from 5.7 to 19.6. CONCLUSIONS The content coverage of the health information for patients with diabetes in English search engine tended to be more comprehensive than that from Chinese search engine. There was a lack of websites provided by health organisations in China. The quality of online health information for people with diabetes needs to be improved to bridge the knowledge gap between website service and public demand.


Sign in / Sign up

Export Citation Format

Share Document