scholarly journals Developing a Quality Benchmark for Determining the Credibility of Web Health Information- a Protocol of a Gold Standard Approach

2021 ◽  
Vol 3 ◽  
Author(s):  
Lubna Daraz ◽  
Sheila Bouseh

Background: The current pandemic of COVID-19 has changed the way health information is distributed through online platforms. These platforms have played a significant role in informing patients and the public with knowledge that has changed the virtual world forever. Simultaneously, there are growing concerns that much of the information is not credible, impacting patient health outcomes, causing human lives, and tremendous resource waste. With the increasing use of online platforms, patients/the public require new learning models and sharing medical knowledge. They need to be empowered with strategies to navigate disinformation on online platforms.Methods and Design: To meet the urgent need to combat health “misinformation,” the research team proposes a structured approach to develop a quality benchmark, an evidence-based tool that identifies and addresses the determinants of online health information reliability. The specific methods to develop the intervention are the following: (1) systematic reviews: two comprehensive systematic reviews to understand the current state of the quality of online health information and to identify research gaps, (2) content analysis: develop a conceptual framework based on established and complementary knowledge translation approaches for analyzing the existing quality assessment tools and draft a unique set of quality of domains, (3) focus groups: multiple focus groups with diverse patients/the public and health information providers to test the acceptability and usability of the quality domains, (4) development and evaluation: a unique set of determinants of reliability will be finalized along with a preferred scoring classification. These items will be used to develop and validate a quality benchmark to assess the quality of online health information.Expected Outcomes: This multi-phase project informed by theory will lead to new knowledge that is intended to inform the development of a patient-friendly quality benchmark. This benchmark will inform best practices and policies in disseminating reliable web health information, thus reducing disparities in access to health knowledge and combat misinformation online. In addition, we envision the final product can be used as a gold standard for developing similar interventions for specific groups of patients or populations.

2017 ◽  
Author(s):  
Maureen Dobbins ◽  
Susannah Watson ◽  
Kristin Read ◽  
Kelly Graham ◽  
Reza Yousefi Nooraie ◽  
...  

Author(s):  
Beniamino Schiavone ◽  
Andrea Vitale ◽  
Mena Gallo ◽  
Gianlucasalvatore Russo ◽  
Domenico Ponticelli ◽  
...  

Background: Facebook is the most popular social network across the world and also allows users access to health information. Our study presents an overview of the official Facebook profiles of hospitals in Italy (n = 1351) and how much they are used. Methods: All hospitals were surveyed on the number of Facebook posts in May (post-lockdown) and October (second pandemic wave) 2020. The number of followers, the creation date of the official page, and the frequency of publication—that is, the average number of days between two subsequent posts—were determined. Results: In Italy, only 28% (n = 379) of the hospitals had official Facebook pages, of which 20.6% (n = 78) were public hospitals, and 79.4% (n = 301) were private hospitals. Of the hospitals with Facebook pages, 49.1% used them every week, and public hospitals published more often. Conclusions: Despite the differences between regions and types of management, the number of hospitals in Italy that use Facebook as a tool for the public dissemination of health information is still low. Hospitals should adopt an effective communication strategy using social networks to improve the quality of health care.


2021 ◽  
Author(s):  
Anagha Kulkarni ◽  
Mike Wong ◽  
Tejasvi Belsare ◽  
Risha Shah ◽  
Diana Yu Yu ◽  
...  

BACKGROUND The Internet has become a major source of health information especially for adolescents and young adults. Unfortunately, inaccurate, incomplete or outdated health information is widespread online. Often adolescents and young adults turn to authoritative websites such as the student health center (SHC) website of the university they are attending to obtain reliable health information. Although most on-campus SHC clinics comply with the American College Health Association (ACHA) standards, their websites are not subject to any standards or code of conduct. In the absence of quality standards or guidelines, the monitoring and compliance processes do not exist for SHC websites either. As such, there is no oversight on the health information published on the SHC websites by any central governing body. OBJECTIVE Our objective is to enable researchers to monitor online information quality at scale. We have created a tool that can efficiently quantify the quality of information posted on SHC websites about a health topic. Specifically, this quantitative tool provides information on quality, such as reading ease, coverage of the topic, and the degree of fact-based objective information. METHODS Our cross-functional team has designed and developed an open-source software, QMOHI: Quantitative Measures of Online Health Information, using the Agile software development methodology. The QMOHI tool finds the SHC website and gathers information on the specific health topic of interest from a prespecified list of university websites. Based on the retrieved text, the tool computes eight different quality metrics. The QMOHI tool is a fully automated tool that is designed to be scalable, generalizable, and robust. RESULTS The first empirical evaluation shows that the QMOHI tool is highly scalable and substantially more efficient than the manual approach of assessing online information quality. The second experimental results demonstrate QMOHI’s ability to work effectively with starkly different health topics (COVID, Cancer, LARC, and Condom) and with narrowly focused topics (hormonal IUD and copper IUD); thereby establishing the generalizability and versatility of the tool. The results from the last experiment demonstrate that QMOHI is not vulnerable to typical structural changes that SHC websites may undergo (e.g. URL changes) over a long period of time. QMOHI is able to support longitudinal studies by being robust to such website changes. CONCLUSIONS QMOHI allows public health researchers and practitioners to conduct large-scale studies of SHC websites that were previously too time intensive. The capability to generalize broadly or focus narrowly allows for wide applications of QMOHI, equipping researchers to study both mainstream and underexplored health topics. QMOHI’s ability to robustly analyze SHC websites periodically facilitates longitudinal investigations and monitor SHC progress. QMOHI serves as a launching pad for our future work that aims to develop a broadly applicable public health tool for online health information studies with potential applications far beyond SHC websites.


2021 ◽  
Vol 8 (1) ◽  
pp. 1
Author(s):  
Leela Raj ◽  
Denise Smith ◽  
James Heilman

Background Wikipedia is frequently used as a source of health information. However, the quality of its content varies widely across articles. The DISCERN tool is a brief questionnaire developed in 1996 by the Division of Public Health and Primary Health Care of the Institute of Health Sciences of the University of Oxford. They claim it provides users with a valid and reliable way of assessing the quality of written information. However, the DISCERN instrument’s reliability in measuring the quality of online health information, particularly whether or not its scores are affected by reader biases about specific publication sources, has not yet been explored. Methods This study is a double-blind randomized assessment of a Wikipedia article versus a BMJ literature review using a modified version of the DISCERN tool. Participants will include physicians and medical residents from four university campuses in Ontario and British Columbia and will be randomized into one of four study arms. Inferential statistics tests (paired t-test, multi-level ordinal regression, and one-way ANOVA) will be conducted with the data collected from the study. Outcomes The primary outcome of this study will be to determine whether a statistically significant difference in DISCERN scores exists, which could suggest whether or not how health information is packaged influences how it is assessed for quality. Plain Language Summary The internet, and in particular Wikipedia, is an important way for professionals, students and the public to obtain health information. For this reason, the DISCERN tool was developed in 1996 to help users assess the quality of the health information they find. The ability of DISCERN to measure the quality of online health information has been supported with research, but the role of bias has not necessarily been accounted for. Does how the information is packaged influence how the information itself is evaluated? This study will compare the scores assigned to articles in their original format to the same articles in a modified format in order to determine whether the DISCERN tool is able to overcome bias. A significant difference in ratings between original and inverted articles will suggest that the DISCERN tool lacks the ability to overcome bias related to how health information is packaged.


2019 ◽  
Author(s):  
Anat Gesser-Edelsburg ◽  
Nour Abed Elhadi Shahbari ◽  
Ricky Cohen ◽  
Adva Mir Halavi ◽  
Rana Hijazi ◽  
...  

BACKGROUND In the new media age, the public searches for information both online and offline. Many studies have examined how the public reads and understands this information but very few investigate how people assess the quality of journalistic articles as opposed to information generated by health professionals. OBJECTIVE The aim of this study was to examine how public health care workers (HCWs) and the general public seek, read, and understand health information and to investigate the criteria by which they assess the quality of journalistic articles. METHODS A Web-based nonprobability sampling questionnaire survey was distributed to Israeli HCWs and members of the public via 3 social media outlets: Facebook, WhatsApp, and Instagram. A total of 979 respondents participated in the online survey via the Qualtrics XM platform. RESULTS The findings indicate that HCWs find academic articles more reliable than do members of the general public (44.4% and 28.4%, respectively, P<.001). Within each group, we found disparities between the places where people search for information and the sources they consider reliable. HCWs consider academic articles to be the most reliable, yet these are not their main information sources. In addition, HCWs often use social networks to search for information (18.2%, P<.001), despite considering them very unreliable (only 2.2% found them reliable, P<.001). The same paradoxes were found among the general public, where 37.5% (P<.001) seek information via social networks yet only 8.4% (P<.001) find them reliable. Out of 6 quality criteria, 4 were important both to HCWs and to the general public. CONCLUSIONS In the new media age where information is accessible to all, the quality of articles about health is of critical importance. It is important that the criteria examined in this research become the norm in health writing for all stakeholders who write about health, whether they are professional journalists or citizen journalists writing in the new media.


2021 ◽  
Author(s):  
Yijing Chen ◽  
Hanming Lin ◽  
Jin Zhang ◽  
Yiming Zhao

BACKGROUND Online health information retrieval has been a top choice for acquiring health information and knowledge by millions worldwide. OBJECTIVE This study aims to investigate consumers’ modification of retrieval platform switch paths across health-related search tasks and learning via such a change. METHODS A lab user experiment was designed to obtain data on consumers’ health information search behavior. Participants accomplished health-related information search tasks. Screen movements were recorded by EV screen-recording software. The participants underwent in-depth interviews immediately after finishing the tasks. Screen recordings and interview data were both coded and analyzed. RESULTS Three types of learning, including the similar transfer learning, optimizing learning, and SERP-guided learning were identified based on five change patterns of retrieval platform switch paths adopted by health information consumers from task 1 to task 2. Health information consumers’ retrieval platform switch based on information usefulness evaluation. And they accessed different amounts and types of health knowledge from different retrieval platforms. CONCLUSIONS The results suggest that health information consumers exhibit learning both through retrieval platform switching and the knowledge they consume during the search process. This facilitates the assessment of a certain retrieval platform’s usefulness by measuring the amount and types of health knowledge in each search result. This study also contributes to the enhancement of consumers’ health information retrieval abilities, and to helping optimize health information retrieval platforms by increasing their exposure to consumers and increasing the matching degree between knowledge types and consumer needs.


Author(s):  
Elmer V. Bernstam ◽  
Funda Meric-Bernstam

This chapter discusses the problem of how to evaluate online health information. The quality and accuracy of online health information is an area of increasing concern for healthcare professionals and the general public. We define relevant concepts including quality, accuracy, utility, and popularity. Most users access online health information via general-purpose search engines, therefore we briefly review Web search-engine fundamentals. We discuss desirable characteristics for quality-assessment tools and the available evidence regarding their effectiveness and usability. We conclude with advice for healthcare consumers as they search for health information online.


Author(s):  
Izabella Lejbkowicz

The exponential development of Information Technologies revolutionized healthcare. A significant aspect of this revolution is the access to health information in the Internet. The Internet World Stats estimates that 56.8% of the world population used the Internet in March 2019, an increase of 1,066% from 2000. According to The Pew Research Center survey of 2012 81% of Americans used the internet and 72% of them searched for health information. Even though there is a lack in more recent data on the percentage of online health information seekers, it is clear that this trend is on the rise. This chapter focuses on the characteristics of the search for online health information by patients and providers, investigates features related to the quality of health web sites, and discusses the impact of these searches on healthcare.


2019 ◽  
Vol 18 ◽  
pp. 153473541989002 ◽  
Author(s):  
Seong Min Lee ◽  
Ho Cheol Choi ◽  
Min Kyung Hyun

Introduction: This article critically examines the systematic reviews (SR) and meta-analysis (MA) of complementary therapies for cancer patients to appraise the evidence level, and offers suggestions for future research and practice. Methods: The Cochrane Library and MEDLINE were searched from their inception to January 2018, to identify SR and MA of complementary therapies available for cancer patients. Final selected SR and MA were methodologically evaluated for their quality by applying the Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR2) instrument. Data extraction and risk of quality assessments were performed by 2 independent reviewers. Results: A total of 104 studies were included in the analysis. The majority of the individual clinical trials included in the SR and MA were performed in China (48%) and the United States (26.9%). Breast cancer was the most studied cancer type (25%), and acupuncture was the most studied intervention (21%). Side effects of cancer such as pain, depression, and fatigue were effectively managed with complementary therapies. The methodologically problematic items included not listing the excluded studies and lack of protocol or protocol registration. Conclusions: With increasing interest in research, complementary therapies appear to be beneficial in reducing side effects and raising the quality of life of cancer patients. Complementary therapies have generally been studied for all cancers, with acupuncture being the most researched, regardless of the cancer type. Since AMSTAR2 is a stricter assessment tool than before, future studies need to consider the risk of methodological bias with caution and discuss appropriate overall quality assessment tools.


Sign in / Sign up

Export Citation Format

Share Document