scholarly journals Tools to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals: Systematic Review (Preprint)

2019 ◽  
Author(s):  
Gerlinde Lenaerts ◽  
Geertruida E Bekkering ◽  
Martine Goossens ◽  
Leen De Coninck ◽  
Nicolas Delvaux ◽  
...  

BACKGROUND User-friendly information at the point of care should be well structured, rapidly accessible, and comprehensive. Also, this information should be trustworthy, as it will be used by health care practitioners to practice evidence-based medicine. Therefore, a standard, validated tool to evaluate the trustworthiness of such point-of-care information resources is needed. OBJECTIVE This systematic review sought to search for tools to assess the trustworthiness of point-of-care resources and to describe and analyze the content of these tools. METHODS A systematic search was performed on three sources: (1) we searched online for initiatives that worked off of the trustworthiness of medical information; (2) we searched Medline (PubMed) until June 2019 for relevant literature; and (3) we scanned reference lists and lists of citing papers via Web of Science for each retrieved paper. We included all studies, reports, websites, or methodologies that reported on tools that assessed the trustworthiness of medical information for professionals. From the selected studies, we extracted information on the general characteristics of the tools. As no standard, risk-of-bias assessment instruments are available for these types of studies, we described how each tool was developed, including any assessments on reliability and validity. We analyzed the criteria used in the different tools and divided them into five categories: (1) author-related information; (2) evidence-based methodology; (3) website quality; (4) website design and usability; and (5) website interactivity. The percentage of tools in compliance with these categories and the different criteria were calculated. RESULTS Included in this review was a total of 17 tools, all published between 1997 and 2018. The tools were developed for different purposes, from a general quality assessment of medical information to very detailed analyses, all specifically for point-of-care resources. However, the development process of the tools was poorly described. Overall, seven tools had a scoring system implemented, two were assessed for reliability only, and two other tools were assessed for both validity and reliability. The content analysis showed that all the tools assessed criteria related to an evidence-based methodology: 82% of the tools assessed author-related information, 71% assessed criteria related to website quality, 71% assessed criteria related to website design and usability, and 47% of the tools assessed criteria related to website interactivity. There was significant variability in criteria used, as some were very detailed while others were more broadly defined. CONCLUSIONS The 17 included tools encompass a variety of items important for the assessment of the trustworthiness of point-of-care information. Overall, two tools were assessed for both reliability and validity, but they lacked some essential criteria for the assessment of the trustworthiness of medical information for use at the point-of-care. Currently, a standard, validated tool does not exist. The results of this review may contribute to the development of such an instrument, which may enhance the quality of point-of-care information in the long term.

10.2196/15415 ◽  
2020 ◽  
Vol 22 (1) ◽  
pp. e15415 ◽  
Author(s):  
Gerlinde Lenaerts ◽  
Geertruida E Bekkering ◽  
Martine Goossens ◽  
Leen De Coninck ◽  
Nicolas Delvaux ◽  
...  

Background User-friendly information at the point of care should be well structured, rapidly accessible, and comprehensive. Also, this information should be trustworthy, as it will be used by health care practitioners to practice evidence-based medicine. Therefore, a standard, validated tool to evaluate the trustworthiness of such point-of-care information resources is needed. Objective This systematic review sought to search for tools to assess the trustworthiness of point-of-care resources and to describe and analyze the content of these tools. Methods A systematic search was performed on three sources: (1) we searched online for initiatives that worked off of the trustworthiness of medical information; (2) we searched Medline (PubMed) until June 2019 for relevant literature; and (3) we scanned reference lists and lists of citing papers via Web of Science for each retrieved paper. We included all studies, reports, websites, or methodologies that reported on tools that assessed the trustworthiness of medical information for professionals. From the selected studies, we extracted information on the general characteristics of the tools. As no standard, risk-of-bias assessment instruments are available for these types of studies, we described how each tool was developed, including any assessments on reliability and validity. We analyzed the criteria used in the different tools and divided them into five categories: (1) author-related information; (2) evidence-based methodology; (3) website quality; (4) website design and usability; and (5) website interactivity. The percentage of tools in compliance with these categories and the different criteria were calculated. Results Included in this review was a total of 17 tools, all published between 1997 and 2018. The tools were developed for different purposes, from a general quality assessment of medical information to very detailed analyses, all specifically for point-of-care resources. However, the development process of the tools was poorly described. Overall, seven tools had a scoring system implemented, two were assessed for reliability only, and two other tools were assessed for both validity and reliability. The content analysis showed that all the tools assessed criteria related to an evidence-based methodology: 82% of the tools assessed author-related information, 71% assessed criteria related to website quality, 71% assessed criteria related to website design and usability, and 47% of the tools assessed criteria related to website interactivity. There was significant variability in criteria used, as some were very detailed while others were more broadly defined. Conclusions The 17 included tools encompass a variety of items important for the assessment of the trustworthiness of point-of-care information. Overall, two tools were assessed for both reliability and validity, but they lacked some essential criteria for the assessment of the trustworthiness of medical information for use at the point-of-care. Currently, a standard, validated tool does not exist. The results of this review may contribute to the development of such an instrument, which may enhance the quality of point-of-care information in the long term. Trial Registration PROSPERO CRD42019122565; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=122565


2021 ◽  
Author(s):  
Gerlinde Lenaerts ◽  
Geertruida E Bekkering ◽  
Martine Goossens ◽  
Leen De Coninck ◽  
Nicolas Delvaux ◽  
...  

BACKGROUND User-friendly information at the point of care for health care professionals should be well structured, rapidly accessible, comprehensive, and trustworthy. The reliability of information and the associated methodological process must be clear. There is no standard tool to evaluate the trustworthiness of such point-of-care (POC) information. OBJECTIVE We aim to develop and validate a new tool for assessment of trustworthiness of evidence-based POC resources to enhance the quality of POC resources and facilitate evidence-based practice. METHODS We designed the Critical Appraisal of Point-of-Care Information (CAPOCI) tool based on the criteria important for assessment of trustworthiness of POC information, reported in a previously published review. A group of health care professionals and methodologists (the authors of this paper) defined criteria for the CAPOCI tool in an iterative process of discussion and pilot testing until consensus was reached. In the next step, all criteria were subject to content validation with a Delphi study. We invited an international panel of 10 experts to rate their agreement with the relevance and wording of the criteria and to give feedback. Consensus was reached when 70% of the experts agreed. When no consensus was reached, we reformulated the criteria based on the experts’ comments for a next round of the Delphi study. This process was repeated until consensus was reached for each criterion. In a last step, the interrater reliability of the CAPOCI tool was calculated with a 2-tailed Kendall tau correlation coefficient to quantify the agreement between 2 users who piloted the CAPOCI tool on 5 POC resources. Two scoring systems were tested: a 3-point ordinal scale and a 7-point Likert scale. RESULTS After validation, the CAPOCI tool was designed with 11 criteria that focused on methodological quality and author-related information. The criteria assess authorship, literature search, use of preappraised evidence, critical appraisal of evidence, expert opinions, peer review, timeliness and updating, conflict of interest, and commercial support. Interrater agreement showed substantial agreement between 2 users for scoring with the 3-point ordinal scale (τ=.621, <i>P</i>&lt;.01) and scoring with the 7-point Likert scale (τ=.677, <i>P</i>&lt;.01). CONCLUSIONS The CAPOCI tool may support validation teams in the assessment of trustworthiness of POC resources. It may also provide guidance for producers of POC resources.


Author(s):  
Elvira Ortiz-Sánchez ◽  
Almudena Velando-Soriano ◽  
Laura Pradas-Hernández ◽  
Keyla Vargas-Román ◽  
Jose L. Gómez-Urquiza ◽  
...  

The aim of this study was to analyze social networks’ information about the anti-vaccine movement. A systematic review was performed in PubMed, Scopus, CINAHL and CUIDEN databases. The search equations were: “vaccine AND social network” and “vaccine AND (Facebook[title] OR Twitter[title] OR Instagram[title] OR YouTube[title])”. The final sample was n = 12, including only articles published in the last 10 years, in English or Spanish. Social networks are used by the anti-vaccine groups to disseminate their information. To do this, these groups use different methods, including bots and trolls that generate anti-vaccination messages and spread quickly. In addition, the arguments that they use focus on possible harmful effects and the distrust of pharmaceuticals, promoting the use of social networks as a resource for finding health-related information. The anti-vaccine groups are able to use social networks and their resources to increase their number and do so through controversial arguments, such as the economic benefit of pharmaceuticals or personal stories of children to move the population without using reliable or evidence-based content.


Author(s):  
Samuel O Bolarinde ◽  

Background of the study: Smartphones medically related applications are quickly becoming one of the main tools for accessing clinical information among health care professionals. Aim of Study: This study assessed the perception of patients on usage of smartphones by health care professionals during clinic hours. Methodology: The study recruited 185 patients. Data on demographic characteristics and perception of patients on the use of smartphones for medical information were obtained using a self-administered questionnaire. Data were summarized using a descriptive statistics and inferential statistics of Chi square. Alpha level was set at 0.005 Results: 76 Males, 109 Females participated in this study. 67.6% (125) own a smartphones. 34.6% (64) have seen health care professionals using smartphones during clinic hours, 28.1% (18) had their health care providers explain to them reasons for using smartphone. 34.1% (63) agreed it was unprofessional for health care provider to use smartphone during clinic, 33.5% (62) disagreed, 32.4% (60) were undecided. No association observed between respondents’ age (χ2= 12.00, p= 0.606), educational qualification (χ2= 8.501, p= 0.075) and responses to the statement that use of smartphones by health care professional was unprofessional. Conclusion: Although one third of the respondents agreed that usage of smartphones by healthcare professionals in the clinic while attending to patients was unprofessional however, usage of smartphone for health related information by health care professionals during clinic hours should be with caution to avoid losing the confidence repose in them by their patients.


10.2196/17621 ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. e17621
Author(s):  
Henk Verloo ◽  
Pauline Melly ◽  
Roger Hilfiker ◽  
Filipa Pereira

Background The implementation of evidence-based practice (EBP) in daily health care practice is strongly encouraged; it is widely recognized as a means to improve the quality and safety of health care for patients and reduce avoidable costs. Primary care nurses and physiotherapists face numerous challenges in trying to ensure that they deliver effective daily care. Broadly promoted educational interventions aim to increase the integration and implementation of EBP in their daily practice. Objective This systematic review will retrieve and evaluate publications examining the effectiveness of educational interventions to increase the integration and implementation of EBP among nurses, nurse practitioners, and physiotherapists active in primary care. Methods We will conduct a systematic review of published articles in relevant professional, scientific journals (from their start dates) and in the following electronic databases, from inception until October 31, 2020: Medline Ovid SP (from 1946), PubMed (NOT Medline[sb]; from 1996), Embase.com (from 1947), CINAHL Ebesco (from 1937), the Cochrane Central Register of Controlled Trials Wiley (from 1992), PsycINFO Ovid SP (from 1806), Web of Science Core collection (from 1900), PEDro (from 1999), the JBI Database of Systematic Reviews and Implementation Reports (from 1998), and the Trip Database (from 1997). We will use the predefined search terms of “evidence-based practice,” “nurses,” or “physiotherapists” and combinations with other terms, such as “educational interventions.” We will also conduct a hand search of the bibliographies of all the relevant articles and a search for unpublished studies using Google Scholar, the ProQuest Dissertations and Theses dissemination, Mednar, WorldCat, OpenGrey, and Grey Literature Report. We will consider publications in English, French, German, and Portuguese. Results The electronic database searches were completed in October 2020. Retrieved articles are currently being screened, and the entire study is expected to be completed by March 2021. Conclusions This systematic review will provide specific knowledge about the effectiveness of educational interventions to increase the implementation and integration of EBP in the daily practice of nurses and physiotherapists providing primary care services. Its findings will inform us about the types and frequencies of the most successful educational interventions. Trial Registration PROSPERO International Prospective Register of Systematic Reviews CRD42017077309; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=77309 International Registered Report Identifier (IRRID) DERR1-10.2196/17621


2016 ◽  
Author(s):  
Rahila Iftikhar ◽  
Bahaa Abaalkhail

BACKGROUND Major social networking platforms, such as Facebook, WhatsApp, and Twitter, have become popular means through which people share health-related information, irrespective of whether messages disseminated through these channels are authentic. OBJECTIVE This study aims to describe the demographic characteristics of patients that may demonstrate their attitudes toward medical information shared on social media networks. Second, we address how information found through social media affects the way people deal with their health. Third, we examine whether patients initiate or alter/discontinue their medications based on information derived from social media. METHODS We conducted a cross-sectional survey between April and June 2015 on patients attending outpatient clinics at King Abdulaziz University, Jeddah, Saudi Arabia. Patients who used social media (Facebook, WhatsApp, and Twitter) were included. We designed a questionnaire with closed-ended and multiple-choice questions to assess the type of social media platforms patients used and whether information received on these platforms influenced their health care decisions. We used chi-square test to establish the relationship between categorical variables. RESULTS Of the 442 patients who filled in the questionnaires, 401 used Facebook, WhatsApp, or Twitter. The majority of respondents (89.8%, 397/442) used WhatsApp, followed by Facebook (58.6%, 259/442) and Twitter (42.3%, 187/442). In most cases, respondents received health-related messages from WhatsApp and approximately 42.6% (171/401) reported ever stopping treatment as advised on a social media platform. A significantly higher proportion of patients without heart disease (P=.001) and obese persons (P=.01) checked the authenticity of information received on social media. Social media messages influenced decision making among patients without heart disease (P=.04). Respondents without heart disease (P=.001) and obese persons (P=.01) were more likely to discuss health-related information received on social media channels with a health care professional. A significant proportion of WhatsApp users reported that health-related information received on this platform influenced decisions regarding their family’s health care (P=.001). Respondents’ decisions regarding family health care were more likely to be influenced when they used two or all three types of platforms (P=.003). CONCLUSIONS Health education in the digital era needs to be accurate, evidence-based, and regulated. As technologies continue to evolve, we must be equipped to face the challenges it brings with it.


2011 ◽  
pp. 2134-2142
Author(s):  
Abrams A. O’Byuonge ◽  
Leida Chen

The increasing use of the Internet by consumers gave rise to an information boom to health-care consumers. Not only could the Internet be used as a communication tool to provide information that would allow patients to make informed decisions, but it could also be used to generate revenue for investors. The dot-com boom of the late 1990s exploited this opportunity, targeting the health-care system, a $1.7 trillion market in the United States alone. Overall, the health-care system is wasteful and costly (Itagaki, Berlin, & Schatz, 2002), and as a result, health-care IT was touted as the magic pill for cutting costs. The Internet boom of the late 1990s saw the emergence of e-health: the delivery of health services and health information through the Internet and Internet-related technologies (Eysenbach, 2001). Leading the many entrepreneurs and venture capitalists who stepped in to seize a piece of the health-care industry cake were WebMD Corp., an online provider of medical information for doctors and consumers in Elmwood Park, New Jersey, and DrKoop.com, an Austin, Texas-born company that later moved to Santa Monica, California, and began doing business as Dr. Koop LifeCare Corp. Dr. C. Everett Koop, the former U.S. surgeon general, had spent over 6 decades in the medical profession. He envisioned the Internet as an opportunity to change the health-care delivery system in order to empower individuals to take charge of their own health care (Musselwhite, 2002). With this vision and his reputation as an advocate for health-care reform, along with the help of two budding entrepreneurs, Don Hackett and John Zacarro, the trio opened a business-to-consumer Internet portal: DrKoop.com. The portal was designed to provide health information to consumers in areas such as chronic illness, food and nutrition, fitness, and medical breakthroughs. At the beginning, the Web site was an overwhelming success, receiving a million hits per month after 2 years of operation, and about 4 million unique visitors per month at its peak. The portal included a personal medical-records system that facilitated the cross-referencing of medications for interactions, as well as the storage of medical reports that could then be accessed by both patients and physicians. DrKoop.com’s public woes began in February 2000 when its auditor, PricewaterhouseCoopers, issued a “going concern qualification,” an ominous warning that highlighted the precarious financial situation the Internet-based health service was in Cleary (2000). By the end of 2000, DrKoop.com was still struggling, and in the first 9 months of 2001 alone, the company’s losses were nearly 3 times its revenue. According to the Securities and Exchange Commision (SEC) filings, from January 1999 until the service’s liquidation in September 2001, DrKoop.com’s losses stood at $193.6 million, dwarfing the $41 million revenue generated during the period. At the site’s peak in July 1999, DrKoop.com’s stock rose to $45.75 per share on the NASDAQ, but was worth $0.12 at the time of bankruptcy filing. In July 2002, Vitacost.com, a privately held online seller of nutritional supplements, paid a paltry $186,000 in cash for DrKoop.com’s assets, which included the brand name, trademarks, domain names, the Web site, and the e-mail addresses of its registered users. WebMD, originally called Healtheon/WebMD, was founded by Jim Clark, who also founded Silicon Graphics and Netscape. Clark’s vision was to connect insurance companies, doctors, and patients over the Internet in order to lower costs and reduce paper trails. Rather than building its own products and services, Healtheon used its highly valued stock to finance acquisitions of leading companies in the industries it targeted. In 1999, it acquired WebMD.com and OnHealth, both leading health portals, giving it access to the consumer health market (Salkever, 2000). Though WebMD lost $6.5 billion on revenue of $530.2 million in the first 9 months of 2001, it still continued to expand long after DrKoop.com had dropped off the radar screen. For the fiscal year ending in December 2003, WebMD reported revenues of $964 million, an increase of 10.6% on the previous year’s revenues, which totaled $871.7 million. Of the 11 health-care mergers and acquisition deals in the first 7 months of 2004, valued at $900 million, WebMD was the leading acquirer (Abrams, 2004). Two of WebMD’s high-profile acquisitions in 2004 were the $160 million cash purchase of ViPS, a privately held provider in Baltimore, Maryland, of information technology to the government, Blue Cross-Blue Shield, and other health-care insurers; and the $40 million acquisition of Dakota Imaging Inc., a private company in Columbia, Maryland, that offered automated health-care claims processing technology. As industry leaders, WebMD and DrKoop.com faced competition from both health-care information portals (such as HealthGrades.com, MDConsult, ZoeMed.com) and online pharmacies that provided consumers with one-stop shopping for medications and medical information (Walgreens.com, drugstore.com, Webvan.com). The threat from the health-care information portals, nevertheless, was minimal due to their limited brand recognition and information coverage. In the online pharmacy sector, however, Walgreens.com gained a substantial market share by combining the best of both worlds: complementing its physical stores located throughout the country by offering online customer service, convenience, and real-time access to a health library that provided comprehensive information on prescription drugs, insurance, and health issues.


2021 ◽  
Author(s):  
◽  
Fiona Grattan

<p>Often a patient’s first contact with their health service is through a medical receptionist. Literature has framed medical receptionists as gate-keepers, and few studies have examined what they actually do when they answer incoming calls by studying recordings of them. The current thesis asks how receptionists managed calls to Mauri Ora, a student health service, to deliver what the callers were asking for. The findings present evidence that receptionists are skilled and supportive in their interactions with patients.  Following discursive psychology and conversation analysis as theoretical and methodological frameworks this thesis examined naturally occurring social interactions to discover how joint understanding and coordinated action was accomplished. Eighteen (N=18) calls between receptionists and patients were recorded, transcribed and examined in detail for what happened in each call and how receptionists worked to deliver what the callers were asking for.  Callers ring with a broad range of different problems. The analysis documents how receptionists showed that they understood what callers wanted, and the ways they worked to progress solutions. The examination of requests for doctors’ appointments were of particular interest because of their very limited availability and the triage process for getting one. By establishing with the caller the conditions under which they could see a doctor, including if it was an urgent problem, receptionists opened the door to the health care being sought. A difficult matter for receptionists is asking for and responding to health-related information because they have no medical training. An additional aspect of the analysis demonstrated that receptionists only asked for medical information as a record for triage referral, and when it had not previously been disclosed.  Far from casting medical receptionists as gate-keepers withholding help, the current thesis demonstrates their orientation towards granting the requests of callers and doing what they can to facilitate access to health care. Practical applications for the training and practice of medical receptionists are considered as well as future research, and the ethical constraints of this kind of work.</p>


Sign in / Sign up

Export Citation Format

Share Document