scholarly journals Readability of Online Materials Related to Vocal Cord Leukoplakia

OTO Open ◽  
2021 ◽  
Vol 5 (3) ◽  
pp. 2473974X2110326
Author(s):  
Matthew Shneyderman ◽  
Grace E. Snow ◽  
Ruth Davis ◽  
Simon Best ◽  
Lee M. Akst
Keyword(s):  
Patient Education ◽  
Vocal Cord ◽  
Grade Level ◽  
Assessment Tool ◽  
Medical Center ◽  
Academic Medical Center ◽  
Entire Cohort ◽  
Flesch Reading Ease ◽  
Ease Score ◽  
Google Search

Objectives To assess readability and understandability of online materials for vocal cord leukoplakia. Study Design Review of online materials. Setting Academic medical center. Methods A Google search of “vocal cord leukoplakia” was performed, and the first 50 websites were considered for analysis. Readability was measured by the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Simple Measure of Gobbledygook (SMOG). Understandability and actionability were assessed by 2 independent reviewers with the PEMAT-P (Patient Education Materials Assessment Tool for Printable Materials). Unpaired t tests compared scores between sites aimed at physicians and those at patients, and a Cohen’s kappa was calculated to measure interrater reliability. Results Twenty-two websites (17 patient oriented, 5 physician oriented) met inclusion criteria. For the entire cohort, FRES, FKGL, and SMOG scores (mean ± SD) were 36.90 ± 20.65, 12.96 ± 3.28, and 15.65 ± 3.57, respectively, indicating that materials were difficult to read at a >12th-grade level. PEMAT-P understandability and actionability scores were 73.65% ± 7.05% and 13.63% ± 22.47%. Statistically, patient-oriented sites were more easily read than physician-oriented sites ( P < .02 for each of the FRES, FKGL, and SMOG comparisons); there were no differences in understandability or actionability scores between these categories of sites. Conclusion Online materials for vocal cord leukoplakia are written at a level more advanced than what is recommended for patient education materials. Awareness of the current ways that these online materials are failing our patients may lead to improved education materials in the future.

Critical Quality and Readability Analysis of Online Patient Education Materials on Parotidectomy: A Cross-Sectional Study

2022 ◽  
pp. 000348942110666
Author(s):  
Elysia Miriam Grose ◽  
Emily YiQin Cheng ◽  
Marc Levin ◽  
Justine Philteos ◽  
Jong Wook Lee ◽  
...  
Keyword(s):  
Patient Education ◽  
Grade Level ◽  
Critical Role ◽  
Cross Sectional Study ◽  
Online Information ◽  
Cross Sectional ◽  
Flesch Reading Ease ◽  
Ease Score ◽  
Google Search ◽  
Online Patient Education

Purpose: Complications related to parotidectomy can cause significant morbidity, and thus, the decision to pursue this surgery needs to be well-informed. Given that information available online plays a critical role in patient education, this study aimed to evaluate the readability and quality of online patient education materials (PEMs) regarding parotidectomy. Methods: A Google search was performed using the term “parotidectomy” and the first 10 pages of the search were analyzed. Quality and reliability of the online information was assessed using the DISCERN instrument. Flesch-Kincaid Grade Level (FKGL) and Flesch-Reading Ease Score (FRE) were used to evaluate readability. Results: Thirty-five PEMs met the inclusion criteria. The average FRE score was 59.3 and 16 (46%) of the online PEMs had FRE scores below 60 indicating that they were fairly difficult to very difficult to read. The average grade level of the PEMs was above the eighth grade when evaluated with the FKGL. The average DISCERN score was 41.7, which is indicative of fair quality. There were no significant differences between PEMs originating from medical institutions and PEMs originating from other sources in terms of quality or readability. Conclusion: Online PEMs on parotidectomy may not be comprehensible to the average individual. This study highlights the need for the development of more appropriate PEMs to inform patients about parotidectomy.

scholarly journals Quality Assessment of Online Patient Information for Cosmetic Botulinum Toxin

2020 ◽  
Vol 40 (11) ◽  
pp. NP636-NP642 ◽  
Author(s):  
Eric Barbarite ◽  
David Shaye ◽  
Samuel Oyer ◽  
Linda N Lee
Keyword(s):  
Botulinum Toxin ◽  
Patient Education ◽  
Online Education ◽  
Grade Level ◽  
Assessment Tool ◽  
Botulinum Toxin Injection ◽  
Reading Level ◽  
Accuracy Score ◽  
Flesch Reading Ease

Abstract Background In an era of widespread Internet access, patients increasingly look online for health information. Given the frequency with which cosmetic botulinum toxin injection is performed, there is a need to provide patients with high-quality information about this procedure. Objectives The aim of this study was to examine the quality of printed online education materials (POEMs) about cosmetic botulinum toxin. Methods An Internet search was performed to identify 32 websites of various authorship types. Materials were evaluated for accuracy and inclusion of key content points. Readability was measured by Flesch Reading Ease and Flesch-Kincaid Grade Level. Understandability and actionability were assessed with the Patient Education Materials Assessment Tool for Printed Materials. The effect of authorship was measured by undertaking analysis of variance between groups. Results The mean [standard deviation] accuracy score among all POEMs was 4.2 [0.7], which represents an accuracy of 76% to 99%. Mean comprehensiveness was 47.0% [16.4%]. Mean Flesch-Kincaid Grade Level and Flesch Reading Ease scores were 10.7 [2.1] and 47.9 [10.0], respectively. Mean understandability and actionability were 62.8% [18.8%] and 36.2% [26.5%], respectively. There were no significant differences between accuracy (P &gt; 0.2), comprehensiveness (P &gt; 0.5), readability (P &gt; 0.1), understandability (P &gt; 0.3), or actionability (P &gt; 0.2) by authorship. Conclusions There is wide variability in the quality of cosmetic botulinum toxin POEMs regardless of authorship type. The majority of materials are written above the recommended reading level and fail to include important content points. It is critical that providers take an active role in the evaluation and endorsement of online patient education materials.

scholarly journals P126 An analysis of the quality and readability of online information for osteoarthritis

Rheumatology ◽  
2020 ◽  
Vol 59 (Supplement_2) ◽  
Author(s):  
Kieran Murray ◽  
Timothy Murray ◽  
Candice Low ◽  
Anna O'Rourke ◽  
Douglas J Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Scoring Systems ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

Abstract Background Osteoarthritis is the most common cause of disability in people over 65 years old. The readability of of online osteoarthritis information has never been assessed. A 2003 study found the quality of online osteoarthritis information to be poor. This study reviews the quality of online information regarding osteoarthritis in 2018 using three validated scoring systems. Readability is reviewed for the first time, again using three validated tools. Methods The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analysed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons) and non-text pages were excluded. Readability was measured using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL) and Gunning-Fog Index (GFI). Website quality was scored using the the Journal of the American Medical Association (JAMA) benchmark criteria and DISCERN criteria. Presence or absence of HONcode certification, age of content, content producer and author characteristics were noted. Results 37 unique websites were suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7- 8th grade level. One (2.7%) website met all four JAMA Criteria. Mean DISCERN quality of information for OA websites was “fair”, comparing favourably with the “poor” grading of a 2003 study. HONCode endorsed websites (43.2%) were of a statistically significantly higher quality. Conclusion Quality of online health information for OA is “fair”. 2.7% of websites met JAMA benchmark criteria for quality. Readability was equal to or more difficult than recommendations. HONcode certification was indicative of higher quality, but not readability. Disclosures K. Murray None. T. Murray None. C. Low None. A. O'Rourke None. D.J. Veale None.

scholarly journals An Analysis of the Readability of Educational Materials on the Consumer Webpage of a Health Professional Organization: Considerations for Practice

2011 ◽  
Author(s):  
Naudia Falconer ◽  
E. Reicherter ◽  
Barbara Billek-Sawhney ◽  
Steven Chesbro
Keyword(s):  
Patient Education ◽  
Health Professional ◽  
Grade Level ◽  
Sixth Grade ◽  
Reading Level ◽  
Professional Organization ◽  
Flesch Reading Ease ◽  
Ease Score ◽  
Site Evaluation ◽  
American Physical

The readability level of many patient education materials is too high for patients to comprehend, placing the patient’s health at risk. Since health professionals often recommend Internet-based patient education resources, they must ensure that the readability of information provided to consumers is at an appropriate level. Purpose: The purpose of this study was to determine the readability of educational brochures found on the American Physical Therapy Association (APTA) consumer website. Methods: Fourteen educational brochures on the APTA website in March 2008 were analyzed using the following assessments: Flesch-Kincaid Grade Level, Flesch Reading Ease, Fry Readability Formula, Simple Measure of Gobbledygook (SMOG), Checklist for Patient Education Materials, and Consumer Health Web Site Evaluation Checklist. Results: According to the Flesch-Kincaid and Flesch Reading Ease, over 90% of the brochures were written at greater than a sixth grade level. The mean reading level was grade 10.2 (range = 3.1 to 12) with a Reading Ease score between 31.5 to 79.9. Using the SMOG formula, the brochures had a mean reading level of grade 11.5 (range = 9 to 13). The Fry Readability showed that 85% of the brochures were written higher than a sixth grade level, with a mean reading level of grade 9.5 (range = 6 to 14). Conclusion: Findings suggest that most of the consumer education information available on the website of this health professional organization had readability scores that were too high for average consumers to read.

Search Trends and Quality of Online Resources Regarding Thyroidectomy

2020 ◽  
pp. 019459982096915
Author(s):  
Lena W. Chen ◽  
Vandra Chatrice Harris ◽  
Justin Lee Jia ◽  
Deborah Xingchun Xie ◽  
Ralph Patrick Tufano ◽  
...  
Keyword(s):  
Grade Level ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Neck Surgery ◽  
Reading Level ◽  
Online Resources ◽  
Cross Sectional ◽  
Flesch Reading Ease ◽  
Google Search

Objective Thyroidectomy is one of the most common procedures performed in head and neck surgery. The quality of online resources for thyroidectomy is unknown. We aim to evaluate search trends and online resource quality regarding thyroidectomy. Study Design Cross-sectional analysis. Setting Websites appearing on Google search. Methods The first 30 Google websites for thyroidectomy were reviewed, excluding research, video, and restricted sites. Search patterns were obtained with Google Trends. Quality was measured by readability (Flesch Reading Ease and Flesch-Kinkaid Grade Level), understandability and actionability (Patient Education Materials Assessment Tool), and clinical practice guideline (CPG) compatibility. Fleiss kappa interrater reliability analysis was performed for 2 raters. Results Twenty-one sites were evaluated. Search popularity for thyroidectomy has increased since 2004. Median reading ease was 42.2 (range, 15.4-62.7) on a scale from 1 to 100, with 100 indicating maximum readability. Median reading grade level was 12 (range, 7-16). Thyroidectomy resources were poorly understandable (median, 66%; range, 21%-88%) and actionable (median, 10%; range, 0%-60%). Median CPG compatibility was 4 out of 5 (range, 0-5). Interrater reliability ranged from substantial to moderate for understandability (0.78), actionability (0.57), and CPG compatibility (0.58), with P < .05 for all results. Conclusion Online resources about thyroidectomy vary in quality and reliability and are written at grade levels above the average reading level of the public. Providers should be aware of existing resources and work to create education resources that meet universal health literacy guidelines. The framework provided in this article may also serve as a guide and provide tangible steps that providers can take to help patients access care.

scholarly journals Readability and Quality of Online Information on Osteoarthritis: An Objective Analysis With Historic Comparison (Preprint)

2018 ◽  
Author(s):  
Kieran Edward Murray ◽  
Timothy Eanna Murray ◽  
Anna Caroline O'Rourke ◽  
Candice Low ◽  
Douglas James Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Code Of Conduct ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

BACKGROUND Osteoarthritis (OA) is the most common cause of disability in people older than 65 years. Readability of online OA information has never been assessed. A 2003 study found the quality of online OA information to be poor. OBJECTIVE The aim of this study was to review the readability and quality of current online information regarding OA. METHODS The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analyzed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons), and nontext pages were excluded. Readability was measured using Flesch Reading Ease Score, Flesch-Kincaid Grade Level, and Gunning-Fog Index. Website quality was scored using the Journal of the American Medical Association (JAMA) benchmark criteria and the DISCERN criteria. Presence or absence of the Health On the Net Foundation Code of Conduct (HONcode) certification, age of content, content producer, and author characteristics were noted. RESULTS A total of 37 unique websites were found suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7th to 8th grade level. Of the 37, 1 (2.7%) website met all 4 JAMA criteria. Mean DISCERN quality of information for OA websites was “fair,” compared with the “poor” grading of a 2003 study. HONcode-endorsed websites (43%, 16/37) were of a statistically significant higher quality. CONCLUSIONS Readability of online health information for OA was either equal to or more difficult than the recommended level.

scholarly journals Readability and quality assessment of internet-based patient education materials related to nasal septoplasty

2021 ◽  
Vol 50 (1) ◽  
Author(s):  
Elysia M. Grose ◽  
Connor P. Holmes ◽  
Kaishan A. Aravinthan ◽  
Vincent Wu ◽  
John M. Lee
Keyword(s):  
Patient Education ◽  
Grade Level ◽  
Reading Level ◽  
Common Procedure ◽  
Flesch Reading Ease ◽  
Quality And Reliability ◽  
Google Search ◽  
The Impact ◽  
Online Patient Education ◽  
Nasal Septoplasty

Abstract Background Given that nasal septoplasty is a common procedure in otolaryngology – head and neck surgery, the objective of this study was to evaluate the quality and readability of online patient education materials on septoplasty. Methods A Google search was performed using eight different search terms related to septoplasty. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability. Results Eighty-five online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 54.9 ± 11.5, indicating they were fairly difficult to read. The average reading grade level was 10.5 ± 2.0, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 42.9 ± 10.5 and 42% (36/85) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality. Conclusion The majority of online patient education materials on septoplasty are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ decision making.

Readability and Quality Assessment of Internet-Based Patient Education Materials Regarding Diabetic Foot Ulcers (Preprint)

2021 ◽  
Author(s):  
David Michael Lee ◽  
Elysia Grose ◽  
Karen Cross
Keyword(s):  
Patient Education ◽  
Diabetic Foot ◽  
Grade Level ◽  
Foot Ulcers ◽  
Diabetic Foot Ulcers ◽  
Flesch Reading Ease ◽  
Reading Grade Level ◽  
Ease Score ◽  
Quality And Reliability ◽  
Online Patient Education

BACKGROUND While diabetic foot ulcers are a common complication of diabetes, little is known about the content and readability of online patient education materials for diabetic foot ulcers. The recommended reading grade level for these materials is grade 6th - 8th. OBJECTIVE To evaluate the quality and readability of online patient education materials on diabetic foot ulcers. METHODS A Google search was performed using four different search terms related to DFUs. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch-Reading Ease Score, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability RESULTS Fourty-one online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 63.43±14.21, indicating a standard difficulty level of reading. The average reading grade level was 9.33±2.6, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 45.66±3.34 and 27% (11/41) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality. CONCLUSIONS The majority of online patient education materials on diabetic foot ulcers are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ self-management.

scholarly journals Readability and Quality of Online Information on Osteoarthritis: An Objective Analysis With Historic Comparison

10.2196/12855 ◽  
2019 ◽  
Vol 8 (3) ◽  
pp. e12855 ◽  
Author(s):  
Kieran Edward Murray ◽  
Timothy Eanna Murray ◽  
Anna Caroline O'Rourke ◽  
Candice Low ◽  
Douglas James Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Code Of Conduct ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

Background Osteoarthritis (OA) is the most common cause of disability in people older than 65 years. Readability of online OA information has never been assessed. A 2003 study found the quality of online OA information to be poor. Objective The aim of this study was to review the readability and quality of current online information regarding OA. Methods The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analyzed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons), and nontext pages were excluded. Readability was measured using Flesch Reading Ease Score, Flesch-Kincaid Grade Level, and Gunning-Fog Index. Website quality was scored using the Journal of the American Medical Association (JAMA) benchmark criteria and the DISCERN criteria. Presence or absence of the Health On the Net Foundation Code of Conduct (HONcode) certification, age of content, content producer, and author characteristics were noted. Results A total of 37 unique websites were found suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7th to 8th grade level. Of the 37, 1 (2.7%) website met all 4 JAMA criteria. Mean DISCERN quality of information for OA websites was “fair,” compared with the “poor” grading of a 2003 study. HONcode-endorsed websites (43%, 16/37) were of a statistically significant higher quality. Conclusions Readability of online health information for OA was either equal to or more difficult than the recommended level.

scholarly journals Is the internet a valuable source of information on transarterial chemoembolization for patients? A systematic review. (Preprint)

2020 ◽  
Author(s):  
Georgios Antonios Sideris ◽  
Aikaterini Themis Vyllioti ◽  
Danai Dima ◽  
Michael Chill ◽  
Njogu Njuguna
Keyword(s):  
Grade Level ◽  
Transarterial Chemoembolization ◽  
Assessment Tool ◽  
Web Searches ◽  
Specific Content ◽  
For Profit ◽  
Flesch Reading Ease ◽  
Not For Profit ◽  
Ease Score ◽  
Source Of Information

BACKGROUND Transarterial chemoembolization (TACE) is the reason for thousands of web searches given its palliative role in liver cancer treatment. OBJECTIVE The purpose of our study is to assess the reliability, quality, completeness, readability, understandability and actionability of websites providing information on TACE for patients. METHODS The 5 most popular keywords pertaining to TACE were searched in Google, Yahoo and Bing. General website characteristics as well as presence of Health on the Net (HON) code certification were documented. Website assessment was performed using the following scores: DISCERN, Journal of the American Medical Association (JAMA), Flesch-Kincaid Grade Level (FRES), Flesch Reading- Ease Score (FKGL) and Patient Education Materials Assessment Tool (PEMAT). A novel TACE-specific content score was designed to evaluate website completeness. RESULTS The search yielded 3750 websites. Eighty-one website entities met inclusion criteria. HON code certification was present in 11.5% of website domains. Authorship was absent in 88% of websites, whereas sources were absent in 83% of websites. Medical disclaimer was not provided in 31% of websites. Date of publication or of last update was not listed in 58% of websites. Median DISCERN score was 47 (IQR 40.5 – 54.0). Median TACE-content score was 35 (IQR 27 – 43). Median readability grade level was in the 11th grade. Sixty percent and 16% of websites were deemed understandable and actionable, respectively. Not-for-profit websites fared significantly better on JAMA, DISCERN, and TACE- content scores (p <0.05). CONCLUSIONS The content referring to TACE that is currently available online is unreliable, incomplete, difficult to read, understandable but not actionable, and characterized by low overall quality. Websites need to revise their content in order to optimally educate consumers and support shared decision-making.

Sign in / Sign up

Export Citation Format

Share Document