Search Trends and Quality of Online Resources Regarding Thyroidectomy

2020 ◽  
pp. 019459982096915
Author(s):  
Lena W. Chen ◽  
Vandra Chatrice Harris ◽  
Justin Lee Jia ◽  
Deborah Xingchun Xie ◽  
Ralph Patrick Tufano ◽  
...  
Keyword(s):  
Grade Level ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Neck Surgery ◽  
Reading Level ◽  
Online Resources ◽  
Cross Sectional ◽  
Flesch Reading Ease ◽  
Google Search

Objective Thyroidectomy is one of the most common procedures performed in head and neck surgery. The quality of online resources for thyroidectomy is unknown. We aim to evaluate search trends and online resource quality regarding thyroidectomy. Study Design Cross-sectional analysis. Setting Websites appearing on Google search. Methods The first 30 Google websites for thyroidectomy were reviewed, excluding research, video, and restricted sites. Search patterns were obtained with Google Trends. Quality was measured by readability (Flesch Reading Ease and Flesch-Kinkaid Grade Level), understandability and actionability (Patient Education Materials Assessment Tool), and clinical practice guideline (CPG) compatibility. Fleiss kappa interrater reliability analysis was performed for 2 raters. Results Twenty-one sites were evaluated. Search popularity for thyroidectomy has increased since 2004. Median reading ease was 42.2 (range, 15.4-62.7) on a scale from 1 to 100, with 100 indicating maximum readability. Median reading grade level was 12 (range, 7-16). Thyroidectomy resources were poorly understandable (median, 66%; range, 21%-88%) and actionable (median, 10%; range, 0%-60%). Median CPG compatibility was 4 out of 5 (range, 0-5). Interrater reliability ranged from substantial to moderate for understandability (0.78), actionability (0.57), and CPG compatibility (0.58), with P < .05 for all results. Conclusion Online resources about thyroidectomy vary in quality and reliability and are written at grade levels above the average reading level of the public. Providers should be aware of existing resources and work to create education resources that meet universal health literacy guidelines. The framework provided in this article may also serve as a guide and provide tangible steps that providers can take to help patients access care.

scholarly journals Quality Assessment of Online Patient Information for Cosmetic Botulinum Toxin

2020 ◽  
Vol 40 (11) ◽  
pp. NP636-NP642 ◽  
Author(s):  
Eric Barbarite ◽  
David Shaye ◽  
Samuel Oyer ◽  
Linda N Lee
Keyword(s):  
Botulinum Toxin ◽  
Patient Education ◽  
Online Education ◽  
Grade Level ◽  
Assessment Tool ◽  
Botulinum Toxin Injection ◽  
Reading Level ◽  
Accuracy Score ◽  
Flesch Reading Ease

Abstract Background In an era of widespread Internet access, patients increasingly look online for health information. Given the frequency with which cosmetic botulinum toxin injection is performed, there is a need to provide patients with high-quality information about this procedure. Objectives The aim of this study was to examine the quality of printed online education materials (POEMs) about cosmetic botulinum toxin. Methods An Internet search was performed to identify 32 websites of various authorship types. Materials were evaluated for accuracy and inclusion of key content points. Readability was measured by Flesch Reading Ease and Flesch-Kincaid Grade Level. Understandability and actionability were assessed with the Patient Education Materials Assessment Tool for Printed Materials. The effect of authorship was measured by undertaking analysis of variance between groups. Results The mean [standard deviation] accuracy score among all POEMs was 4.2 [0.7], which represents an accuracy of 76% to 99%. Mean comprehensiveness was 47.0% [16.4%]. Mean Flesch-Kincaid Grade Level and Flesch Reading Ease scores were 10.7 [2.1] and 47.9 [10.0], respectively. Mean understandability and actionability were 62.8% [18.8%] and 36.2% [26.5%], respectively. There were no significant differences between accuracy (P &gt; 0.2), comprehensiveness (P &gt; 0.5), readability (P &gt; 0.1), understandability (P &gt; 0.3), or actionability (P &gt; 0.2) by authorship. Conclusions There is wide variability in the quality of cosmetic botulinum toxin POEMs regardless of authorship type. The majority of materials are written above the recommended reading level and fail to include important content points. It is critical that providers take an active role in the evaluation and endorsement of online patient education materials.

scholarly journals Readability of the American, Canadian, and British Otolaryngology–Head and Neck Surgery Societies’ Patient Materials

2021 ◽  
pp. 019459982110332
Author(s):  
Joo Hyun Kim ◽  
Elysia Grose ◽  
Justine Philteos ◽  
David Forner ◽  
Christopher W. Noel ◽  
...  
Keyword(s):  
Patient Education ◽  
Head And Neck ◽  
Grade Level ◽  
Neck Surgery ◽  
Cross Sectional Study ◽  
Reading Level ◽  
Head And Neck Surgery ◽  
Cross Sectional ◽  
Patient Comprehension ◽  
Reading Grade Level

Objective Patient education materials across 3 national English otolaryngology–head and neck surgery (OHNS) societies: the American Academy of Otolaryngology–Head and Neck Surgery (AAO-HNS), the Canadian Society of Otolaryngology–Head and Neck Surgery (CSOHNS), and Ear, Nose, and Throat United Kingdom (ENT UK) were examined to determine whether they are written at a level suitable for patient comprehension. Study Design Cross-sectional study. Setting Online patient materials presented through OHNS national societies. Methods Readability was calculated using the Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease Score, and Simple Measure of Gobbledygook Index. All public patient education materials available through the CSOHNS, AAO-HNS, and ENT UK websites were assessed. Patient education materials were grouped into categories by subspecialty. Results In total, 128 patient materials from the 3 societies were included in the study. All 3 societies required a minimum grade 9 reading comprehension level to understand their online materials. According to Flesch-Kincaid Grade Level, the CSOHNS required a significantly higher reading grade level to comprehend the materials presented when compared to AAO-HNS (11.3 vs 9.9; 95% CI, 0.5-2.4; P < .01) and ENT UK (11.3 vs 9.4; 95% CI, 0.9-2.9; P < .01). Patient education materials related to rhinology were the least readable among all 3 societies. Conclusion This study suggests that the reading level of the current patient materials presented through 3 national OHNS societies are written at a level that exceeds current recommendations. Promisingly, it highlights an improvement for the readability of patient materials presented through the AAO-HNS.

scholarly journals P126 An analysis of the quality and readability of online information for osteoarthritis

Rheumatology ◽  
2020 ◽  
Vol 59 (Supplement_2) ◽  
Author(s):  
Kieran Murray ◽  
Timothy Murray ◽  
Candice Low ◽  
Anna O'Rourke ◽  
Douglas J Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Scoring Systems ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

Abstract Background Osteoarthritis is the most common cause of disability in people over 65 years old. The readability of of online osteoarthritis information has never been assessed. A 2003 study found the quality of online osteoarthritis information to be poor. This study reviews the quality of online information regarding osteoarthritis in 2018 using three validated scoring systems. Readability is reviewed for the first time, again using three validated tools. Methods The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analysed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons) and non-text pages were excluded. Readability was measured using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL) and Gunning-Fog Index (GFI). Website quality was scored using the the Journal of the American Medical Association (JAMA) benchmark criteria and DISCERN criteria. Presence or absence of HONcode certification, age of content, content producer and author characteristics were noted. Results 37 unique websites were suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7- 8th grade level. One (2.7%) website met all four JAMA Criteria. Mean DISCERN quality of information for OA websites was “fair”, comparing favourably with the “poor” grading of a 2003 study. HONCode endorsed websites (43.2%) were of a statistically significantly higher quality. Conclusion Quality of online health information for OA is “fair”. 2.7% of websites met JAMA benchmark criteria for quality. Readability was equal to or more difficult than recommendations. HONcode certification was indicative of higher quality, but not readability. Disclosures K. Murray None. T. Murray None. C. Low None. A. O'Rourke None. D.J. Veale None.

Critical Quality and Readability Analysis of Online Patient Education Materials on Parotidectomy: A Cross-Sectional Study

2022 ◽  
pp. 000348942110666
Author(s):  
Elysia Miriam Grose ◽  
Emily YiQin Cheng ◽  
Marc Levin ◽  
Justine Philteos ◽  
Jong Wook Lee ◽  
...  
Keyword(s):  
Patient Education ◽  
Grade Level ◽  
Critical Role ◽  
Cross Sectional Study ◽  
Online Information ◽  
Cross Sectional ◽  
Flesch Reading Ease ◽  
Ease Score ◽  
Google Search ◽  
Online Patient Education

Purpose: Complications related to parotidectomy can cause significant morbidity, and thus, the decision to pursue this surgery needs to be well-informed. Given that information available online plays a critical role in patient education, this study aimed to evaluate the readability and quality of online patient education materials (PEMs) regarding parotidectomy. Methods: A Google search was performed using the term “parotidectomy” and the first 10 pages of the search were analyzed. Quality and reliability of the online information was assessed using the DISCERN instrument. Flesch-Kincaid Grade Level (FKGL) and Flesch-Reading Ease Score (FRE) were used to evaluate readability. Results: Thirty-five PEMs met the inclusion criteria. The average FRE score was 59.3 and 16 (46%) of the online PEMs had FRE scores below 60 indicating that they were fairly difficult to very difficult to read. The average grade level of the PEMs was above the eighth grade when evaluated with the FKGL. The average DISCERN score was 41.7, which is indicative of fair quality. There were no significant differences between PEMs originating from medical institutions and PEMs originating from other sources in terms of quality or readability. Conclusion: Online PEMs on parotidectomy may not be comprehensible to the average individual. This study highlights the need for the development of more appropriate PEMs to inform patients about parotidectomy.

scholarly journals Evaluating the Quality and Readability of Internet Information Sources regarding the Treatment of Swallowing Disorders

2017 ◽  
Vol 96 (3) ◽  
pp. 128-138 ◽  
Author(s):  
Ashley P. O'Connell Ferster ◽  
Amanda Hu
Keyword(s):  
Health Information ◽  
Grade Level ◽  
Information Sources ◽  
Swallowing Disorders ◽  
Reading Level ◽  
Online Information ◽  
Significant Difference ◽  
8Th Grade ◽  
Google Search

The Internet has become a popular resource for patient education. The information it provides, however, is rarely peer-reviewed, and its quality may be a concern. Since the average American reads at an 8th grade level, the American Medical Association and the National Institutes of Health have recommended that health information be written at a 4th to 6th grade level. We performed a study to assess the quality and readability of online information regarding the treatment of swallowing disorders. A Google search for “swallowing treatment” was conducted. We studied the first 50 websites that appeared on the search engines results with the use of the DISCERN quality index tool, the Flesch Ease of Reading Score (FRES), and the Flesch-Kincaid Grade Level (FKGL) readability test. DISCERN is a validated 16-item questionnaire used to assess the quality of written health information; FRES and FKGL are used to assess readability. We classified the websites as either patient-targeted or professional-targeted sites, as well as either major or minor. The overall DISCERN score was 1.61 ± 0.61 (range: 1 to 5), the overall FRES was 39.1 ± 19.0 (range: 1 to 100), and the overall FKGL was 11.8 ± 3.4 (range: 3 to 12). As would be expected, patient-targeted websites had significantly higher FRES and significantly lower FKGL scores than did the professional-targeted websites (p = 0.01 and p = 0.04, respectively); there was no significant difference between the two in DISCERN scores. The major websites had significantly higher DISCERN scores than did the minor sites (p = 0.002); there were no significant differences in FRES and FKGL scores. We conclude that online information sources regarding the treatment of swallowing disorders were of sub optimal quality in that information was written at a level too difficult for the average American to easily understand. Also, the patient-targeted websites were written at a lower reading level, and the major websites contained a higher quality of information.

scholarly journals Readability and Quality of Online Information on Osteoarthritis: An Objective Analysis With Historic Comparison (Preprint)

2018 ◽  
Author(s):  
Kieran Edward Murray ◽  
Timothy Eanna Murray ◽  
Anna Caroline O'Rourke ◽  
Candice Low ◽  
Douglas James Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Code Of Conduct ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

BACKGROUND Osteoarthritis (OA) is the most common cause of disability in people older than 65 years. Readability of online OA information has never been assessed. A 2003 study found the quality of online OA information to be poor. OBJECTIVE The aim of this study was to review the readability and quality of current online information regarding OA. METHODS The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analyzed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons), and nontext pages were excluded. Readability was measured using Flesch Reading Ease Score, Flesch-Kincaid Grade Level, and Gunning-Fog Index. Website quality was scored using the Journal of the American Medical Association (JAMA) benchmark criteria and the DISCERN criteria. Presence or absence of the Health On the Net Foundation Code of Conduct (HONcode) certification, age of content, content producer, and author characteristics were noted. RESULTS A total of 37 unique websites were found suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7th to 8th grade level. Of the 37, 1 (2.7%) website met all 4 JAMA criteria. Mean DISCERN quality of information for OA websites was “fair,” compared with the “poor” grading of a 2003 study. HONcode-endorsed websites (43%, 16/37) were of a statistically significant higher quality. CONCLUSIONS Readability of online health information for OA was either equal to or more difficult than the recommended level.

scholarly journals Readability of patient education materials related to radiation safety: What are the implications for patient-centred radiology care?

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Francis T. Delaney ◽  
Tiarnán Ó. Doinn ◽  
James M. Broderick ◽  
Emma Stanley
Keyword(s):  
Grade Level ◽  
Radiation Safety ◽  
Reading Level ◽  
Online Resources ◽  
Flesch Reading Ease ◽  
Reading Grade Level ◽  
8Th Grade ◽  
Ease Score ◽  
The Mean ◽  
Grade Reading Level

Abstract Background Increasing numbers of patients and carers rely on online resources for healthcare information. Radiation safety can be misunderstood by patients and clinicians and lead to patient anxiety. We aimed to assess the readability of online patient educational materials (PEMs) related to radiation safety. Methods A total of 84 articles pertaining to radiation safety from 14 well-known online resources were identified. PEMs were then analysed using Readability Studio Professional Edition Version 2019. Readability was assessed using eight different instruments: the Flesch-Kincaid Reading Grade Level, Raygor Estimate, SMOG, Coleman–Liau, Fry, FORCAST, Gunning Fog, and Flesch Reading Ease Score formula. The mean reading grade level (RGL) of each article was compared to the 6th and 8th grade reading level using 1-sample t-tests. Results The cumulative mean RGL for all 84 articles was 13.3 (range = 8.6–17.4), and none were written at or below the 6th or 8th grade level. The cumulative mean RGL exceeded the 6th grade reading level by an average of 7.3 levels (95% CI, 6.8–7.8; p < 0.001) and the 8th grade level by an average of 5.3 grade levels (95% CI, 4.8–5.8; p < 0.001). The mean Flesch Reading Ease Score was 39/100 (‘difficult’). Conclusion Currently available online PEMs related to radiation safety are still written at higher than recommended reading levels. Radiation safety is a topic in which the specialist training of radiologists is crucial in providing guidance to patients. Addressing the readability of online PEMs can improve radiology-patient communication and support the shift to a patient-centred model of practice.

scholarly journals Readability and quality assessment of internet-based patient education materials related to nasal septoplasty

2021 ◽  
Vol 50 (1) ◽  
Author(s):  
Elysia M. Grose ◽  
Connor P. Holmes ◽  
Kaishan A. Aravinthan ◽  
Vincent Wu ◽  
John M. Lee
Keyword(s):  
Patient Education ◽  
Grade Level ◽  
Reading Level ◽  
Common Procedure ◽  
Flesch Reading Ease ◽  
Quality And Reliability ◽  
Google Search ◽  
The Impact ◽  
Online Patient Education ◽  
Nasal Septoplasty

Abstract Background Given that nasal septoplasty is a common procedure in otolaryngology – head and neck surgery, the objective of this study was to evaluate the quality and readability of online patient education materials on septoplasty. Methods A Google search was performed using eight different search terms related to septoplasty. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability. Results Eighty-five online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 54.9 ± 11.5, indicating they were fairly difficult to read. The average reading grade level was 10.5 ± 2.0, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 42.9 ± 10.5 and 42% (36/85) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality. Conclusion The majority of online patient education materials on septoplasty are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ decision making.

scholarly journals Readability and Quality of Online Information on Osteoarthritis: An Objective Analysis With Historic Comparison

10.2196/12855 ◽  
2019 ◽  
Vol 8 (3) ◽  
pp. e12855 ◽  
Author(s):  
Kieran Edward Murray ◽  
Timothy Eanna Murray ◽  
Anna Caroline O'Rourke ◽  
Candice Low ◽  
Douglas James Veale
Keyword(s):  
Grade Level ◽  
English Language ◽  
Assessment Tool ◽  
Code Of Conduct ◽  
Online Information ◽  
Flesch Reading Ease ◽  
12Th Grade ◽  
8Th Grade ◽  
Ease Score

Background Osteoarthritis (OA) is the most common cause of disability in people older than 65 years. Readability of online OA information has never been assessed. A 2003 study found the quality of online OA information to be poor. Objective The aim of this study was to review the readability and quality of current online information regarding OA. Methods The term osteoarthritis was searched across the three most popular English language search engines. The first 25 pages from each search engine were analyzed. Duplicate pages, websites featuring paid advertisements, inaccessible pages (behind a pay wall, not available for geographical reasons), and nontext pages were excluded. Readability was measured using Flesch Reading Ease Score, Flesch-Kincaid Grade Level, and Gunning-Fog Index. Website quality was scored using the Journal of the American Medical Association (JAMA) benchmark criteria and the DISCERN criteria. Presence or absence of the Health On the Net Foundation Code of Conduct (HONcode) certification, age of content, content producer, and author characteristics were noted. Results A total of 37 unique websites were found suitable for analysis. Readability varied by assessment tool from 8th to 12th grade level. This compares with the recommended 7th to 8th grade level. Of the 37, 1 (2.7%) website met all 4 JAMA criteria. Mean DISCERN quality of information for OA websites was “fair,” compared with the “poor” grading of a 2003 study. HONcode-endorsed websites (43%, 16/37) were of a statistically significant higher quality. Conclusions Readability of online health information for OA was either equal to or more difficult than the recommended level.

scholarly journals Readability of Online Materials Related to Vocal Cord Leukoplakia

OTO Open ◽  
2021 ◽  
Vol 5 (3) ◽  
pp. 2473974X2110326
Author(s):  
Matthew Shneyderman ◽  
Grace E. Snow ◽  
Ruth Davis ◽  
Simon Best ◽  
Lee M. Akst
Keyword(s):  
Patient Education ◽  
Vocal Cord ◽  
Grade Level ◽  
Assessment Tool ◽  
Medical Center ◽  
Academic Medical Center ◽  
Entire Cohort ◽  
Flesch Reading Ease ◽  
Ease Score ◽  
Google Search

Objectives To assess readability and understandability of online materials for vocal cord leukoplakia. Study Design Review of online materials. Setting Academic medical center. Methods A Google search of “vocal cord leukoplakia” was performed, and the first 50 websites were considered for analysis. Readability was measured by the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Simple Measure of Gobbledygook (SMOG). Understandability and actionability were assessed by 2 independent reviewers with the PEMAT-P (Patient Education Materials Assessment Tool for Printable Materials). Unpaired t tests compared scores between sites aimed at physicians and those at patients, and a Cohen’s kappa was calculated to measure interrater reliability. Results Twenty-two websites (17 patient oriented, 5 physician oriented) met inclusion criteria. For the entire cohort, FRES, FKGL, and SMOG scores (mean ± SD) were 36.90 ± 20.65, 12.96 ± 3.28, and 15.65 ± 3.57, respectively, indicating that materials were difficult to read at a >12th-grade level. PEMAT-P understandability and actionability scores were 73.65% ± 7.05% and 13.63% ± 22.47%. Statistically, patient-oriented sites were more easily read than physician-oriented sites ( P < .02 for each of the FRES, FKGL, and SMOG comparisons); there were no differences in understandability or actionability scores between these categories of sites. Conclusion Online materials for vocal cord leukoplakia are written at a level more advanced than what is recommended for patient education materials. Awareness of the current ways that these online materials are failing our patients may lead to improved education materials in the future.

Sign in / Sign up

Export Citation Format

Share Document