Readability Analysis of Online Patient Educational Materials on Blepharoplasty

2021 ◽  
pp. 074880682110283
Author(s):  
Manish J. Patel ◽  
Parth V. Shah ◽  
Stuti P. Garg ◽  
Robert T. Cristel

Blepharoplasty is a common procedure for correction of eyelid appearance. Online educational material among surgical procedures is often written higher than the recommended fifth-grade level. The objective of this study is to evaluate the readability of online patient education materials (OPEMs) available on Google for patients interested in blepharoplasty. Using 6 different pre-established readability scores, the top 100 Google results on blepharoplasty were screened for analysis. A total of 87 OPEMs were found to be relevant yielding an average grade reading level of 11.90 (range 7-20; 95% confidence interval [CI], 11.45-12.33). In addition, OPEMs readability scores were not influenced by whether the author was a medical provider. This study demonstrated the average reading level for available information on blepharoplasty is higher than the recommended fifth-grade reading level. Readability is only one metric for evaluating comprehendible information; however, authors of online medical education need to be more conscious of the public’s ability to comprehend and should tailor their content delivery appropriately.

2020 ◽  
Vol 5 (4) ◽  
pp. 2473011420S0022
Author(s):  
Burke Gao ◽  
Alan G. Shamrock ◽  
Trevor Gulbrandsen ◽  
John E. Femino ◽  
Cesar de Cesar Netto ◽  
...  

Category: Sports; Trauma Introduction/Purpose: Patients often access online resources to learn about orthopedic procedures prior to undergoing elective surgery. In order to be fully understood by the average English-speaking adult, online health information must be written at an elementary school reading level. To be helpful to patients, educational resources should also be generally understandable and have actionable direction that positively affects healthcare interactions. There are several previously validated indices for accessing the reading level of written materials. The Patient Education Materials Assessment Tool (PEMAT) provides a reliable and validated method to measure the understandability and actionability of education materials. The purpose of this study was to utilize PEMAT and readability algorithms to quantify readability, understandability and actionability of online patient education materials related to Achilles tendon repair. Methods: Online patient education materials were identified using two independently conducted Google engine searches with the term ‘Achilles tendon repair’. Using the top 50 search results, articles were included if they specifically served to educate patients regarding TAA. Exclusion criteria included news articles, non-text materials (video), research manuscripts, industry websites, and articles not related to Achilles tendon repair. The readability of included articles was quantified using the validated Flesch-Kincaid Grade Level index. The PEMAT form for printed materials was used to assess understandability and actionability using a 0-100 scale for both measures of interest. Spearman’s correlation coefficient was utilized to examine the relationship between a website’s average rank on Google (from first to last) and its readability, understandability, and actionability. P-values of less than 0.05 were considered significant. Results: Thirty-one websites met inclusion criteria. The mean Flesch Kincaid reading grade level was 10.8+-2.9, with only one website written below the 6th grade reading level. Higher Flesch-Kincaid grade was associated with later Google seach rank (rho: 0.488, p=0.010). Mean understandability and actionability scores were 67.1+-16.4% and 38.3+-28.4%, respectively. Among understandability criteria, only 12.9% (n=4) of articles included summaries and just 38.7% (n=12) included visual aids. Among actionability categories, 74% (n=23) of websites identified at least one action for readers, while only 60.8% (n=14) of these studies broke down actions into explicit, easy to understand steps. Actionability scores were not correlated with Google search rank (rho: -0.02, p=0.888), while higher understandability scores were associated with later Google search rank (rho: 0.45, p=0.017). Conclusion: Only one website describing Achilles tendon repair was written at or below the nationally recommended 6th grade reading level. Overall, Achilles tendon repair online educational materials scored poorly with respect to readability, understandability, and actionability. Articles that appeared earlier in the Google search had lower readability and understandability scores. In the era of shared decision making, it is vital that patients understand procedures, as well as the risks and benefits prior to undergoing elective surgery. These results suggest that current publicly available resources for Achilles tendon repair remain inadequate for patient education.


Author(s):  
Elysia M. Grose ◽  
Connor P. Holmes ◽  
Kaishan A. Aravinthan ◽  
Vincent Wu ◽  
John M. Lee

Abstract Background Given that nasal septoplasty is a common procedure in otolaryngology – head and neck surgery, the objective of this study was to evaluate the quality and readability of online patient education materials on septoplasty. Methods A Google search was performed using eight different search terms related to septoplasty. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability. Results Eighty-five online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 54.9 ± 11.5, indicating they were fairly difficult to read. The average reading grade level was 10.5 ± 2.0, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 42.9 ± 10.5 and 42% (36/85) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality. Conclusion The majority of online patient education materials on septoplasty are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ decision making.


2019 ◽  
Vol 30 (3) ◽  
pp. 328-336
Author(s):  
Derya Arslan ◽  
Mahmut Sami Tutar ◽  
Betul Kozanhan ◽  
Zafer Bagci

AbstractObjective:Murmurs are abnormal audible heart sounds produced by turbulent blood flow. Therefore, murmurs in a child may be a source of anxiety for family members. Families often use online materials to explore possible reasons for these murmurs, given the accessibility of information on the Internet. In this study, we evaluated the quality, understandability, readability, and popularity of online materials about heart murmur.Methods:An Internet search was performed for “heart murmur” using the Google search engine. The global quality score (on a scale of 1 to 5, corresponding to poor to excellent quality) and Health on the Net code were used to measure the quality of information presented. The understandability of the web pages identified was measured using the Patient Education Materials Assessment Tool (score range from 0 to 100%, scores below 70% reflect poor performance). The readability of each web pages was assessed using four validated indices: the Flesch Reading Ease Score, the Flesch–Kincaid Grade Level, the Gunning Frequency of Gobbledygook, and the Simple Measure of Gobbledygook. The ALEXA traffic tool was used to reference domains’ popularity and visibility.Results:We identified 230 English-language patient educational materials that discussed heart murmur. After exclusion, a total of 86 web pages were evaluated for this study. The average global quality score was 4.34 (SD = 0.71; range from 3 to 5) indicating that the quality of information of most websites was good. Only 14 (16.3%) websites had Health on the Net certification. The mean understandability score for all Internet-based patient educational materials was 74.6% (SD = 12.8%; range from 31.2 to 93.7%). A score suggesting these Internet-based patient educational materials were “easy to understand”. The mean readability levels of all patient educational materials were higher than the recommended sixth-grade reading level, according to all indices applied. This means that the level of readability is difficult. The average grade level for all web pages was 10.4 ± 1.65 (range from 7.53 to 14.13). The Flesch–Kincaid Grade level was 10 ± 1.81, the Gunning Frequency of Gobbledygook level was 12.1 ± 1.85, and the Simple Measure of Gobbledygook level was 9.1 ± 1.38. The average Flesch Reading Ease Score was 55 ± 9.1 (range from 32.4 to 72.9).Conclusion:We demonstrated that web pages describing heart murmurs were understandable and high quality. However, the readability level of the websites was above the recommended sixth-grade reading level. Readability of written materials from online sources need to be improved. However, care must be taken to ensure that the information of web pages is of a high quality and understandable.


2021 ◽  
pp. 105566562110131
Author(s):  
Christopher V. Lavin ◽  
Evan J. Fahy ◽  
Darren B. Abbas ◽  
Michelle Griffin ◽  
Nestor M. Diaz Deleon ◽  
...  

Objective: It is important for health care education materials to be easily understood by caretakers of children requiring craniofacial surgery. This study aimed to analyze the readability of Google search results as they pertain to “Cleft Palate Surgery” and “Palatoplasty.” Additionally, the study included a search from several locations globally to identify possible geographic differences. Design: Google searches of the terms “Cleft Palate Surgery” and “Palatoplasty” were performed. Additionally, searches of only “Cleft Palate Surgery” were run from several internet protocol addresses globally. Main Outcome Measures: Flesch-Kincaid Grade Level and Readability Ease, Gunning Fog Index, Simple Measure of Gobbledygook (SMOG) index, and Coleman-Liau Index. Results: Search results for “Cleft Palate Surgery” were easier to read and comprehend compared to search results for “Palatoplasty.” Mean Flesch-Kincaid Grade Level scores were 7.0 and 10.11, respectively ( P = .0018). Mean Flesch-Kincaid Reading Ease scores were 61.29 and 40.71, respectively ( P = .0003). Mean Gunning Fog Index scores were 8.370 and 10.34, respectively ( P = .0458). Mean SMOG Index scores were 6.84 and 8.47, respectively ( P = .0260). Mean Coleman-Liau Index scores were 12.95 and 15.33, respectively ( P = .0281). No significant differences were found in any of the readability measures based on global location. Conclusions: Although some improvement can be made, craniofacial surgeons can be confident in the online information pertaining to cleft palate repair, regardless of where the search is performed from. The average readability of the top search results for “Cleft Palate Surgery” is around the seventh-grade reading level (US educational system) and compares favorably to other health care readability analyses.


2003 ◽  
Vol 27 (2) ◽  
pp. 37-46 ◽  
Author(s):  
Benjamin J. White ◽  
Bradley J. Cardinal

Waiver of liability forms should be written at a reading level consistent with that of the intended audience. On average, students read three grade levels below the last grade they completed in school. Therefore, waivers should be written no higher then the ninth-grade level. The main goal of this study was to assess the reading level of intramural and recreational sport waiver of liability forms, compared to the ninth-grade level. Nine NIRSA member schools and nine non-NIRSA member schools were randomly selected from each of NIRSA's six regions. Readability was assessed using the Readability Calculation software (Micro Power & Light, Dallas, TX) for MacIntosh. A one-sample t-test was performed to compare the forms to the ninth-grade reading level. Forms were written significantly higher than the ninth-grade level (t[26]=14.53, p<.0001). An analysis of variance was performed to assess possible moderating variables. No significant differences were found. Font size was also measured, and forms were found to have been written at a significantly higher level then the recommended 12-point font (t[28]=-2.88, p<.01). This study brings into question the efficacy of waiver of liability forms used in many collegiate/university intramural and recreational sports programs.


2020 ◽  
Vol 5 (4) ◽  
pp. 2473011420S0008
Author(s):  
Alan G. Shamrock ◽  
Burke Gao ◽  
Trevor Gulbrandsen ◽  
John E. Femino ◽  
Cesar de Cesar Netto ◽  
...  

Category: Ankle Arthritis; Ankle Introduction/Purpose: Patients often access online resources to learn about orthopedic procedures prior to undergoing elective surgery. In order to be fully understood by the average English-speaking adult, online health information must be written at an elementary school reading level. To be helpful to patients, educational resources should also be generally understandable and have actionable direction that positively affects their healthcare interactions. There are several previously validated indices for accessing the reading level of written materials. The Patient Education Materials Assessment Tool (PEMAT) provides a reliable and validated method to measure the understandability and actionability of education materials. The purpose of this study was to utilize PEMAT and readability algorithms to quantify readability, understandability and actionability of online patient education materials related to total ankle arthroplasty (TAA). Methods: Online patient education materials were identified using two independently conducted Google engine searches with the term ‘ankle replacement’. Using the top 50 search results, articles were included if they specifically served to educate patients regarding TAA. Exclusion criteria included news articles, non-text materials (video), research manuscripts, industry websites, and articles not related to TAA. The readability of included articles was quantified using the validated Flesch-Kincaid Grade Level index. The PEMAT form (Figure 1) for printed materials was used to assess understandability and actionability using a 0-100 scale for both measures of interest. Spearman’s correlation coefficient was utilized to examine the relationship between a website’s average rank on Google (from first to last) and its readability, understandability, and actionability. P-values of less than 0.05 were considered significant. Results: Forty-one websites met inclusion criteria. The mean Flesch Kincaid reading grade level was 13.7+-15.3 (range: 6.3-16.8), with no website written at an elementary school level. Article readability scores were not associated with Google search rank (p>0.301). Mean understandability and actionability scores were 70.4+-15.3 and 24.4+-24.3, respectively. Among understandability categories, only 9.8% (n=4) included summaries and only 46.3% (n=19) included visual aids. Among actionability categories, 58.5% (n=24) of websites identified at least one action for readers, but only 16.7% (n=4) of these studies broke down actions into explicit, easy to understand steps. Higher actionability scores were significantly associated with earlier Google search rank (rho:- 0.44, p=0.004), while higher understandability scores were associated with later Google search rank (rho: 0.53, p<0.001). Conclusion: No website describing TAA was written at or below the nationally recommended 6th grade reading level. Overall, TAA online educational materials scored poorly with respect to readability, understandability, and actionability. Article actionability but not understandability correlated with an earlier Google search rank. In the era of shared decision making, it is vital that patients understand procedures, as well as the risks and benefits prior to undergoing elective surgery. These results suggest that current publicly available resources for TAA remain inadequate for patient education.


2010 ◽  
Vol 7 (3) ◽  
pp. 375-380 ◽  
Author(s):  
Lorraine S. Wallace ◽  
Kenneth Bielak ◽  
Brian Linn

Background:We evaluated readability and related features of English-language instructions accompanying pedometers, including reading grade level, layout/formatting characteristics, and emphasis of key points.Methods:We identified 15 pedometers currently available for purchase in the US. Reading grade level was calculated using Flesch-Kinkaid (FK) and SMOG formulas. Text point size was measured with a C-Thru Ruler. Page and illustration dimensions were measured to the nearest millimeter (mm) with a standard ruler. Layout features were evaluated using the criteria from the User-Friendliness Tool.Results:FK scores ranged from 8th to 11th grade, while SMOG scores ranged from 8th to 12th grade. Text point size averaged 6.9 ± 1.9 (range = 4−11). Instructions averaged 8.7 ± 9.0 (range = 0−36) illustrations, most about the size of a US quarter. While many instructions avoided use of specialty fonts (n = 12; 80.0%), most used a minimal amount of white space. Just 4 (26.7%) sets of instructions highlighted the target goal of 10,000 steps-per-day.Conclusion:Pedometer instructions should be revised to meet the recommended 6th grade reading level. Paper size instructions are printed on should be enlarged, thereby allowing for larger text and illustrations, and additional white space. Recommended number of steps per day and proper pedometer positioning should also be predominantly highlighted.


2021 ◽  
Vol 8 ◽  
pp. 237437352110564
Author(s):  
Shayan Hosseinzadeh ◽  
Philip Blazar ◽  
Brandon E Earp ◽  
Dafang Zhang

Dupuytren's contracture is a common hand pathology for which consultation and treatment are largely at the patient's discretion. The objective of this study was to evaluate the readability of current online patient information regarding Dupuytren's contracture. The largest public search engines (Google, Yahoo, and Bing) were queried using the search terms “Dupuytren's contracture,” “Dupuytren's disease,” “Viking's disease,” and “bent finger.” The first 30 unique websites by each search were analyzed and readability assessed using five established algorithms: Flesch Reading Ease, Gunning-Fog Index, Flesch–Kincaid Grade level, Coleman–Liau index, and Simple Measure of Gobbledygook grade level. Analysis of 73 websites demonstrated an average Flesch Reading Ease score of 48.6 ± 8.0, which corresponds to college reading level. The readability of websites ranged from 10.5 to 13.3 reading grade level. No article was written at or below the recommended sixth grade reading level. Information on the internet on Dupuytren's contracture is written at higher than recommended reading grade level. There is a need for high-quality patient information on Dupuytren's contracture at appropriate reading grade levels for patients of various health literacy backgrounds. Hospitals, universities, and academic organizations focused on the development of readable online information should consider patients’ input and preferences.


2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0010
Author(s):  
Ashley N. Marshall ◽  
Kenneth C. Lam

Background: The assessment of patient outcomes in pediatric (ie, youth and adolescent) athletes is critical for comprehensive and whole person healthcare. The Disablement of the Physically Active scale (DPA) is a relatively new generic patient-reported outcome measure (PROM) that was designed specifically for athletic and highly functional patient populations. While the DPA has been used to evaluate health-related quality of life (HRQOL) in adults, little is known about its use in pediatric athletes. The selection of PROMs for pediatric athletes presents with unique challenges, particularly regarding the ability of these athletes to effectively understand the instruments to which they are completing. Therefore, the purpose of this study was to examine the readability of the DPA in pediatric athletes through (1) participant-based and (2) computer-based analyses. Methods: Participant-based analysis was utilized to conduct a preliminary investigation into the subjective readability (ie, a participant’s perceived ability to successfully read the material) of the DPA. Participants were youth athletes (n=13, age=8.7±1.3 years) recruited from a local community athletics league. An investigator administered the San Diego Quick Assessment of Reading Ability to determine each participant’s current reading grade level. Participants were then instructed to read each item of the DPA and circle any words that they did not understand. Frequency counts and percentages were determined for each word identified by participants, within each item of the DPA. Computer-based analysis was utilized to assess the objective readability of the DPA. The Flesch Reading Ease (FRE), Flesch-Kincaid Reading Level (FK), and Gunning Fog Index (FOG) scores were calculated for each item of the DPA. FRE scores range from 0 to 100, with lower scores indicating more difficult reading material. The FRE score is converted to an approximate reading level (FK), ranging from pre-primer (<0) to college (>12), with higher reading level indicating more difficult reading material. Similar to the FK formula, the FOG formula computes to an approximate reading grade level associated with the U.S. education system. Summary statistics (mean± standard deviation, median, and range) were used to report scores for each DPA item. We also reported the number (%) of items that exceeded the 5th – 6th grade reading level, which is the maximum recommended threshold for pediatric patients. Results: It was determined that the average reading grade level of the participants was 3±1.4 years. In regards to subjective readability, participants did not understand an average of 22.1% (48.3/219 words) of the entire DPA scale, with a range across items of 3.1% (Pain = 0.15/5 words) to 34.9% (Overall Fitness = 5.2/15 words). There were 40 instances where greater than 50% of the participants did not recognize a word, and seven words throughout the scale that 100% (13/13) of the participants did not understand: endurance, stability, pivoting, coordination, cardiovascular, endurance and colleagues. For objective readability, FRE scores ranged from 5.8 (very confusing) to 119.7 (very easy) across items. The mean and median across all items was 42.4±33.4 (difficult), and 41.4 (difficult), respectively. The FK reading level ranged from -2.8 (pre-primer) to 13.8 (college), with a mean score of 8.8±4.8 and median score of 8.9. The FOG reading level ranged from 1 (1st grade) to 13.8 (college), with a mean score of 9.3±3.8 and median score of 10.5. When considering both the FK and FOG scores, 81.8% (9/11) of the items exceeded the 5th – 6th grade reading level threshold. Conclusions/Significance: These findings indicate that the overall readability of the DPA may not be appropriate for pediatric athletes. Thus, findings using the DPA in pediatric athletes for clinical or research purposes should be interpreted with caution. Future research is warranted to develop a pediatric version of the DPA, utilizing the results of this study for guidance, as no other generic PROM currently exist for assessing HRQOL specifically in youth and adolescent athletes.


PEDIATRICS ◽  
1994 ◽  
Vol 93 (3) ◽  
pp. 460-468 ◽  
Author(s):  
Terry C. Davis ◽  
E. J. Mayeaux ◽  
Doren Fredrickson ◽  
Joseph A. Bocchini ◽  
Robert H. Jackson ◽  
...  

Objectives. To test the reading ability of parents of pediatric outpatients and to compare their reading ability with the ability necessary to read commonly used educational materials; to compare individual reading grade levels with the levels of the last grade completed in school; and to further validate a new literacy screening test designed specifically for medical settings. Design. Prospective survey. Setting. Pediatrics outpatient clinic in a large, public university, teaching hospital. Participants. Three hundred ninety-six parents or other caretakers accompanying pediatric outpatients. Measurements. Demographics and educational status were assessed using a structured interview. Reading ability was tested using the Rapid Estimate of Adult Literacy in Medicine (REALM) and the Wide Range Achievement Test-Revised2. Written educational materials were assessed for readability levels with a computer program (Grammatik IV). Results. The mean score on the REALM for all parents placed them in the seventh to eighth grade reading range, despite the mean self-reported last grade completed in school being 11th grade 5th month. Wide Range Achievement Test-Revised2 scores correlated well with REALM scores (0.82). Eighty percent of 129 written materials from the American Academy of Pediatrics, the Centers for Disease Control, the March of Dimes, pharmaceutical companies, and commercially available baby books required at least a 10th grade reading level. Only 25% of 60 American Academy of Pediatrics items and 19% of all materials tested were written at less than a ninth grade level, and only 2% of all materials were written at less than a seventh grade level. Conclusion. This study demonstrates that parents' self-reported education level will not accurately indicate their reading ability. Testing is needed to screen at-risk parents for low reading levels. In a public health setting, a significant amount of available parent education materials and instructions require a higher reading level than most parents have achieved. In such settings, all materials probably should be written at less than a high school level if most parents are to be expected to read them. The REALM can easily be used in busy public health clinics to screen parents for reading ability.


Sign in / Sign up

Export Citation Format

Share Document