Measuring Text Readability Using Reading Level

Author(s):  
James C. Brewer

Reading grade level calculations have been in use for over a century in the United States and have guided the selection of texts used in school programs. Government agencies at all levels, the military in its various branches, and editors of publications have found such formulas of use in setting policy or determining who can participate in programs. As readership is now a worldwide phenomenon with English as the primary language of the internet, reading grade level calculations can also be useful in creating web pages and assigning reading texts to large multi-user classes (MOOCs) run over the internet. In this regard, it is possible for faculty to be assured that the material is reachable to a wide audience by checking reading grade level and providing additional guidance for the more difficult items in the form of discussion or focused questions. Authors can use the formulas as a tool to check the quality of their own writing and improve sections which are unnecessarily complex.

Author(s):  
James C. Brewer

Reading Grade Level calculations have been in use for over a century in the United States and have guided the selection of texts used in school programs. Government agencies at all levels, the military in its various branches, and editors of publications have found such formulas of use in setting policy or determining who can participate in programs. As readership is now a worldwide phenomenon with English as the primary language of the Internet, Reading Grade Level calculations can also be useful in creating Web pages and assigning reading texts to large multi-user classes (MOOCs) run over the Internet. In this regard, it is possible for faculty to be assured that the material is reachable to a wide audience by checking Reading Grade Level and providing additional guidance for the more difficult items in the form of discussion or focused questions. Authors can use the formulas as a tool to check the quality of their own writing and improve sections which are unnecessarily complex.


Author(s):  
Michael Xie ◽  
Jason Young ◽  
Collin May

Purpose To determine the availability and readability of online patient information (OPI) provided by paediatric hospitals in the United States using clubfoot as a model condition Methods The websites of the top 95 paediatric hospitals identified using US News & World Report were included. The names of paediatric hospitals and the terms “clubfoot”, “clubfeet” and “talipes equinovarus” were entered into the Google search engine. Readability was assessed using five validated metrics and the composite grade level (CGL). The number of unpaid monthly visits was calculated with the Ahrefs Organic Traffic Score (OTS) tool. Data for paediatric hospitals were compared with the same metrics for the top ten Google search results. Results Of 95 paediatric hospitals, 29 (30.5%) did not have at least one web page dedicated to clubfoot. The 128 web pages representing 66 paediatric hospitals had an average CGL of 9.4, representing a readability level requiring some high school education. The mean OTS for all paediatric hospitals was 116 estimated visits per month, which was significantly less than that for the top ten Google clubfoot search results (3035.1; p < 0.0001). Conclusion Paediatric hospital web pages on clubfoot were visited much less frequently than those from the top ten Google search results. Only two web pages (1.6%) from paediatric hospitals offered OPI on clubfoot that met the American Medical Association recommended reading level (sixth-grade level). Paediatric hospitals should create OPI on clubfoot with appropriate readability and accessibility for patient families. Level of Evidence N/A


2009 ◽  
Vol 36 (1) ◽  
pp. 41-49 ◽  
Author(s):  
ANDREW E. THOMPSON ◽  
SARA L. GRAYDON

ObjectiveWith continuing use of the Internet, rheumatologists are referring patients to various websites to gain information about medications and diseases. Our goal was to develop and evaluate a Medication Website Assessment Tool (MWAT) for use by health professionals, and to explore the overall quality of methotrexate information presented on common English-language websites.MethodsIdentification of websites was performed using a search strategy on the search engine Google. The first 250 hits were screened. Inclusion criteria included those English-language websites from authoritative sources, trusted medical, physicians’, and common health-related websites. Websites from pharmaceutical companies, online pharmacies, and where the purpose seemed to be primarily advertisements were also included. Product monographs or technical-based web pages and web pages where the information was clearly directed at patients with cancer were excluded. Two reviewers independently scored each included web page for completeness and accuracy, format, readability, reliability, and credibility. An overall ranking was provided for each methotrexate information page.ResultsTwenty-eight web pages were included in the analysis. The average score for completeness and accuracy was 15.48 ± 3.70 (maximum 24) with 10 out of 28 pages scoring 18 (75%) or higher. The average format score was 6.00 ± 1.46 (maximum 8). The Flesch-Kincaid Grade Level revealed an average grade level of 10.07 ± 1.84, with 5 out of 28 websites written at a reading level less than grade 8; however, no web page scored at a grade 5 to 6 level. An overall ranking was calculated identifying 8 web pages as appropriate sources of accurate and reliable methotrexate information.ConclusionWith the enormous amount of information available on the Internet, it is important to direct patients to web pages that are complete, accurate, readable, and credible sources of information. We identified web pages that may serve the interests of both rheumatologists and patients.


2018 ◽  
Vol 6 (11) ◽  
pp. 232596711880538 ◽  
Author(s):  
Rafael Kakazu ◽  
Adam Schumaier ◽  
Chelsea Minoughan ◽  
Brian Grawe

Background: Appropriate education on the disease processes associated with orthopaedic pathology can affect patient expectations and functional outcome. Hypothesis: Patient education resources from the American Orthopaedic Society for Sports Medicine (AOSSM) are too complex for comprehension by the average orthopaedic patient. Study Design: Cross-sectional study. Methods: Patient education resources provided by the AOSSM were analyzed with software that provided 10 readability scores as well as opportunities for improving readability. The readability scores were compared with the recommended eighth-grade reading level. Results: A total of 39 patient education resources were identified and evaluated. The mean ± SD reading grade-level scores were as follows: Coleman-Liau Index, 12.5 ± 1.11; New Dale-Chall Readability Formula, 10.9 ± 1.37; Flesch-Kincaid Grade Level, 9.9 ± 1.06; FORCAST Readability Formula, 11.4 ± 0.51; Fry Readability Formula, 12.8 ± 2.79; Gunning Fog Index, 11.9 ± 1.37; Raygor Readability Index, 13.1 ± 2.37; Simple Measure of Gobbledygook, 12.3 ± 0.90; Automated Readability Index, 11.2 ± 1.18; and New Automated Readability Index, 10.6 ± 1.27. After averaging the reading grade-level scores, only 1 patient education resource was found to be written at an 8th- to 9th-grade level, and 14 (36%) were written above a 12th-grade level. All scores were significantly different from the eighth-grade level ( P < .0065). The percentage of complex words and long words were 19.6% ± 2.67% and 41.4% ± 3.18%, respectively. Conclusion: Patient education resources provided by the AOSSM are at a significantly higher reading level than recommended. Simple changes can drastically improve these scores to increase health literacy and possibly outcome.


2021 ◽  
pp. 019459982110332
Author(s):  
Joo Hyun Kim ◽  
Elysia Grose ◽  
Justine Philteos ◽  
David Forner ◽  
Christopher W. Noel ◽  
...  

Objective Patient education materials across 3 national English otolaryngology–head and neck surgery (OHNS) societies: the American Academy of Otolaryngology–Head and Neck Surgery (AAO-HNS), the Canadian Society of Otolaryngology–Head and Neck Surgery (CSOHNS), and Ear, Nose, and Throat United Kingdom (ENT UK) were examined to determine whether they are written at a level suitable for patient comprehension. Study Design Cross-sectional study. Setting Online patient materials presented through OHNS national societies. Methods Readability was calculated using the Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease Score, and Simple Measure of Gobbledygook Index. All public patient education materials available through the CSOHNS, AAO-HNS, and ENT UK websites were assessed. Patient education materials were grouped into categories by subspecialty. Results In total, 128 patient materials from the 3 societies were included in the study. All 3 societies required a minimum grade 9 reading comprehension level to understand their online materials. According to Flesch-Kincaid Grade Level, the CSOHNS required a significantly higher reading grade level to comprehend the materials presented when compared to AAO-HNS (11.3 vs 9.9; 95% CI, 0.5-2.4; P < .01) and ENT UK (11.3 vs 9.4; 95% CI, 0.9-2.9; P < .01). Patient education materials related to rhinology were the least readable among all 3 societies. Conclusion This study suggests that the reading level of the current patient materials presented through 3 national OHNS societies are written at a level that exceeds current recommendations. Promisingly, it highlights an improvement for the readability of patient materials presented through the AAO-HNS.


2018 ◽  
Vol 33 (5) ◽  
pp. 487-492 ◽  
Author(s):  
Lubna Daraz ◽  
Allison S. Morrow ◽  
Oscar J. Ponce ◽  
Wigdan Farah ◽  
Abdulrahman Katabi ◽  
...  

Online health information should meet the reading level for the general public (set at sixth-grade level). Readability is a key requirement for information to be helpful and improve quality of care. The authors conducted a systematic review to evaluate the readability of online health information in the United States and Canada. Out of 3743 references, the authors included 157 cross-sectional studies evaluating 7891 websites using 13 readability scales. The mean readability grade level across websites ranged from grade 10 to 15 based on the different scales. Stratification by specialty, health condition, and type of organization producing information revealed the same findings. In conclusion, online health information in the United States and Canada has a readability level that is inappropriate for general public use. Poor readability can lead to misinformation and may have a detrimental effect on health. Efforts are needed to improve readability and the content of online health information.


2020 ◽  
Vol 7 (6) ◽  
pp. 1331-1335
Author(s):  
Casey M O’Connor ◽  
Joost Kortlever ◽  
David Ring

This study investigated handouts regarding common upper extremity problems for inaccuracies, distracting information, and concepts that reinforce common unhelpful cognitive biases. We reviewed handouts on upper extremity conditions from 2 electronic medical records and 2 professional associations. We categorized information as inaccurate, distracting, and risk of reinforcing common unhelpful cognitive biases. Reading level, quality, and the ability of patients to process and take action was also rated. We found an average rate of inaccurate statements of 1.9 per 100 words, distracting statements of 0.73 per 100 words, and statements reinforcing common unhelpful cognitive biases of 2.1 per 100 words. Handouts from electronic medical records were rated higher quality and had higher reading grade level, but on average were constructed for better understandability. Patient handouts have a notable rate of inaccuracies, distractions, and information that may reinforce less adaptive cognitions. Greater attention is merited to making patient handouts readable, understandable, hopeful, and enabling.


2010 ◽  
Vol 7 (3) ◽  
pp. 375-380 ◽  
Author(s):  
Lorraine S. Wallace ◽  
Kenneth Bielak ◽  
Brian Linn

Background:We evaluated readability and related features of English-language instructions accompanying pedometers, including reading grade level, layout/formatting characteristics, and emphasis of key points.Methods:We identified 15 pedometers currently available for purchase in the US. Reading grade level was calculated using Flesch-Kinkaid (FK) and SMOG formulas. Text point size was measured with a C-Thru Ruler. Page and illustration dimensions were measured to the nearest millimeter (mm) with a standard ruler. Layout features were evaluated using the criteria from the User-Friendliness Tool.Results:FK scores ranged from 8th to 11th grade, while SMOG scores ranged from 8th to 12th grade. Text point size averaged 6.9 ± 1.9 (range = 4−11). Instructions averaged 8.7 ± 9.0 (range = 0−36) illustrations, most about the size of a US quarter. While many instructions avoided use of specialty fonts (n = 12; 80.0%), most used a minimal amount of white space. Just 4 (26.7%) sets of instructions highlighted the target goal of 10,000 steps-per-day.Conclusion:Pedometer instructions should be revised to meet the recommended 6th grade reading level. Paper size instructions are printed on should be enlarged, thereby allowing for larger text and illustrations, and additional white space. Recommended number of steps per day and proper pedometer positioning should also be predominantly highlighted.


2021 ◽  
Vol 8 ◽  
pp. 237437352110564
Author(s):  
Shayan Hosseinzadeh ◽  
Philip Blazar ◽  
Brandon E Earp ◽  
Dafang Zhang

Dupuytren's contracture is a common hand pathology for which consultation and treatment are largely at the patient's discretion. The objective of this study was to evaluate the readability of current online patient information regarding Dupuytren's contracture. The largest public search engines (Google, Yahoo, and Bing) were queried using the search terms “Dupuytren's contracture,” “Dupuytren's disease,” “Viking's disease,” and “bent finger.” The first 30 unique websites by each search were analyzed and readability assessed using five established algorithms: Flesch Reading Ease, Gunning-Fog Index, Flesch–Kincaid Grade level, Coleman–Liau index, and Simple Measure of Gobbledygook grade level. Analysis of 73 websites demonstrated an average Flesch Reading Ease score of 48.6 ± 8.0, which corresponds to college reading level. The readability of websites ranged from 10.5 to 13.3 reading grade level. No article was written at or below the recommended sixth grade reading level. Information on the internet on Dupuytren's contracture is written at higher than recommended reading grade level. There is a need for high-quality patient information on Dupuytren's contracture at appropriate reading grade levels for patients of various health literacy backgrounds. Hospitals, universities, and academic organizations focused on the development of readable online information should consider patients’ input and preferences.


2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0010
Author(s):  
Ashley N. Marshall ◽  
Kenneth C. Lam

Background: The assessment of patient outcomes in pediatric (ie, youth and adolescent) athletes is critical for comprehensive and whole person healthcare. The Disablement of the Physically Active scale (DPA) is a relatively new generic patient-reported outcome measure (PROM) that was designed specifically for athletic and highly functional patient populations. While the DPA has been used to evaluate health-related quality of life (HRQOL) in adults, little is known about its use in pediatric athletes. The selection of PROMs for pediatric athletes presents with unique challenges, particularly regarding the ability of these athletes to effectively understand the instruments to which they are completing. Therefore, the purpose of this study was to examine the readability of the DPA in pediatric athletes through (1) participant-based and (2) computer-based analyses. Methods: Participant-based analysis was utilized to conduct a preliminary investigation into the subjective readability (ie, a participant’s perceived ability to successfully read the material) of the DPA. Participants were youth athletes (n=13, age=8.7±1.3 years) recruited from a local community athletics league. An investigator administered the San Diego Quick Assessment of Reading Ability to determine each participant’s current reading grade level. Participants were then instructed to read each item of the DPA and circle any words that they did not understand. Frequency counts and percentages were determined for each word identified by participants, within each item of the DPA. Computer-based analysis was utilized to assess the objective readability of the DPA. The Flesch Reading Ease (FRE), Flesch-Kincaid Reading Level (FK), and Gunning Fog Index (FOG) scores were calculated for each item of the DPA. FRE scores range from 0 to 100, with lower scores indicating more difficult reading material. The FRE score is converted to an approximate reading level (FK), ranging from pre-primer (<0) to college (>12), with higher reading level indicating more difficult reading material. Similar to the FK formula, the FOG formula computes to an approximate reading grade level associated with the U.S. education system. Summary statistics (mean± standard deviation, median, and range) were used to report scores for each DPA item. We also reported the number (%) of items that exceeded the 5th – 6th grade reading level, which is the maximum recommended threshold for pediatric patients. Results: It was determined that the average reading grade level of the participants was 3±1.4 years. In regards to subjective readability, participants did not understand an average of 22.1% (48.3/219 words) of the entire DPA scale, with a range across items of 3.1% (Pain = 0.15/5 words) to 34.9% (Overall Fitness = 5.2/15 words). There were 40 instances where greater than 50% of the participants did not recognize a word, and seven words throughout the scale that 100% (13/13) of the participants did not understand: endurance, stability, pivoting, coordination, cardiovascular, endurance and colleagues. For objective readability, FRE scores ranged from 5.8 (very confusing) to 119.7 (very easy) across items. The mean and median across all items was 42.4±33.4 (difficult), and 41.4 (difficult), respectively. The FK reading level ranged from -2.8 (pre-primer) to 13.8 (college), with a mean score of 8.8±4.8 and median score of 8.9. The FOG reading level ranged from 1 (1st grade) to 13.8 (college), with a mean score of 9.3±3.8 and median score of 10.5. When considering both the FK and FOG scores, 81.8% (9/11) of the items exceeded the 5th – 6th grade reading level threshold. Conclusions/Significance: These findings indicate that the overall readability of the DPA may not be appropriate for pediatric athletes. Thus, findings using the DPA in pediatric athletes for clinical or research purposes should be interpreted with caution. Future research is warranted to develop a pediatric version of the DPA, utilizing the results of this study for guidance, as no other generic PROM currently exist for assessing HRQOL specifically in youth and adolescent athletes.


Sign in / Sign up

Export Citation Format

Share Document