scholarly journals Verbal Reports as Measures of Comprehension Evaluation

1989 ◽  
Vol 21 (3) ◽  
pp. 295-307 ◽  
Author(s):  
DeWayne Moore ◽  
Karen Zabrucky

The present study assessed several commonly used measures of children's comprehension evaluation ability. Third and sixth grade higher and lower ability readers (N= 120) read texts that either contained an inconsistency or did not. Following each passage reading, six measures of comprehension evaluation were obtained: one performance measure and five commonly used verbal report measures. The results revealed that different verbal report measures are not comparable measures of children's comprehension evaluation ability. The verbal report measures were differently affected by grade level, reading ability, and text variables. Moreover, the verbal report measures did not all relate equally to comprehension evaluation performance and relationships between verbal reports and performance were stronger for higher ability readers and young readers. The results suggest that caution is needed in interpreting studies using verbal report measures in isolation to assess children's evaluation skills, and that the use of poorly defined verbal report measures may be one factor contributing to inconsistent findings concerning the development of such skills.

1989 ◽  
Vol 21 (1) ◽  
pp. 69-83 ◽  
Author(s):  
Karen Zabrucky ◽  
Hilary Horn Ratner

Good and poor readers in the sixth grade ( M age = 11.92 years) were videotaped reading inconsistent stories presented one sentence at a time. Children's comprehension evaluation was assessed with on-line (reading times) and verbal report measures; comprehension regulation was assessed by examining look-backs during reading. All children read inconsistencies more slowly than consistent control information but good readers were more likely than poor readers to look back at inconsistencies during reading, to give accurate verbal reports of passage consistency following reading, and to recall text inconsistencies. Results highlight the importance of using multiple comprehension monitoring measures in assessing children's abilities and of treating comprehension monitoring as a multidimensional process.


1985 ◽  
Vol 17 (3) ◽  
pp. 235-252 ◽  
Author(s):  
Lawrence G. Erickson ◽  
Steven A. Stahl ◽  
Steven D. Rinehart

A number of researchers have suggested recently that differences between good and poor comprehenders lie in differences in metacognitive skills. This study examines one of the paradigms used to measure metacognitive skill–the error detection task. Seventy-four above and below grade level sixth graders were asked to detect order changes and nonsense word substitutions in third-grade and sixth-grade level passages. It was found that conceptual tempo (impulsivity/reflectivity), passage readability, and error type, as well as reading ability, all influenced the performance of these children on the error detection tasks. No differences were found between above and below average readers on two other metacognitive tasks, a reading difficulty judgment, and a knowledge and purposes of reading interview. Results indicate that conceptual tempo should be considered in any explanation of the relationship between metacognitive monitoring and reading ability.


1980 ◽  
Vol 12 (1) ◽  
pp. 31-40
Author(s):  
Mark Grabe

Fourth and sixth grade students grouped as good or poor readers were asked to read a story from a certain perspective or with instructions to read carefully. The ability to take a perspective, as measured by skill in differentiating important material on a highlighting task or in reproducing it on a later recall test, was present in both age groups. Reading skill was found to produce significant differences on both types of dependent measures. Further analysis indicated that reading ability differences in recall were related to, but could not be totally accounted for, by the ability to identify important material. A model is proposed claiming that poor readers are too overburdened by lower level reading skills to engage in this type of cognitive processing.


2019 ◽  
Vol 41 (3) ◽  
pp. 162-175 ◽  
Author(s):  
Patsy Nomvete ◽  
Susan R. Easterbrooks

The components involved in adolescent reading are complex and not clearly understood in struggling readers. Phrase reading, a language skill associated with prosodic understanding of syntactic phrases, has received little attention. We studied 70 adolescent readers including delayed readers to answer the following questions: (a) Do phrase-reading ability, syntactic awareness, passage-reading rate, and reading comprehension have a positive, significant correlation; (b) Do language-related variables (i.e., phrasing ability, syntactic awareness) account for more of the variance in comprehension than passage-reading rate; (c) Does phrase-reading ability, as measured by phrase-level prosody, provide a mechanism for, or at least partially mediate, how passage-reading rate and syntactic awareness affect reading comprehension? Data were analyzed using hierarchical regression and mediation regression. All answers were affirmative suggesting that researchers studying adolescent struggling readers should investigate prosodic phrasing-reading ability as a tool for improving reading comprehension.


2021 ◽  
Vol 18 (2) ◽  
pp. 1-17
Author(s):  
Shannon P. Devlin ◽  
Jennifer K. Byham ◽  
Sara Lu Riggs

Changes in task demands can have delayed adverse impacts on performance. This phenomenon, known as the workload history effect, is especially of concern in dynamic work domains where operators manage fluctuating task demands. The existing workload history literature does not depict a consistent picture regarding how these effects manifest, prompting research to consider measures that are informative on the operator's process. One promising measure is visual attention patterns, due to its informativeness on various cognitive processes. To explore its ability to explain workload history effects, participants completed a task in an unmanned aerial vehicle command and control testbed where workload transitioned gradually and suddenly. The participants’ performance and visual attention patterns were studied over time to identify workload history effects. The eye-tracking analysis consisted of using a recently developed eye-tracking metric called coefficient K , as it indicates whether visual attention is more focal or ambient. The performance results found workload history effects, but it depended on the workload level, time elapsed, and performance measure. The eye-tracking analysis suggested performance suffered when focal attention was deployed during low workload, which was an unexpected finding. When synthesizing these results, they suggest unexpected visual attention patterns can impact performance immediately over time. Further research is needed; however, this work shows the value of including a real-time visual attention measure, such as coefficient K , as a means to understand how the operator manages varying task demands in complex work environments.


Author(s):  
V. Vijaya Kishore ◽  
R.V.S. Satyanarayana

A vital necessity for clinical determination and treatment is an opportunity to prepare a procedure that is universally adaptable. Computer aided diagnosis (CAD) of various medical conditions has seen a tremendous growth in recent years. The frameworks combined with expanding capacity, the coliseum of CAD is touching new spaces. The goal of proposed work is to build an easy to understand multifunctional GUI Device for CAD that performs intelligent preparing of lung CT images. Functions implemented are to achieve region of interest (ROI) segmentation for nodule detection. The nodule extraction from ROI is implemented by morphological operations, reducing the complexity and making the system suitable for real-time applications. In addition, an interactive 3D viewer and performance measure tool that quantifies and measures the nodules is integrated. The results are validated through clinical expert. This serves as a foundation to determine, the decision of treatment and the prospect of recovery.


Stroke ◽  
2012 ◽  
Vol 43 (suppl_1) ◽  
Author(s):  
Crismely A Perdomo ◽  
Vepuka E Kauari ◽  
Elizabeth Suarez ◽  
Olajide Williams ◽  
Joshua Stillman ◽  
...  

Background and Purpose The literature demonstrates how utilizing evidence-based, standardized stroke care can improve patient outcomes; however, the contribution of electronic medical record (EMR) systems may also impact outcomes by ensuring utilization and compliance with established stroke performance measures, facilitating and improving documentation requirements, and standardizing approach to care. In 2008, documentation in patients’ medical records was done in combination of paper and a template free EMR. Originally, the EMR was used for order entry, then transitioned to full electronic documentation in 2009. At that time we implemented our stroke templates and performance measures based on regulatory standards. We hypothesized that the stroke template implementation would help us achieve performance measure criteria above state benchmarks as set out by the New York State Department of Health (NYS DOH). Methods Implementation was phased in [over 18 months], initially using a template that only included neurological assessment and free text fields for stroke measures. By July 2010, existing templates were modified and additional stroke templates were implemented to meet new regulatory requirements and meaningful use criteria. Retrospective data review was conducted for performance comparison between 2008 -- one year prior to EMR/template implementation -- and 2010. In Quarter 1 of 2011 EMR was also implemented in the Emergency Department (ED). Data was reviewed for compliance with stroke measures. Results Documentation compliance substantially improved between 2008 and Quarter 1 2011: Compliance for these measures has been maintained ≥ 85% since November 2010, ≥ 90% Q1 2011 Conclusions The EMR implementation of stroke templates and performance measures can produce substantial improvement in performance measure compliance. Future steps will include automated documentation alerts to retrieve information and real time discovery of missing documentation for concurrent quality review and improvement


2012 ◽  
Vol 70 (2) ◽  
pp. 140-144 ◽  
Author(s):  
Renato Nickel ◽  
Carlos Eduardo Silvado ◽  
Francisco Manoel Branco Germiniani ◽  
Luciano de Paola ◽  
Nicolle Lucena da Silveira ◽  
...  

Epilepsy causes restrictions in the performance of various daily activities. The aiming of this study was to investigate whether these restrictions affect the perceived quality of life. The assessments Quality of Life in Epilepsy-31 (QOLIE-31) and Canadian Occupational Performance Measure (COPM) were applied in a sample that consisted of a single group of 34 subjects with at least two years of uncontrolled seizures. The results indicated that the most affected domains of QOLIE-31 were seizure worry, 29.77 (±21.72), and effects of drugs, 49.75 (±28.58), and for the COPM, the average of performance and satisfaction were respectively 3.10 (±3.07) and 4.45 (±3.29), and performance limitations most frequently cited were maintain employment (18), left home alone (15) and courses (15). The application of the Spearman correlation coefficient showed that the three main performance limitations posed by the COPM, especially regarding the level of satisfaction, influence the perception of quality of life. Thus, occupational performance proves to be an important area of intervention with subjects with epilepsy.


1988 ◽  
Vol 10 (1) ◽  
pp. 45-61 ◽  
Author(s):  
Damon Burton

The purpose of this investigation was to utilize a multidimensional measure of anxiety and a more sensitive intraindividual performance measure to evaluate the relationship between anxiety and performance. Three hypotheses were tested. First, cognitive anxiety is more consistently and strongly related to performance than is somatic anxiety. Second, somatic anxiety demonstrates an inverted-U relationship with performance, whereas self-confidence and performance exhibit a positive linear relationship and cognitive anxiety and performance exhibit a negative one. Finally, short duration and high and low complexity events demonstrate stronger relationships between somatic anxiety and performance than do long duration or moderate complexity events. Two samples of swimmers completed the CSAI-2 prior to competition, and performance data were obtained from meet results. Correlational and multiple regression analyses generally supported Hypotheses 1 and 3, while polynomial trend analyses on standardized CSAI-2 scores confirmed trends predicted in Hypothesis 2. Overall, these results not only revealed that improved instrumentation allows demonstration of consistent anxiety-performance relationships, but they also provided additional construct validity for the CSAI-2.


Sign in / Sign up

Export Citation Format

Share Document