scholarly journals Investigating the construct measured by banked gap-fill items: Evidence from eye-tracking

2016 ◽  
Vol 35 (1) ◽  
pp. 51-73 ◽  
Author(s):  
Gareth McCray ◽  
Tineke Brunfaut
Keyword(s):  
Eye Tracking ◽  
Cognitive Processing ◽  
Cognitive Processes ◽  
Reading Proficiency ◽  
Cognitive Effort ◽  
Test Design ◽  
Task Processing ◽  
And Task

This study investigates test-takers’ processing while completing banked gap-fill tasks, designed to test reading proficiency, in order to test theoretically based expectations about the variation in cognitive processes of test-takers across levels of performance. Twenty-eight test-takers’ eye traces on 24 banked gap-fill items (on six tasks) were analysed according to seven online eye-tracking measures representing overall, text and task processing. Variation in processing was related to test-takers’ level of performance on the tasks overall. In particular, as hypothesized, lower-scoring students exerted more cognitive effort on local reading and lower-level cognitive processing in contrast to test-takers who attained higher scores. The findings of different cognitive processes associated with variation in scores illuminate the construct measured by banked gap-fill items, and therefore have implications for test design and the validity of score interpretations.

scholarly journals Gaze and eye movement in dialogue interpreting: An eye-tracking study

2020 ◽  
Vol 23 (4) ◽  
pp. 780-787 ◽  
Author(s):  
Elisabet Tiselius ◽  
Kayle Sneed
Keyword(s):  
Eye Tracking ◽  
Cognitive Load ◽  
Eye Movement ◽  
Cognitive Processes ◽  
Cognitive Effort ◽  
Simultaneous Interpreting ◽  
Gaze Patterns ◽  
Averted Gaze

AbstractPrevious studies have investigated the cognitive processes of simultaneous interpreting and translation using eye-tracking. No study has yet utilized eye-tracking to investigate cognitive load and cognitive effort in dialogue interpreting. An eye-tracking study was conducted on two groups of interpreters (experienced and inexperienced) with varying language backgrounds during a staged dialogue interpreting session. The aim of the study was to explore gaze patterns in dialogue interpreting in relation to the interpreters’ action and translation direction. The results indicated there were differences in gaze patterns depending on the action and the language used. Participants averted gaze more when interpreting into the allophone language (the L2 for a majority of the participants in this study). This may indicate that interpreting into L2 in a dialogue may involve more cognitive effort than interpreting into L1. Finally, gaze patterns did not differ significantly between inexperienced and experienced dialogue interpreters.

scholarly journals Listening Effort Informed Quality of Experience Evaluation

2022 ◽  
Vol 12 ◽  
Author(s):  
Pheobe Wenyi Sun ◽  
Andrew Hines
Keyword(s):  
Cognitive Science ◽  
Cognitive Processing ◽  
Cognitive Processes ◽  
Quality Of Experience ◽  
Perceived Quality ◽  
Cognitive Effort ◽  
General Definition ◽  
Contributing Factors ◽  
The Impact

Perceived quality of experience for speech listening is influenced by cognitive processing and can affect a listener's comprehension, engagement and responsiveness. Quality of Experience (QoE) is a paradigm used within the media technology community to assess media quality by linking quantifiable media parameters to perceived quality. The established QoE framework provides a general definition of QoE, categories of possible quality influencing factors, and an identified QoE formation pathway. These assist researchers to implement experiments and to evaluate perceived quality for any applications. The QoE formation pathways in the current framework do not attempt to capture cognitive effort effects and the standard experimental assessments of QoE minimize the influence from cognitive processes. The impact of cognitive processes and how they can be captured within the QoE framework have not been systematically studied by the QoE research community. This article reviews research from the fields of audiology and cognitive science regarding how cognitive processes influence the quality of listening experience. The cognitive listening mechanism theories are compared with the QoE formation mechanism in terms of the quality contributing factors, experience formation pathways, and measures for experience. The review prompts a proposal to integrate mechanisms from audiology and cognitive science into the existing QoE framework in order to properly account for cognitive load in speech listening. The article concludes with a discussion regarding how an extended framework could facilitate measurement of QoE in broader and more realistic application scenarios where cognitive effort is a material consideration.

Processing Forced-choice versus Check-all-that-apply Question Formats

Field Methods ◽  
2017 ◽  
Vol 29 (4) ◽  
pp. 383-394 ◽  
Author(s):  
Cornelia E. Neuert
Keyword(s):  
Eye Tracking ◽  
Cognitive Processes ◽  
Forced Choice ◽  
Cognitive Effort ◽  
Tracking Data ◽  
Question Format ◽  
Factual Question ◽  
Question Formats

Previous research has shown that check-all-that-apply (CATA) and forced-choice (FC) question formats do not produce comparable results. The cognitive processes underlying respondents’ answers to both types of formats still require clarification. This study contributes to filling this gap by using eye-tracking data. Both formats are compared by analyzing attention processes and the cognitive effort respondents spend while answering one factual and one opinion question, respectively. No difference in cognitive effort spent on the factual question was found, whereas for the opinion question, respondents invested more cognitive effort in the FC than in the CATA condition. The findings indicate that higher endorsement in FC questions cannot only be explained by question format. Other possible causes are discussed.

scholarly journals A comparison of the performance on extrinsic and intrinsic cartographic visualizations through correctness, response time and cognitive processing

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0250164
Author(s):  
Čeněk Šašinka ◽  
Zdeněk Stachoň ◽  
Jiří Čeněk ◽  
Alžběta Šašinková ◽  
Stanislav Popelka ◽  
...  
Keyword(s):  
Soil Moisture ◽  
Response Time ◽  
Eye Tracking ◽  
Cognitive Processing ◽  
Cognitive Processes ◽  
Soil Depth ◽  
Error Rates ◽  
Eye Tracker ◽  
Map Reading ◽  
Social Sciences And Humanities

The aim of this study was to compare the performance of two bivariate visualizations by measuring response correctness (error rate) and response time, and to identify the differences in cognitive processes involved in map-reading tasks by using eye-tracking methods. The present study is based on our previous research and the hypothesis that the use of different visualization methods may lead to significant cognitive-processing differences. We applied extrinsic and intrinsic visualizations in the study. Participants in the experiment were presented maps which depicted two variables (soil moisture and soil depth) and asked to identify the areas which displayed either a single condition (e.g., “find an area with low soil depth”) or both conditions (e.g., “find an area with high soil moisture and low soil depth”). The research sample was composed of 31 social sciences and humanities university students. The experiment was performed under laboratory conditions, and Hypothesis software was used for data collection. Eye-tracking data were collected for 23 of the participants. An SMI RED-m eye-tracker was used to determine whether either of the two visualization methods was more efficient for solving the given map-reading tasks. Our results showed that with the intrinsic visualization method, the participants spent significantly more time with the map legend. This result suggests that extrinsic and intrinsic visualizations induce different cognitive processes. The intrinsic method was observed to generally require more time and led to higher error rates. In summary, the extrinsic method was found to be more efficient than the intrinsic method, although the difference was less pronounced in the tasks which contained two variables, which proved to be better suited to intrinsic visualization.

scholarly journals Eye-tracking test design influences the relationship between gazing behaviour and evaluation decision

2018 ◽  
Vol 68 (4) ◽  
pp. 261-270
Author(s):  
Thi Minh Hang Vu ◽  
Viet Phu Tu ◽  
Klaus Duerrschmid
Keyword(s):  
Decision Making ◽  
Eye Tracking ◽  
Cognitive Processes ◽  
Test Design ◽  
Consumer Decision Making ◽  
Eye Tracker ◽  
Choice Tests ◽  
Evaluation Decision ◽  
Design Factors ◽  
The Relationship

Summary Recent research has revealed a correlation between consumer gazing behaviour and decision-making in eye-tracking tests, which suggested a predictability decision-making from gazing behaviour. Since the eye-tracking test design has been reported to have an effect on gazing behaviour, the objective of this work is therefore to study systematically whether the test design influences the relationship between choice and gazing. Using a Tobii-T60 Eye Tracker, 100 persons participated in eye-tracking tests working on food images. Two design factors were tested: 1) Type of evaluation (maximum choice, minimum choice, ranking, and rating); 2) Question content (deliciousness, healthiness,prices, and familiarity). The results showed that the correlation between decision-making and gazing behaviour is influenced by both Type of evaluation and Question content. Only in the choice tests, a significant correlation between gazing behaviour and consumer decision-making was found. No correlation was found in the question content group Prices, but a very strong correlation existed in the three other question content groups. The results are discussed considering the relationship between visual attention and cognitive processes in decision-making.

Cognitive Processing of Miscommunication in Interactive Listening: An Evaluation of Listener Indecision and Cognitive Effort

2021 ◽  
pp. 1-17
Author(s):  
Jennifer M. Roche ◽  
Arkady Zgonnikov ◽  
Laura M. Morett
Keyword(s):  
Decision Making ◽  
Cognitive Processing ◽  
Language Processing ◽  
Cognitive Effort ◽  
Mouse Tracking ◽  
Computer Mouse ◽  
Decision Making Processes ◽  
Computer Mouse Tracking ◽  
Listening Task ◽  
Processing Effort

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse–tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

If Eyes are the Window to Our Soul, What Role does Eye-Tracking Play in Accounting Research?

2018 ◽  
Vol 31 (2) ◽  
pp. 107-133 ◽  
Author(s):  
Edward J. Lynch ◽  
Lindsay M. Andiola
Keyword(s):  
Eye Tracking ◽  
Cognitive Processes ◽  
Research Tool ◽  
Future Research ◽  
Behavioral Accounting ◽  
Research Directions ◽  
Psychological Constructs ◽  
Instructional Resource ◽  
Future Research Directions ◽  
Research Domains

ABSTRACT Recent advances in technology have increased the accessibility and ease in using eye-tracking as a research tool. These advances have the potential to benefit behavioral accounting researchers' understanding of the cognitive processes underlying individuals' judgments, decisions, and behaviors. However, despite its potential and wide use in other disciplines, few behavioral accounting studies use eye-tracking. The purpose of this paper is to familiarize accounting researchers with eye-tracking, including its advantages and limitations as a research tool. We start by providing an overview of eye-tracking and discussing essential terms and useful metrics, as well as the psychological constructs they proxy. We then summarize eye-tracking research across research domains, review accounting studies that use eye-tracking, and identify future research directions across accounting topics. Finally, we provide an instructional resource to guide those researchers interested in using eye-tracking, including important considerations at each stage of the study. JEL Classifications: M41; C91.

scholarly journals Effects of age on memory for pragmatic implications in advertising

2021 ◽  
Vol 15 ◽  
pp. 183449092110004
Author(s):  
Jing Yu ◽  
Xue-Rui Peng ◽  
Ming Yan
Keyword(s):  
Older Adults ◽  
Eye Tracking ◽  
Cognitive Processes ◽  
Time Processing ◽  
Movement Data ◽  
Processing Strategies ◽  
Health Related ◽  
Advertising Content ◽  
Inferential Processing ◽  
Tracking Technology

People employ automatic inferential processing when confronting pragmatically implied claims in advertising. However, whether comprehension and memorization of pragmatic implications differ between young and older adults is unclear. In the present study, we used eye-tracking technology to investigate online cognitive processes during reading of misleading advertisements. We found an interaction between age and advertising content, manifested as our older participants generated higher misleading rates in health-related than in health-irrelevant products, whereas this content-bias did not appear in their younger counterparts. Eye movement data further showed that the older adults spent more time processing critical claims for the health-related products than for the health-irrelevant products. Moreover, the correlations between fixation duration on pragmatic implications and misleading rates showed opposite trends in the two groups. The eye-tracking evidence novelly suggests that young and older adults may adopt different information processing strategies to comprehend pragmatic implications in advertising: More reading possibly enhances young adults’ gist memory whereas it facilitates older adults’ verbatim memory instead.

Achievement in School in Relation to Simultaneous and Sequential Cognitive Processes among Young Egyptian Students

1997 ◽  
Vol 84 (3_suppl) ◽  
pp. 1139-1148 ◽  
Author(s):  
Fadia Z. Elwan
Keyword(s):  
Cognitive Processing ◽  
Cognitive Processes ◽  
Sequential Analysis ◽  
School Achievement ◽  
Reading Scores ◽  
Sequential Processing ◽  
Simultaneous Synthesis ◽  
And Performance ◽  
The Relationship ◽  
Reading Decoding

The present study was designed to examine whether a relationship exists between scores on simultaneous and sequential cognitive processes, on one hand, and performance on the Reading Decoding and Arithmetic subtests of the Kaufman Assessment Battery for Children (K–ABC), on the other hand, using a sample of 170 Egyptian school children in Grades 1, 3, and 5. To examine the differential magnitudes of the relationship between scores for cognitive processing and school achievement a two by two (simultaneous × sequential) analysis of variance was calculated with reading decoding and arithmetic scores as dependent variables. The results indicated that cognitive processing, especially simultaneous synthesis, is related to arithmetic as well as decoding during reading. Scores on sequential processing were not significantly related to scores for decoding reading and may not be important as simultaneous processing for mathematical skills. The findings were interpreted in the context of the Arabic orthographic system and in view of the nature of the cognitive and mathematical tasks employed in this study.

Sign in / Sign up

Export Citation Format

Share Document