Investigating Test-Taking Strategies in Listening Assessment: A Comparative Study of Eye-Tracking and Self-Report Questionnaires

Author(s):  
Andralyn Rui Lin Low ◽  
Vahid Aryadoust
Author(s):  
Federico Cassioli ◽  
Laura Angioletti ◽  
Michela Balconi

AbstractHuman–computer interaction (HCI) is particularly interesting because full-immersive technology may be approached differently by users, depending on the complexity of the interaction, users’ personality traits, and their motivational systems inclination. Therefore, this study investigated the relationship between psychological factors and attention towards specific tech-interactions in a smart home system (SHS). The relation between personal psychological traits and eye-tracking metrics is investigated through self-report measures [locus of control (LoC), user experience (UX), behavioral inhibition system (BIS) and behavioral activation system (BAS)] and a wearable and wireless near-infrared illumination based eye-tracking system applied to an Italian sample (n = 19). Participants were asked to activate and interact with five different tech-interaction areas with different levels of complexity (entrance, kitchen, living room, bathroom, and bedroom) in a smart home system (SHS), while their eye-gaze behavior was recorded. Data showed significant differences between a simpler interaction (entrance) and a more complex one (living room), in terms of number of fixation. Moreover, slower time to first fixation in a multifaceted interaction (bathroom), compared to simpler ones (kitchen and living room) was found. Additionally, in two interaction conditions (living room and bathroom), negative correlations were found between external LoC and fixation count, and between BAS reward responsiveness scores and fixation duration. Findings led to the identification of a two-way process, where both the complexity of the tech-interaction and subjects’ personality traits are important impacting factors on the user’s visual exploration behavior. This research contributes to understand the user responsiveness adding first insights that may help to create more human-centered technology.


2010 ◽  
Vol 42 (2) ◽  
pp. 232-246 ◽  
Author(s):  
Sanda Stankovic ◽  
Dejan Lalovic

Standardized reading comprehension tests (RCTs) usually consist of a small number of texts each accompanied by several multiple-choice questions, with texts and questions simultaneously presented. The score the common measure of reading comprehension ability in RCTs is the score. Literature review suggests that strategies subjects employ may influence their performance on RCT, however the score itself provides no information on the specific strategy employed. Knowledge of test-taking strategies could have impact on understanding of the actual purpose and benefits of using RCTs in pedagogical and psychological practice. With the ultimate objective of constructing a first standard RCT in Serbian language, the preliminary step we took was to conduct an experimental reading comprehension task (ERCT) consisting of 27 short texts displayed in succession, each followed by a single multiplechoice question. Using qualitative analysis of subjects? responses in semi-structured postexperimental interview, we identified four overall strategies used on ERCT. Our results show that groups of students who used specific strategies differed significantly from one another in text reading time, with no differences found regarding the question reading and answering time. More importantly, there were no significant between-group differences found in terms of ERCT score. These findings suggest that choice of strategy is a way to optimize the relation between one?s own potential and ERCT task requirements. RCT based on ERCT principles would allow for a flexible choice of strategy which would not influence the final score.


2019 ◽  
pp. 269-294
Author(s):  
Pedro Rodrigues ◽  
Pedro J. Rosa

A large body of educational research has been keen to the processes and outcomes of learning. Usually, clinical interviews, self-report measures or behavioral assessment procedures have been the most frequently used techniques to assess cognitive activities during learning. Equally, such approaches often suffer from validity issues. The eye-tracking methodology can be used to overcome some limitations in the study of cognitive processes linked to learning and performance. Therefore, this chapter aims to show how eye movement studies can be used to link ocular metrics to learning processes (e.g. language acquisition, reading, memory). The authors cover a topic that ranges from the paradigm shift in the theories of learning, through eye movement applications and measures, to the contribution of eye tracking methodology to investigate learning processes in educational settings.


Author(s):  
Pedro Rodrigues ◽  
Pedro J. Rosa

A large body of educational research has been keen to the processes and outcomes of learning. Usually, clinical interviews, self-report measures or behavioral assessment procedures have been the most frequently used techniques to assess cognitive activities during learning. Equally, such approaches often suffer from validity issues. The eye-tracking methodology can be used to overcome some limitations in the study of cognitive processes linked to learning and performance. Therefore, this chapter aims to show how eye movement studies can be used to link ocular metrics to learning processes (e.g. language acquisition, reading, memory). The authors cover a topic that ranges from the paradigm shift in the theories of learning, through eye movement applications and measures, to the contribution of eye tracking methodology to investigate learning processes in educational settings.


Author(s):  
Eva Bumbálková

This work focuses on the test-taking strategies employed by STANAG 6001 English exam candidates in receptive skills tests and on how these strategies are employed. The qualitative analysis reveals that candidates have their preferred strategy of dealing with test items, they use a number of test-management and test-wiseness strategies, and that the use of a particular strategy depends on a number of factors.


Author(s):  
Jiaying Liu ◽  
Joe Phua ◽  
Dean Krugman ◽  
Linjia Xu ◽  
Glen Nowak ◽  
...  

Abstract Introduction In October 2019, a heated tobacco product (HTP) IQOS debuted in the United States. This study examined young adults’ attention and cognitions in response to an IQOS ad that carried two mandated textual health warnings (Surgeon General’s warning and nicotine warning), and how their vaping and smoking status may interact with attention patterns to affect attitude and intention to use IQOS. Methods In November 2019, college students (N=164) viewed IQOS’ first U.S. magazine ad and two distractor ads. Viewing patterns were recorded with eye-tracking. Masked recall and aided recognition, attitude and intention towards IQOS use were later assessed with self-report. OLS regressions and moderated mediation analyses examined the associations between visual attention and viewers’ cognitions about IQOS use. Results Promotional content attracted significantly more attention compared to the warnings. Attention to the Surgeon General’s warning but not to the nicotine warning was associated with recall and recognition of the warning’s content. For ever-vapers, greater attention allocation to the promotional content in the IQOS ad was associated with more favorable attitude toward IQOS use, which was in turn positively associated with intention to use IQOS. Attention allocation to the warnings did not affect attitude or intentions, regardless of tobacco use status. Conclusions The results revealed the effects of IQOS promotional content overshadowed the two health warnings in influencing young people’s attitude and intention to use IQOS. Young adults who vaped were more vulnerable to HTP advertising with respect to future use and vaping may be a gateway to HTP use. Implications This is the first eye-tracking study examining attention and cognitions associated with the new IQOS ad exposure among young adults. Promotional content in the ad attracted significantly more attention than the two warnings combined. Attention to the Surgeon General’s warning but not to the nicotine warning was associated with recall and recognition of the warning’s content. Greater attention allocation to the promotional content led to more favorable attitude toward IQOS use which was associated with increased intention to use IQOS for ever vapers. However, greater attention allocation to the warnings did not affect attitude or intentions to use IQOS.


Sign in / Sign up

Export Citation Format

Share Document