Cognitive Processing of Miscommunication in Interactive Listening: An Evaluation of Listener Indecision and Cognitive Effort

2021 ◽  
pp. 1-17
Author(s):  
Jennifer M. Roche ◽  
Arkady Zgonnikov ◽  
Laura M. Morett
Keyword(s):  
Decision Making ◽  
Cognitive Processing ◽  
Language Processing ◽  
Cognitive Effort ◽  
Mouse Tracking ◽  
Computer Mouse ◽  
Decision Making Processes ◽  
Computer Mouse Tracking ◽  
Listening Task ◽  
Processing Effort

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse–tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

An Evaluation of Listener Comprehension Indecision and Cognitive Effort When Unresolvable Ambiguity Leads to Miscommunication

2018 ◽  
Author(s):  
Jennifer M. Roche ◽  
Arkady Zgonnikov ◽  
Laura M. Morett
Keyword(s):  
Decision Making ◽  
Interpersonal Communication ◽  
Long Range ◽  
Language Processing ◽  
Perspective Taking ◽  
Cognitive Effort ◽  
Complexity Metrics ◽  
The Social ◽  
Decision Making Processes ◽  
Processing Effort

Miscommunication is pervasive in conversational interactions, having short- and long-range impacts on interpersonal communication. The evaluation of the social and cognitive underpinnings of miscommunication have received relatively less attention. Here we report two experiments investigating how a listener’s cognitive effort and decision-making processes were affected by a speaker’s use of ambiguity that led to a miscommunication. Both Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort. Moreover, findings from Experiment 2 indicated that listeners may develop different processing heuristics dependent upon the speaker’s use of ambiguity that led to miscommunication, exerting a significant impact on cognition and decision-making. For instance, we found that perspective taking effort and decision-making complexity metrics predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

scholarly journals Affective Effect: Issue Engagement on a Youth E-Participation Platform

2019 ◽  
Vol 11 (1) ◽  
pp. 37-58
Author(s):  
Thomas J. Lampoltshammer ◽  
Qinfeng Zhu ◽  
Peter Parycek
Keyword(s):  
Decision Making ◽  
Cognitive Processing ◽  
Citizen Participation ◽  
Common Type ◽  
System Level ◽  
Appraisal Theory ◽  
Economic Issues ◽  
Intelligence Theory ◽  
Decision Making Processes ◽  
Research Gap

While E-participation promotes citizen participation in democratic decision-making processes, and often takes place through deliberation, citizens are expected to be cool-headed individuals equipped with reason and logic, insulating their actions from the impulse of emotion. However, research in neuroscience and cognitive science has found that emotion plays a vital part in cognitive processing and is instrumental in decision-making. This study thus fills this research gap by examining the effect of emotions in eliciting participation on a youth E-participation platform. Following affective intelligence theory and appraisal theory, the authors specifically examined three types of emotions; namely, anger, anxiety, and sadness. By applying methods in the field of text and statistical analysis, the authors found that anxiety, although the least common type of emotion expressed on the E-participation platform, was associated with an increased level of engagement. On the contrary, anger dominated issue discussion across topics, and sadness prevailed in the discourse on system-level economic issues.

scholarly journals Hands-on false memories: A combined study with distributional semantics and mouse-tracking

2021 ◽  
Author(s):  
Daniele Gatti ◽  
Marco Marelli ◽  
Giuliana Mazzoni ◽  
Tomaso Vecchi ◽  
Luca Rinaldi
Keyword(s):  
Decision Making ◽  
False Memory ◽  
Semantic Similarity ◽  
Time Window ◽  
Recognition Task ◽  
Mouse Tracking ◽  
Decision Making Processes ◽  
Distributional Semantic Models ◽  
Temporal Measures ◽  
The Impact

Despite mouse-tracking has been taken as a real-time window into different aspects of human decision-making processes, currently little is known about how the decision process unfolds in veridical and false memory retrieval. Here, we directly investigated these processes by predicting participants’ performance in a mouse-tracking version of a typical Deese–Roediger–McDermott (DRM) task through distributional semantic models, a usage-based approach to meaning. Participants were required to study lists of associated words and then to perform a recognition task with the mouse. Results showed that mouse trajectories were extensively affected by the semantic similarity between the words presented in the recognition phase and the ones previously studied. In particular, the higher the semantic similarity, the larger the conflict driving the choice and the higher the irregularity in the trajectory when correctly rejecting new words (i.e., the false memory items). Conversely, on the temporal evolution of the decision, our results showed that semantic similarity affects more complex temporal measures indexing the online decision processes subserving task performance. Together, these findings demonstrate that semantic similarity can affect human behavior at the level of motor control, testifying its influence on online decision-making processes. More generally, our findings complement previous seminal theories on false memory and provide insights on the impact of the semantic memory structure on different decision-making components.

scholarly journals Using Eye-Tracking to Understand Decision-Making in Conjoint Experiments

2020 ◽  
Vol 29 (1) ◽  
pp. 75-101
Author(s):  
Libby Jenke ◽  
Kirk Bansak ◽  
Jens Hainmueller ◽  
Dominik Hangartner
Keyword(s):  
Decision Making ◽  
Eye Tracking ◽  
Cognitive Processing ◽  
Local Community ◽  
Relevant Information ◽  
Absolute Number ◽  
Choice Data ◽  
Attribute Importance ◽  
New Information ◽  
Decision Making Processes

Conjoint experiments are popular, but there is a paucity of research on respondents’ underlying decision-making processes. We leverage eye-tracking methodology and a series of conjoint experiments, administered to university students and local community members, to examine how respondents process information in conjoint surveys. There are two main findings. First, attribute importance measures inferred from the stated choice data are correlated with attribute importance measures based on eye movement. This validation test supports the interpretation of common conjoint metrics, such as average marginal component effects (AMCEs), as measures of attribute importance. Second, when we experimentally increase the number of attributes and profiles in the conjoint table, respondents view a larger absolute number of cells but a smaller fraction of the total cells displayed. Moving from two to three profiles, respondents search more within-profile, rather than within-attribute, to build summary evaluations. However, respondents’ stated choices remain fairly stable regardless of the number of attributes and profiles in the conjoint table. Together, these patterns speak to the robustness of conjoint experiments and are consistent with a bounded rationality mechanism. Respondents adapt to complexity by selectively incorporating relevant new information to focus on important attributes, while ignoring less relevant information to reduce cognitive processing costs.

scholarly journals Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding

2019 ◽  
Vol 81 (7) ◽  
pp. 2424-2460 ◽  
Author(s):  
Jonas Lins ◽  
Gregor Schöner
Keyword(s):  
Motor Behavior ◽  
Cognitive Task ◽  
Spatial Relation ◽  
Selection Response ◽  
Target Color ◽  
Mouse Tracking ◽  
Mouse Cursor ◽  
Computer Mouse ◽  
Computer Mouse Tracking ◽  
Attraction Effects

Abstract In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial phrase. This entails visually identifying the reference item (here, red) and other relevant items through attentional selection. Response trajectories are attracted toward distractors that share the target color but match the spatial relation less well. Trajectories are also attracted toward items that share the reference color. A competing pair of items that match the specified colors but are in the inverse spatial relation increases attraction over-additively compared to individual items. Trajectories are also influenced by the spatial term itself. While the distractor effect resembles deviation toward potential targets in previous studies, the reference effect suggests that the relevance of the reference item for the relational task, not its role as a potential target, was critical. This account is supported by the strengthened effect of a competing pair. We conclude, therefore, that the attraction effects in the mouse trajectories reflect the neural processes that operate on sensorimotor representations to solve the relational task. The paradigm thus provides an experimental window through motor behavior into higher cognitive function and the evolution of activation in modal substrates, a longstanding topic in the area of embodied cognition.

scholarly journals Pupillary and microsaccadic responses to cognitive effort and emotional arousal during complex decision making

2020 ◽  
Vol 13 (5) ◽  
Author(s):  
Krzysztof Krejtz ◽  
Justyna Żurawska ◽  
Andrew Duchowski ◽  
Szymon Wichary
Keyword(s):  
Decision Making ◽  
Information Processing ◽  
Cognitive Load ◽  
Large Body ◽  
Emotional Arousal ◽  
Pupillary Response ◽  
Cognitive Effort ◽  
Affective Priming ◽  
Multi Attribute Decision Making ◽  
Processing Effort

A large body of literature documents the sensitivity of pupil response to cognitive load (e.g., Krejtz et al. 2018) and emotional arousal (Bradley et al., 2008). Recent empirical evidence also showed that microsaccade characteristics and dynamics can be modulated by mental fatigue and cognitive load (e.g., Dalmaso et al. 2017). Very little is known about the sensitivity of microsaccadic characteristics to emotional arousal. The present paper demonstrates in a controlled experiment pupillary and microsaccadic responses to information processing during multi-attribute decision making under affective priming. Twenty-one psychology students were randomly assigned into three affective priming conditions (neutral, aversive, and erotic). Participants were tasked to make several discriminative decisions based on acquired cues. In line with the expectations, results showed microsaccadic rate inhibition and pupillary dilation depending on cognitive effort (number of acquired cues) prior to decision. These effects were moderated by affective priming. Aversive priming strengthened pupillary and microsaccadic response to information processing effort. In general, results suggest that pupillary response is more biased by affective priming than microsaccadic rate. The results are discussed in the light of neuropsychological mechanisms of pupillary and microsaccadic behavior generation.

scholarly journals On Language Processing Shaping Decision Making

2017 ◽  
Vol 26 (2) ◽  
pp. 146-151 ◽  
Author(s):  
Albert Costa ◽  
Marc–Lluís Vives ◽  
Joanna D. Corey
Keyword(s):  
Decision Making ◽  
Foreign Language ◽  
Language Processing ◽  
Native Language ◽  
Dual System ◽  
Future Research ◽  
Research Directions ◽  
Decision Making Processes ◽  
Future Research Directions ◽  
The Impact

Recent research has revealed that people’s preferences, choices, and judgments are affected by whether information is presented in a foreign or a native language. Here, we review this evidence, focusing on various decision-making domains and advancing a variety of potential explanations for this foreign-language effect on decision making. We interpret the findings in the context of dual-system theories of decision making, entertaining the possibility that foreign-language processing reduces the impact of intuition and/or increases the impact of deliberation on people’s choices. In closing, we suggest future research directions for progressing our understanding of how language and decision-making processes interact when guiding people’s decisions.

scholarly journals Tracking stress via the computer mouse? Promises and challenges of a potential behavioral stress marker

2021 ◽  
Author(s):  
Paul Freihaut ◽  
Anja S. Göritz ◽  
Christoph Rockstroh ◽  
Johannes Blum
Keyword(s):  
Stress Measurement ◽  
High Stress ◽  
Mouse Tracking ◽  
Manipulation Check ◽  
Computer Mouse ◽  
Potential Applicability ◽  
Computer Mouse Tracking ◽  
Cost Efficient ◽  
The Relationship ◽  
Theoretical Considerations

AbstractComputer mouse tracking offers a simple and cost-efficient way to gather continuous behavioral data and has mostly been utilized in psychological science to study cognitive processes. The present study extends the potential applicability of computer mouse tracking and investigates the feasibility of using computer mouse tracking for stress measurement. Drawing on first empirical results and theoretical considerations, we hypothesized that stress affects sensorimotor processes involved in mouse usage. To explore the relationship between stress and computer mouse usage, we conducted a between-participant field experiment in which N = 994 participants worked on four mouse tasks in a high-stress or low-stress condition. In the manipulation check, participants reported different stress levels between the two conditions. However, frequentist and machine learning data analysis approaches did not reveal a clear and systematic relationship between mouse usage and stress. These findings challenge the feasibility of using straightforward computer mouse tracking for generalized stress measurement.

Sign in / Sign up

Export Citation Format

Share Document