scholarly journals A data-driven investigation of human action representations

2021 ◽  
Vol 21 (9) ◽  
pp. 2552
Author(s):  
Diana C Dima ◽  
Tyler Tomita ◽  
Christopher Honey ◽  
Martin N Hebart ◽  
Leyla Isik
Author(s):  
Maija Hirvonen ◽  
Liisa Tiittula

This article demonstrates a methodology for studying the translation process from the perspective of multimodal social interaction and applies this methodology to a case analysis of collaborative audio description. The methodology is multimodal conversation analysis, which aims to uncover the way in which multimodal communication resources (e.g., talk, gaze, gestures) are used holistically and situatedly in building human action. Being empirical and data-driven, multimodal conversation analysis observes human conduct in its natural setting. This article analyses video data from an authentic audio-description process and presents the multimodal constitution of problem-solving sequences during translating. In addition, the article discusses issues regarding the methodological choices facing researchers who are interested in human interaction in translation. The article shows that applying multimodal conversation analysis opens new avenues for research into the translation process and collaborative translation.


2019 ◽  
Vol 31 (2) ◽  
pp. 262-277 ◽  
Author(s):  
Carmen Kohl ◽  
Laure Spieser ◽  
Bettina Forster ◽  
Sven Bestmann ◽  
Kielan Yarrow

The neural dynamics underpinning binary perceptual decisions and their transformation into actions are well studied, but real-world decisions typically offer more than two response alternatives. How does decision-related evidence accumulation dynamically influence multiple action representations in humans? The heightened conservatism required in multiple compared with binary choice scenarios suggests a mechanism that compensates for increased uncertainty when multiple choices are present by suppressing baseline activity. Here, we tracked action representations using corticospinal excitability during four- and two-choice perceptual decisions and modeled them using a sequential sampling framework. We found that the predictions made by leaky competing accumulator models to accommodate multiple choices (i.e., reduced baseline activity to compensate increased uncertainty) were borne out by dynamic changes in human action representations. This suggests a direct and continuous influence of interacting evidence accumulators, each favoring a different decision alternative, on downstream corticospinal excitability during complex choice.


Sign in / Sign up

Export Citation Format

Share Document