The role of prosodic and visual information in disambiguating wh-indeterminates: The case of Korean three-year-olds

2021 ◽  
pp. 1-23
Author(s):  
Hye-Jung CHO ◽  
Jieun KIAER ◽  
Naya CHOI ◽  
Jieun SONG
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Visual Stimuli ◽  
Korean Language ◽  
Visual Cue ◽  
Prosodic Cues ◽  
Wh Questions ◽  
Picture Stimuli

Abstract In Korean language, questions containing ambiguous wh-words may be interpreted as either wh-questions or yes-no questions. This study investigated 43 Korean three-year-olds’ ability to disambiguate eight indeterminate questions using prosodic and visual cues. The intonation of each question provided a cue as to whether it should be interpreted as a wh-question or a yes-no question. The questions were presented alongside picture stimuli, which acted as either a matched (presentation of corresponding auditory-visual stimuli) or a mismatched contextual cue (presentation conflicting auditory-visual stimuli). Like adults, the children preferred to comprehend questions involving ambiguous wh-words as wh-questions, rather than yes-no questions. In addition, children were as effective as adults in disambiguating indeterminate questions using prosodic cues regardless of the visual cue. However, when confronted with conflicting auditory-visual stimuli (mismatched), the quality of children's responses was less accurate than adults’ responses.

scholarly journals Visual-olfactory integration in the human disease vector mosquito, Aedes aegypti

2019 ◽  
Author(s):  
Clément Vinauger ◽  
Floris Van Breugel ◽  
Lauren T. Locke ◽  
Kennedy K.S. Tobin ◽  
Michael H. Dickinson ◽  
...  
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Visual Stimuli ◽  
Time Dependent ◽  
Large Field ◽  
Dependent Manner ◽  
Contrast Imaging ◽  
Neural Basis ◽  
Two Photon Microscopy

SummaryMosquitoes rely on the integration of multiple sensory cues, including olfactory, visual, and thermal stimuli, to detect, identify and locate their hosts [1–4]. Although we increasingly know more about the role of chemosensory behaviours in mediating mosquito-host interactions [1], the role of visual cues remains comparatively less studied [3], and how the combination of olfactory and visual information is integrated in the mosquito brain remains unknown. In the present study, we used a tethered-flight LED arena, which allowed for quantitative control over the stimuli, to show that CO2 exposure affects target-tracking responses, but not responses to large-field visual stimuli. In addition, we show that CO2 modulates behavioural responses to visual objects in a time-dependent manner. To gain insight into the neural basis of this olfactory and visual coupling, we conducted two-photon microscopy experiments in a new GCaMP6s-expressing mosquito line. Imaging revealed that the majority of ROIs in the lobula region of the optic lobe exhibited strong responses to small-field stimuli, but showed little response to a large-field stimulus. Approximately 20% of the neurons we imaged were modulated when an attractive odour preceded the visual stimulus; these same neurons also elicited a small response when the odour was presented alone. By contrast, imaging in the antennal lobe revealed no modulation when visual stimuli were presented before or after the olfactory stimulus. Together, our results are the first to reveal the dynamics of olfactory modulation in visually evoked behaviours of mosquitoes, and suggest that coupling between these sensory systems is asymmetrical and time-dependent.

scholarly journals How much do visual cues help listeners in perceiving accented speech?

2018 ◽  
Vol 40 (1) ◽  
pp. 93-109
Author(s):  
YI ZHENG ◽  
ARTHUR G. SAMUEL
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Nonnative Speakers ◽  
Apparent Distance ◽  
Native English Speakers ◽  
English Speakers ◽  
Accented Speech ◽  
Compressed Speech ◽  
Degraded Speech

AbstractIt has been documented that lipreading facilitates the understanding of difficult speech, such as noisy speech and time-compressed speech. However, relatively little work has addressed the role of visual information in perceiving accented speech, another type of difficult speech. In this study, we specifically focus on accented word recognition. One hundred forty-two native English speakers made lexical decision judgments on English words or nonwords produced by speakers with Mandarin Chinese accents. The stimuli were presented as either as videos that were of a relatively far speaker or as videos in which we zoomed in on the speaker’s head. Consistent with studies of degraded speech, listeners were more accurate at recognizing accented words when they saw lip movements from the closer apparent distance. The effect of apparent distance tended to be larger under nonoptimal conditions: when stimuli were nonwords than words, and when stimuli were produced by a speaker who had a relatively strong accent. However, we did not find any influence of listeners’ prior experience with Chinese accented speech, suggesting that cross-talker generalization is limited. The current study provides practical suggestions for effective communication between native and nonnative speakers: visual information is useful, and it is more useful in some circumstances than others.

Impairment of cross-modality of vision and olfaction in Parkinson disease

Neurology ◽  
2018 ◽  
Vol 90 (11) ◽  
pp. e977-e984 ◽  
Author(s):  
Motoyasu Honma ◽  
Yuri Masaoka ◽  
Takeshi Kuroda ◽  
Akinori Futamura ◽  
Azusa Shiromaru ◽  
...  
Keyword(s):  
Parkinson Disease ◽  
Cognitive Functions ◽  
Visual Information ◽  
Visual Cues ◽  
Visual Effects ◽  
Behavioral Experiments ◽  
Odor Evaluation ◽  
Patient Performance ◽  
Normal Controls

ObjectiveTo determine whether Parkinson disease (PD) affects cross-modal function of vision and olfaction because it is known that PD impairs various cognitive functions, including olfaction.MethodsWe conducted behavioral experiments to identify the influence of PD on cross-modal function by contrasting patient performance with age-matched normal controls (NCs). We showed visual effects on the strength and preference of odor by manipulating semantic connections between picture/odorant pairs. In addition, we used brain imaging to identify the role of striatal presynaptic dopamine transporter (DaT) deficits.ResultsWe found that odor evaluation in participants with PD was unaffected by visual information, while NCs overestimated smell when sniffing odorless liquid while viewing pleasant/unpleasant visual cues. Furthermore, DaT deficit in striatum, for the posterior putamen in particular, correlated to few visual effects in participants with PD.ConclusionsThese findings suggest that PD impairs cross-modal function of vision/olfaction as a result of posterior putamen deficit. This cross-modal dysfunction may serve as the basis of a novel precursor assessment of PD.

scholarly journals The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions

2020 ◽  
pp. 002383091989888
Author(s):  
Luma Miranda ◽  
Marc Swerts ◽  
João Moraes ◽  
Albert Rilliard
Keyword(s):  
Visual Information ◽  
Brazilian Portuguese ◽  
Perceptual Identification ◽  
Auditory Information ◽  
Visual Channel ◽  
Prosodic Cues ◽  
The Face ◽  
Set Up ◽  
Echo Questions

This paper presents the results of three perceptual experiments investigating the role of auditory and visual channels for the identification of statements and echo questions in Brazilian Portuguese. Ten Brazilian speakers (five male) were video-recorded (frontal view of the face) while they produced a sentence (“ Como você sabe”), either as a statement (meaning “ As you know.”) or as an echo question (meaning “ As you know?”). Experiments were set up including the two different intonation contours. Stimuli were presented in conditions with clear and degraded audio as well as congruent and incongruent information from both channels. Results show that Brazilian listeners were able to distinguish statements and questions prosodically and visually, with auditory cues being dominant over visual ones. In noisy conditions, the visual channel improved the interpretation of prosodic cues robustly, while it degraded them in conditions where the visual information was incongruent with the auditory information. This study shows that auditory and visual information are integrated during speech perception, also when applied to prosodic patterns.

Differential Involvement of Neurons in the Dorsal and Ventral Premotor Cortex During Processing of Visual Signals for Action Planning

2006 ◽  
Vol 95 (6) ◽  
pp. 3596-3616 ◽  
Author(s):  
Eiji Hoshi ◽  
Jun Tanji
Keyword(s):  
Neuronal Activity ◽  
Visual Information ◽  
Visual Cues ◽  
Target Location ◽  
Premotor Cortex ◽  
Action Planning ◽  
Visual Signals ◽  
Visual Cue ◽  
Ventral Premotor Cortex ◽  
Neuron Response

We examined neuronal activity in the dorsal and ventral premotor cortex (PMd and PMv, respectively) to explore the role of each motor area in processing visual signals for action planning. We recorded neuronal activity while monkeys performed a behavioral task during which two visual instruction cues were given successively with an intervening delay. One cue instructed the location of the target to be reached, and the other indicated which arm was to be used. We found that the properties of neuronal activity in the PMd and PMv differed in many respects. After the first cue was given, PMv neuron response mostly reflected the spatial position of the visual cue. In contrast, PMd neuron response also reflected what the visual cue instructed, such as which arm to be used or which target to be reached. After the second cue was given, PMv neurons initially responded to the cue's visuospatial features and later reflected what the two visual cues instructed, progressively increasing information about the target location. In contrast, the activity of the majority of PMd neurons responded to the second cue with activity reflecting a combination of information supplied by the first and second cues. Such activity, already reflecting a forthcoming action, appeared with short latencies (<400 ms) and persisted throughout the delay period. In addition, both the PMv and PMd showed bilateral representation on visuospatial information and motor-target or effector information. These results further elucidate the functional specialization of the PMd and PMv during the processing of visual information for action planning.

scholarly journals The Role of Adrenoceptors in the Retina

Cells ◽  
2020 ◽  
Vol 9 (12) ◽  
pp. 2594
Author(s):  
Yue Ruan ◽  
Tobias Böhmer ◽  
Subao Jiang ◽  
Adrian Gericke
Keyword(s):  
Visual Information ◽  
Vision Loss ◽  
Retinal Diseases ◽  
System A ◽  
The Central Nervous System ◽  
The Individual ◽  
And Function ◽  
The Brain

The retina is a part of the central nervous system, a thin multilayer with neuronal lamination, responsible for detecting, preprocessing, and sending visual information to the brain. Many retinal diseases are characterized by hemodynamic perturbations and neurodegeneration leading to vision loss and reduced quality of life. Since catecholamines and respective bindings sites have been characterized in the retina, we systematically reviewed the literature with regard to retinal expression, distribution and function of alpha1 (α1)-, alpha2 (α2)-, and beta (β)-adrenoceptors (ARs). Moreover, we discuss the role of the individual adrenoceptors as targets for the treatment of retinal diseases.

Seeing the Way: the Role of Vision in Conversation Turn Exchange Perception

2017 ◽  
Vol 30 (7-8) ◽  
pp. 653-679 ◽  
Author(s):  
Nida Latif ◽  
Agnès Alsius ◽  
K. G. Munhall
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Social Cues ◽  
The Other ◽  
Auditory Information ◽  
Face To Face ◽  
Turn Taking ◽  
Overall Efficiency ◽  
Natural Conversation

During conversations, we engage in turn-taking behaviour that proceeds back and forth effortlessly as we communicate. In any given day, we participate in numerous face-to-face interactions that contain social cues from our partner and we interpret these cues to rapidly identify whether it is appropriate to speak. Although the benefit provided by visual cues has been well established in several areas of communication, the use of visual information to make turn-taking decisions during conversation is unclear. Here we conducted two experiments to investigate the role of visual information in identifying conversational turn exchanges. We presented clips containing single utterances spoken by single individuals engaged in a natural conversation with another. These utterances were from either right before a turn exchange (i.e., when the current talker would finish and the other would begin) or were utterances where the same talker would continue speaking. In Experiment 1, participants were presented audiovisual, auditory-only and visual-only versions of our stimuli and identified whether a turn exchange would occur or not. We demonstrated that although participants could identify turn exchanges with unimodal information alone, they performed best in the audiovisual modality. In Experiment 2, we presented participants audiovisual turn exchanges where the talker, the listener or both were visible. We showed that participants suffered a cost at identifying turns exchanges when visual cues from the listener were not available. Overall, we demonstrate that although auditory information is sufficient for successful conversation, visual information plays an important role in the overall efficiency of communication.

scholarly journals Visual threats reduce blood-feeding and trigger escape responses in Aedes aegypti mosquitoes.

2022 ◽  
Author(s):  
Nicole E Wynne ◽  
Karthikeyan Chandrasegaran ◽  
Lauren Fryzlewicz ◽  
Clément Vinauger
Keyword(s):  
Aedes Aegypti ◽  
Behavioral Response ◽  
Visual Information ◽  
Visual Cues ◽  
Blood Feeding ◽  
Potential Threat ◽  
Visual Component ◽  
Defensive Behaviors ◽  
Escape Responses

The diurnal mosquitoes Aedes aegypti are vectors of several arboviruses, including dengue, yellow fever, and Zika viruses. To find a host to feed on, they rely on the sophisticated integration of olfactory, visual, thermal, and gustatory cues reluctantly emitted by the hosts. If detected by their target, this latter may display defensive behaviors that mosquitoes need to be able to detect and escape. In humans, a typical response is a swat of the hand, which generates both mechanical and visual perturbations aimed at a mosquito. While the neuro-sensory mechanisms underlying the approach to the host have been the focus of numerous studies, the cues used by mosquitoes to detect and identify a potential threat remain largely understudied. In particular, the role of vision in mediating mosquitoes' ability to escape defensive hosts has yet to be analyzed. Here, we used programmable visual displays to generate expanding objects sharing characteristics with the visual component of an approaching hand and quantified the behavioral response of female mosquitoes. Results show that Ae. aegypti is capable of using visual information to decide whether to feed on an artificial host mimic. Stimulations delivered in a LED flight arena further reveal that landed females Ae. aegypti display a stereotypical escape strategy by taking off at an angle that is a function of the distance and direction of stimulus introduction. Altogether, this study demonstrates mosquitoes can use isolated visual cues to detect and avoid a potential threat.

Beauty is not always in the eye of the beholder: the role of vision in the emergence of mate preferences

2019 ◽  
Author(s):  
Meike Scheller ◽  
Francine Matorres ◽  
Lucy Tompkins ◽  
Anthony C. Little ◽  
Alexandra A. de Sousa
Keyword(s):  
Sex Differences ◽  
Physical Attractiveness ◽  
Visual Information ◽  
Visual Cues ◽  
Mate Preferences ◽  
Personality Factors ◽  
High Status ◽  
Partner Characteristics ◽  
Blind Individuals

Cross-cultural research has repeatedly demonstrated sex differences in the importance of different partner characteristics when choosing a mate. Men typically report higher preferences for younger, more physically attractive women, while women prefer men that are wealthier and of higher status. As the assessment of such partner characteristics often relies on visual cues, this raises the question whether visual experience is necessary for sex-specific mate preferences to develop. To shed more light onto the emergence of sex differences in mate choice, the current study assessed how preferences for attractiveness, resources, and personality factors differ between sighted and blind individuals using an online questionnaire. We further investigate the role of social factors and sensory cue selection in these sex differences. Our sample consisted of 94 sighted and blind participants with different ages of blindness-onset, 19 blind/28 sighted males, and 19 blind/28 sighted females. Results replicated well-documented findings in the sighted, with men placing more importance on physical attractiveness and women placing more importance on status and resources. However, while physical attractiveness was less important to blind men, blind women considered physical attractiveness as important as sighted women. The importance of a high status and likeable personality was not influenced by sightedness. Blind individuals considered auditory cues more important than visual cues, while sighted males showed the opposite pattern. Further, relationship status and indirect, social influences were related to preferences. Overall, our findings shed light on the availability of visual information for the emergence of sex differences in mate preference.

scholarly journals The Role of Vision in Auditory Distance Perception

Perception ◽  
10.1068/p7153 ◽  
2012 ◽  
Vol 41 (2) ◽  
pp. 175-192 ◽  
Author(s):  
Esteban R Calcagno ◽  
Ezequiel L Abregú ◽  
Manuel C Eguía ◽  
Ramiro Vergara
Keyword(s):  
Sound Source ◽  
Visual Information ◽  
Auditory Perception ◽  
Horizontal Plane ◽  
Visual Cues ◽  
Distance Perception ◽  
Apparent Distance ◽  
Multisensory Interaction ◽  
Auditory Distance

In humans, multisensory interaction is an important strategy for improving the detection of stimuli of different nature and reducing the variability of response. It is known that the presence of visual information affects the auditory perception in the horizontal plane (azimuth), but there are few researches that study the influence of vision in the auditory distance perception. In general, the data obtained from these studies are contradictory and do not completely define the way in which visual cues affect the apparent distance of a sound source. Here psychophysical experiments on auditory distance perception in humans are performed, including and excluding visual cues. The results show that the apparent distance from the source is affected by the presence of visual information and that subjects can store in their memory a representation of the environment that later improves the perception of distance.

Sign in / Sign up

Export Citation Format

Share Document