scholarly journals Resolving the time course of visual and auditory object categorization

2021 ◽  
Author(s):  
Polina Iamshchinina ◽  
Agnessa Karapetian ◽  
Daniel Kaiser ◽  
Radoslaw Martin Cichy
Keyword(s):  
Time Course ◽  
Object Identification ◽  
Object Categorization ◽  
Visual Modality ◽  
Auditory Modality ◽  
Time Resolved ◽  
Object Category ◽  
Individual Object ◽  
Auditory Object ◽  
The Individual

Humans can effortlessly categorize objects, both when they are conveyed through visual images and spoken words. To resolve the neural correlates of object categorization, studies have so far primarily focused on the visual modality. It is therefore still unclear how the brain extracts categorical information from auditory signals. In the current study we used EEG (N=47) and time-resolved multivariate pattern analysis to investigate (1) the time course with which object category information emerges in the auditory modality and (2) how the representational transition from individual object identification to category representation compares between the auditory modality and the visual modality. Our results show that (1) that auditory object category representations can be reliably extracted from EEG signals and (2) a similar representational transition occurs in the visual and auditory modalities, where an initial representation at the individual-object level is followed by a subsequent representation of the objects category membership. Altogether, our results suggest an analogous hierarchy of information processing across sensory channels. However, we did not find evidence for a shared supra-modal code, suggesting that the contents of the different sensory hierarchies are ultimately modality-unique.

scholarly journals The membrane fusion events in degranulating guinea pig eosinophils

1993 ◽  
Vol 104 (1) ◽  
pp. 203-210 ◽  
Author(s):  
M. Lindau ◽  
O. Nusse ◽  
J. Bennett ◽  
O. Cromwell
Keyword(s):  
Guinea Pig ◽  
Size Distribution ◽  
Time Course ◽  
Phase Detector ◽  
Fusion Pore ◽  
Step Size ◽  
Time Resolved ◽  
Conductance States ◽  
The Individual ◽  
Random Fluctuations

We have investigated the granule fusion events associated with exocytosis in degranulating peritoneal guinea pig eosinophils by time-resolved patch-clamp capacitance measurements using the phase detector technique. Intracellular stimulation with micromolar calcium and GTP gamma S induces a 2- to 3-fold capacitance increase. The main phase of the capacitance increase occurs after a delay of 2–7 minutes and is composed of well-resolved capacitance steps. The number of steps is very close to the number of crystalloid granules contained in a resting cell and the step size distribution with a peak at 9 fF is in excellent agreement with the granule size distribution determined by electron microscopy. The individual granules thus fuse sequentially with the plasma membrane. The stepwise capacitance increase is frequently preceded by an apparently continuous capacitance increase which consists of steps smaller than 4 fF, indicating exocytosis of small vesicles as distinct from crystalloid-containing granules. In some cases the time course of the opening of individual fusion pores could be recorded, and this revealed metastable conductance states below 300 pS but random fluctuations at higher conductance levels. This behaviour suggests that the small fusion pore might be a protein structure similar to an ion channel, which becomes a continuously variable lipid pore at higher conductances. In some cells a significant capacitance decrease was observed which is apparently continuous, suggesting a process of membrane uptake by endocytosis of small vesicles.

Influence of stable iodine on the uptake of the thyroid – model vs. experiment

2001 ◽  
Vol 40 (01) ◽  
pp. 31-37 ◽  
Author(s):  
U. Wellner ◽  
E. Voth ◽  
H. Schicha ◽  
K. Weber
Keyword(s):  
Time Course ◽  
Compartment Model ◽  
The Body ◽  
Iodine Uptake ◽  
Model Calculations ◽  
Physiological Conditions ◽  
Iodine Supply ◽  
Predicted Values ◽  
The Individual ◽  
Stable Iodine

Summary Aim: The influence of physiological and pharmacological amounts of iodine on the uptake of radioiodine in the thyroid was examined in a 4-compartment model. This model allows equations to be derived describing the distribution of tracer iodine as a function of time. The aim of the study was to compare the predictions of the model with experimental data. Methods: Five euthyroid persons received stable iodine (200 μg, 10 mg). 1-123-uptake into the thyroid was measured with the Nal (Tl)-detector of a body counter under physiological conditions and after application of each dose of additional iodine. Actual measurements and predicted values were compared, taking into account the individual iodine supply as estimated from the thyroid uptake under physiological conditions and data from the literature. Results: Thyroid iodine uptake decreased from 80% under physiological conditions to 50% in individuals with very low iodine supply (15 μg/d) (n = 2). The uptake calculated from the model was 36%. Iodine uptake into the thyroid did not decrease in individuals with typical iodine supply, i.e. for Cologne 65-85 μg/d (n = 3). After application of 10 mg of stable iodine, uptake into the thyroid decreased in all individuals to about 5%, in accordance with the model calculations. Conclusion: Comparison of theoretical predictions with the measured values demonstrated that the model tested is well suited for describing the time course of iodine distribution and uptake within the body. It can now be used to study aspects of iodine metabolism relevant to the pharmacological administration of iodine which cannot be investigated experimentally in humans for ethical and technical reasons.

scholarly journals Inhibitory and facilitatory effects of phonological and orthographic similarity on L2 word recognition across modalities in bilinguals

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Candice Frances ◽  
Eugenia Navarra-Barindelli ◽  
Clara D. Martin
Keyword(s):  
Lexical Decision ◽  
Language Processing ◽  
Theoretical Implication ◽  
Phonological Similarity ◽  
Target Language ◽  
Visual Modality ◽  
Decision Task ◽  
Auditory Modality ◽  
Orthographic Similarity ◽  
Special Category

AbstractLanguage perception studies on bilinguals often show that words that share form and meaning across languages (cognates) are easier to process than words that share only meaning. This facilitatory phenomenon is known as the cognate effect. Most previous studies have shown this effect visually, whereas the auditory modality as well as the interplay between type of similarity and modality remain largely unexplored. In this study, highly proficient late Spanish–English bilinguals carried out a lexical decision task in their second language, both visually and auditorily. Words had high or low phonological and orthographic similarity, fully crossed. We also included orthographically identical words (perfect cognates). Our results suggest that similarity in the same modality (i.e., orthographic similarity in the visual modality and phonological similarity in the auditory modality) leads to improved signal detection, whereas similarity across modalities hinders it. We provide support for the idea that perfect cognates are a special category within cognates. Results suggest a need for a conceptual and practical separation between types of similarity in cognate studies. The theoretical implication is that the representations of items are active in both modalities of the non-target language during language processing, which needs to be incorporated to our current processing models.

Who is in the Room? Notification for Intrusions While in Virtual Reality

2020 ◽  
Vol 64 (1) ◽  
pp. 521-525
Author(s):  
Aaron Crowson ◽  
Zachary H. Pugh ◽  
Michael Wilkinson ◽  
Christopher B. Mayhorn
Keyword(s):  
Virtual Reality ◽  
Visual Field ◽  
Physical World ◽  
Visual Modality ◽  
Auditory Modality ◽  
Oculus Rift ◽  
Head Mounted Display ◽  
Sensory Modalities ◽  
Orientation Type

The development of head-mounted display virtual reality systems (e.g., Oculus Rift, HTC Vive) has resulted in an increasing need to represent the physical world while immersed in the virtual. Current research has focused on representing static objects in the physical room, but there has been little research into notifying VR users of changes in the environment. This study investigates how different sensory modalities affect noticeability and comprehension of notifications designed to alert head-mounted display users when a person enters his/her area of use. In addition, this study investigates how the use of an orientation type notification aids in perception of alerts that manifest outside a virtual reality users’ visual field. Results of a survey indicated that participants perceived the auditory modality as more effective regardless of notification type. An experiment corroborated these findings for the person notifications; however, the visual modality was in practice more effective for orientation notifications.

scholarly journals Dentinal anomalies in teeth of harbour porpoises (Phocoena phocoena) from Scottish waters: are they linked to sexual maturation and environmental events?

2009 ◽  
Vol 89 (5) ◽  
pp. 893-902 ◽  
Author(s):  
P.L. Luque ◽  
G.J. Pierce ◽  
J.A. Learmonth ◽  
M.B. Santos ◽  
E. Ieno ◽  
...  
Keyword(s):  
Life History ◽  
Sexual Maturation ◽  
Time Course ◽  
Physiological Stress ◽  
Organic Pollutant ◽  
Additive Models ◽  
Phocoena Phocoena ◽  
Major Life ◽  
The Individual ◽  
Pulp Stones

We examined the tooth ultra-structure of harbour porpoises (Phocoena phocoena) from Scottish waters to determine whether the incidence of mineralization anomalies could be related to certain life history events (e.g. the achievement of sexual maturation) as well as other factors that affect the general health of the individual (e.g. persistent organic pollutant (POP) concentrations in blubber). Five distinct types of mineralization anomalies were recorded: accessory lines, marker lines, dentinal resorption, cemental disturbance and pulp stones and the occurrence of these anomalies was scored by sex, age and maturity state. Overall, the incidence of mineralization anomalies was high and tended to increase with age. Marker lines and accessory lines were the most commonly recorded anomalies while pulp stones were least frequent. Duplicate teeth (i.e. from the same individual) always showed the same pattern of anomaly occurrence.Fitted binary generalized linear and additive models indicated that the presence of dentinal resorption, cemental disturbance and marker lines in harbour porpoise teeth increased with age, body length and maturity. Males displayed marker lines more frequently than females. Age was the best predictor of the incidence of dentinal resorption and cemental disturbance while age and sex were the best predictors of the incidence of marker lines. The time course of appearance of dentinal resorption and cemental disturbance suggests that their occurrence could be related to physiological stress linked to sexual maturation. Marker lines were found within growth layer groups which coincided with the beginning of weaning and sexual maturation, suggesting an association with these two major life history events. Accessory lines were found in most teeth and may be a normal characteristic of porpoise teeth or reflect regular events. Pulp stones appeared only in mature animals. We found no evidence that the presence of anomalies in teeth was significantly related to POP concentrations in the blubber.

The Effect of Learning Modality and Auditory Feedback on Word Memory: Cochlear-Implanted versus Normal-Hearing Adults

2017 ◽  
Vol 28 (03) ◽  
pp. 222-231 ◽  
Author(s):  
Riki Taitelbaum-Swead ◽  
Michal Icht ◽  
Yaniv Mama
Keyword(s):  
Young Adults ◽  
Auditory Feedback ◽  
Silent Reading ◽  
Normal Hearing ◽  
Visual Modality ◽  
Auditory Modality ◽  
No Production ◽  
Vocal Production ◽  
Word Memory ◽  
Open Set

AbstractIn recent years, the effect of cognitive abilities on the achievements of cochlear implant (CI) users has been evaluated. Some studies have suggested that gaps between CI users and normal-hearing (NH) peers in cognitive tasks are modality specific, and occur only in auditory tasks.The present study focused on the effect of learning modality (auditory, visual) and auditory feedback on word memory in young adults who were prelingually deafened and received CIs before the age of 5 yr, and their NH peers.A production effect (PE) paradigm was used, in which participants learned familiar study words by vocal production (saying aloud) or by no-production (silent reading or listening). Words were presented (1) in the visual modality (written) and (2) in the auditory modality (heard). CI users performed the visual condition twice—once with the implant ON and once with it OFF. All conditions were followed by free recall tests.Twelve young adults, long-term CI users, implanted between ages 1.7 and 4.5 yr, and who showed ≥50% in monosyllabic consonant-vowel-consonant open-set test with their implants were enrolled. A group of 14 age-matched NH young adults served as the comparison group.For each condition, we calculated the proportion of study words recalled. Mixed-measures analysis of variances were carried out with group (NH, CI) as a between-subjects variable, and learning condition (aloud or silent reading) as a within-subject variable. Following this, paired sample t tests were used to evaluate the PE size (differences between aloud and silent words) and overall recall ratios (aloud and silent words combined) in each of the learning conditions.With visual word presentation, young adults with CIs (regardless of implant status CI-ON or CI-OFF), showed comparable memory performance (and a similar PE) to NH peers. However, with auditory presentation, young adults with CIs showed poorer memory for nonproduced words (hence a larger PE) relative to their NH peers.The results support the construct that young adults with CIs will benefit more from learning via the visual modality (reading), rather than the auditory modality (listening). Importantly, vocal production can largely improve auditory word memory, especially for the CI group.

scholarly journals Bilingual children show an advantage in controlling verbal interference during spoken language comprehension

2014 ◽  
Vol 18 (3) ◽  
pp. 490-501 ◽  
Author(s):  
ROBERTO FILIPPI ◽  
JOHN MORRIS ◽  
FIONA M. RICHARDSON ◽  
PETER BRIGHT ◽  
MICHAEL S.C. THOMAS ◽  
...  
Keyword(s):  
Inhibitory Control ◽  
Target Sentence ◽  
Spoken Language ◽  
Bilingual Children ◽  
Visual Modality ◽  
Auditory Modality ◽  
Interference Control ◽  
Bilingual Advantage ◽  
Complex Sentences ◽  
Adult Participants

Studies measuring inhibitory control in the visual modality have shown a bilingual advantage in both children and adults. However, there is a lack of developmental research on inhibitory control in the auditory modality. This study compared the comprehension of active and passive English sentences in 7–10 years old bilingual and monolingual children. The task was to identify the agent of a sentence in the presence of verbal interference. The target sentence was cued by the gender of the speaker. Children were instructed to focus on the sentence in the target voice and ignore the distractor sentence. Results indicate that bilinguals are more accurate than monolinguals in comprehending syntactically complex sentences in the presence of linguistic noise. This supports previous findings with adult participants (Filippi, Leech, Thomas, Green & Dick, 2012). We therefore conclude that the bilingual advantage in interference control begins early in life and is maintained throughout development.

A Reexamination of Some Nonverbal Perceptual Abilities of Language-Impaired and Normal Children as a Function of Age and Sensory Modality

1981 ◽  
Vol 24 (3) ◽  
pp. 351-357 ◽  
Author(s):  
Paula Tallal ◽  
Rachel Stark ◽  
Clayton Kallman ◽  
David Mellits
Keyword(s):  
Sensory Modality ◽  
Important Variable ◽  
Control Group ◽  
Visual Modality ◽  
Auditory Modality ◽  
Normal Children ◽  
Language Impaired ◽  
Perceptual Performance ◽  
In Series ◽  
Perceptual Abilities

A battery of nonverbal perceptual and memory tests were given to 35 language-impaired (LI) and 38 control subjects. Three modalities of tests were given: auditory, visual, and cross-modal (auditory and visual). The purpose was to reexamine some nonverbal perceptual and memory abilities of LI children as a function of age and modality of stimulation. Results failed to replicate previous findings of a temporal processing deficit that is specific to the auditory modality in LI children. The LI group made significantly more errors than did controls regardless of modality of stimulation when 2-item sequences were presented rapidly, or when more than two stimuli were presented in series. However, further analyses resolved this apparent conflict between the present and earlier studies by demonstrating that age is an important variable underlying modality specificity of perceptual performance in LI children. Whereas younger LI children were equally impaired when responding to stimuli presented rapidly to the auditory and visual modality, older LI subjects made nearly twice as many errors responding to rapidly presented auditory rather than visual stimuli. This developmental difference did not occur for the control group.

scholarly journals Nonlinear visuoauditory integration in the mouse superior colliculus

2021 ◽  
Author(s):  
Shinya Ito ◽  
Yufei Si ◽  
Alan M. Litke ◽  
David A. Feldheim
Keyword(s):  
Superior Colliculus ◽  
Sensory Integration ◽  
Large Scale ◽  
Temporal Dynamics ◽  
Critical Role ◽  
Sensory Information ◽  
Population Level ◽  
Object Identification ◽  
Response Properties ◽  
The Individual

AbstractSensory information from different modalities is processed in parallel, and then integrated in associative brain areas to improve object identification and the interpretation of sensory experiences. The Superior Colliculus (SC) is a midbrain structure that plays a critical role in integrating visual, auditory, and somatosensory input to assess saliency and promote action. Although the response properties of the individual SC neurons to visuoauditory stimuli have been characterized, little is known about the spatial and temporal dynamics of the integration at the population level. Here we recorded the response properties of SC neurons to spatially restricted visual and auditory stimuli using large-scale electrophysiology. We then created a general, population-level model that explains the spatial, temporal, and intensity requirements of stimuli needed for sensory integration. We found that the mouse SC contains topographically organized visual and auditory neurons that exhibit nonlinear multisensory integration. We show that nonlinear integration depends on properties of auditory but not visual stimuli. We also find that a heuristically derived nonlinear modulation function reveals conditions required for sensory integration that are consistent with previously proposed models of sensory integration such as spatial matching and the principle of inverse effectiveness.

scholarly journals Limitations on animacy categorization in ensemble perception

2020 ◽  
Author(s):  
Vladislav Khvostov ◽  
Yuri Markov ◽  
Timothy F. Brady ◽  
Igor Utochkin
Keyword(s):  
Poor Performance ◽  
Object Categorization ◽  
Visual Features ◽  
Multiple Objects ◽  
Individual Object ◽  
Ensemble Perception ◽  
Entire Visual Field ◽  
Good Individual ◽  
Distribution Type ◽  
Individual Objects

Many studies have shown that people can rapidly and efficiently categorize the animacy of individual objects and scenes, even with few visual features available. Does this necessarily mean that the visual system has an unlimited capacity to process animacy across the entire visual field? We tested this in an ensemble task requiring observers to judge the relative numerosity of animate vs. inanimate items in briefly presented sets of multiple objects. We generated a set of morphed “animacy continua” between pairs of animal and inanimate object silhouettes and tested them in both individual object categorization and ensemble enumeration. For the ensemble task, we manipulated the ratio between animate and inanimate items present in the display and we also presented two types of animacy distributions: “segmentable” (including only definitely animate and definitely inanimate items) or “non-segmentable” (middle-value, ambiguous morphs pictures were shown along with the definite “extremes”). Our results showed that observers failed to integrate animacy information from multiple items, as they showed very poor performance in the ensemble task and were not sensitive to the distribution type despite their categorization rate for individual objects being near 100%. A control condition using the same design with color as a category-defining dimension elicited both good individual object and ensemble categorization performance and a strong effect of the segmentability type. We conclude that good individual categorization does not necessarily allow people to build ensemble animacy representations, thus showing the limited capacity of animacy perception.

Sign in / Sign up

Export Citation Format

Share Document