scholarly journals The role of contextual materials in object recognition

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Tim Lauer ◽  
Filipp Schmidt ◽  
Melissa L.-H. Võ

AbstractWhile scene context is known to facilitate object recognition, little is known about which contextual “ingredients” are at the heart of this phenomenon. Here, we address the question of whether the materials that frequently occur in scenes (e.g., tiles in a bathroom) associated with specific objects (e.g., a perfume) are relevant for the processing of that object. To this end, we presented photographs of consistent and inconsistent objects (e.g., perfume vs. pinecone) superimposed on scenes (e.g., a bathroom) and close-ups of materials (e.g., tiles). In Experiment 1, consistent objects on scenes were named more accurately than inconsistent ones, while there was only a marginal consistency effect for objects on materials. Also, we did not find any consistency effect for scrambled materials that served as color control condition. In Experiment 2, we recorded event-related potentials and found N300/N400 responses—markers of semantic violations—for objects on inconsistent relative to consistent scenes. Critically, objects on materials triggered N300/N400 responses of similar magnitudes. Our findings show that contextual materials indeed affect object processing—even in the absence of spatial scene structure and object content—suggesting that material is one of the contextual “ingredients” driving scene context effects.

2021 ◽  
Author(s):  
Tim Lauer ◽  
Filipp Schmidt ◽  
Melissa L.-H. Vo

While scene context is known to facilitate object recognition, little is known about whichcontextual “ingredients” are at the heart of this phenomenon. Here, we address the question ofwhether the materials that frequently occur in scenes (e.g., tiles in bathroom) associated withspecific objects (e.g., a perfume) are relevant for processing of that object. To this end, wepresented photographs of consistent and inconsistent objects (e.g., perfume vs. pinecone)superimposed on scenes (e.g., bathroom) and close-ups of materials (e.g., tiles). In Experiment1, consistent objects on scenes were named more accurately than inconsistent ones, while therewas only a marginal consistency effect for objects on materials. Also, we did not find anyconsistency effect for scrambled materials that served as color control condition. In Experiment2, we recorded event-related potentials (ERPs) and found N300/N400 responses – markers ofsemantic violations – for objects on inconsistent relative to consistent scenes. Critically, objectson materials triggered N300/N400 responses of similar magnitudes. Our findings show thatcontextual materials indeed affect object processing – even in the absence of spatial scenestructure and object content – suggesting that material is one of the contextual “ingredients”driving scene context effects.


2001 ◽  
Vol 4 (2) ◽  
pp. 155-168 ◽  
Author(s):  
Ellen R. A. de Bruijn ◽  
Ton Dijkstra ◽  
Dorothee J. Chwilla ◽  
Herbert J. Schriefers

Dutch–English bilinguals performed a generalized lexical decision task on triplets of items, responding with “yes” if all three items were correct Dutch and/or English words, and with “no” if one or more of the items was not a word in either language. Sometimes the second item in a triplet was an interlingual homograph whose English meaning was semantically related to the third item of the triplet (e.g., HOUSE – ANGEL – HEAVEN, where ANGEL means “sting” in Dutch). In such cases, the first item was either an exclusively English (HOUSE) or an exclusively Dutch (ZAAK) word. Semantic priming effects were found in on-line response times. Event-related potentials that were recorded simultaneously showed N400 priming effects thought to reflect semantic integration processes. The response time and N400 priming effects were not affected by the language of the first item in the triplets, providing evidence in support of a strong bottom-up role with respect to bilingual word recognition. The results are interpreted in terms of the Bilingual Interactive Activation model, a language nonselective access model assuming bottom-up priority.


2001 ◽  
Vol 19 (2) ◽  
pp. 199-222 ◽  
Author(s):  
Elvira Brattico ◽  
Risto Näääätäänen ◽  
Mari Tervaniemi

Behavioral evidence indicates that musical context facilitates pitch discrimination. In the present study, we sought to determine whether pitch context and its familiarity might affect brain responses to pitch change even at the preattentive level. Ten musicians and 10 nonmusicians, while concentrating on reading a book, were presented with sound stimuli that had an infrequent (p = 15%) pitch shift of 144 Hz. In the familiar condition, the infrequent third-position deviant changed the mode (major vs. minor) of the five-tone pattern. In the unfamiliar condition, patterns were formed from five arithmetically determined tone frequencies, the deviant not causing any change of mode. The no-context condition included only third-position tones. All deviants elicited the change-specific mismatch negativity component of the event-related potentials in both groups of subjects. In both musicians and nonmusicians, pitch change in the familiar condition evoked larger mismatch negativity amplitude than the change in the unfamiliar condition and, correspondingly, larger mismatch negativity in the unfamiliar condition than in the no-context condition. This suggests that preattentive pitch-change processing is generally enhanced in a familiar context. Moreover, the latency of the mismatch negativity was shorter for musicians than for nonmusicians in both the familiar and unfamiliar conditions, whereas no difference between groups was observed in the no-context condition. This finding indicates that, in response to sequential structured sound events, the auditory system reacts faster in musicians than in nonmusicians.


2019 ◽  
Author(s):  
Mahsa Barzy ◽  
Heather Jane Ferguson ◽  
David Williams ◽  
Jo Black

Typically developing (TD) individuals rapidly integrate information about a speaker and their intended meaning while processing sentences online. We examined whether the same processes are activated in autistic adults, and tested their timecourse in two pre-registered experiments. Experiment 1 employed the visual world paradigm. Participants listened to sentences where the speaker’s voice and message were either consistent or inconsistent (e.g. “When we go shopping, I usually look for my favourite wine”, spoken by an adult or a child), and concurrently viewed visual scenes including consistent and inconsistent objects (e.g. wine and sweets). All participants were slower to select the mentioned object in the inconsistent condition. Importantly, eye movements showed a visual bias towards the voice-consistent object, well before hearing the disambiguating word, showing that autistic adults rapidly use the speaker’s voice to anticipate the intended meaning. However, this target bias emerged earlier in the TD group compared to the autism group (2240ms vs 1800ms before disambiguation). Experiment 2 recorded ERPs to explore speaker-meaning integration processes. Participants listened to sentences as described above, and ERPs were time-locked to the onset of the target word. A control condition included a semantic anomaly. Results revealed an enhanced N400 for inconsistent speaker-meaning sentences that was comparable to that elicited by anomalous sentences, in both groups. Overall, contrary to research that has characterised autism in terms of a local processing bias and pragmatic dysfunction, autistic people were unimpaired at integrating multiple modalities of linguistic information, and were comparably sensitive to speaker-meaning inconsistency effects.


2020 ◽  
Author(s):  
Song Zhao ◽  
Chengzhi Feng ◽  
Xinyin Huang ◽  
Yijun Wang ◽  
Wenfeng Feng

Abstract The present study recorded event-related potentials (ERPs) in a visual object-recognition task under the attentional blink paradigm to explore the temporal dynamics of the cross-modal boost on attentional blink and whether this auditory benefit would be modulated by semantic congruency between T2 and the simultaneous sound. Behaviorally, the present study showed that not only a semantically congruent but also a semantically incongruent sound improved T2 discrimination during the attentional blink interval, whereas the enhancement was larger for the congruent sound. The ERP results revealed that the behavioral improvements induced by both the semantically congruent and incongruent sounds were closely associated with an early cross-modal interaction on the occipital N195 (192–228 ms). In contrast, the lower T2 accuracy for the incongruent than congruent condition was accompanied by a larger late occurring cento-parietal N440 (424–448 ms). These findings suggest that the cross-modal boost on attentional blink is hierarchical: the task-irrelevant but simultaneous sound, irrespective of its semantic relevance, firstly enables T2 to escape the attentional blink via cross-modally strengthening the early stage of visual object-recognition processing, whereas the semantic conflict of the sound begins to interfere with visual awareness only at a later stage when the representation of visual object is extracted.


2009 ◽  
Vol 21 (1) ◽  
pp. 42-57 ◽  
Author(s):  
Jasna Martinovic ◽  
Thomas Gruber ◽  
Kathrin Ohla ◽  
Matthias M. Müller

Object recognition is achieved through neural mechanisms reliant on the activity of distributed neural assemblies that are thought to be coordinated by synchronous firing in the gamma-band range (>20 Hz). An outstanding question focuses on the extent to which the role of gamma oscillations in object recognition is dependent on attention. Attentional mechanisms determine the allocation of perceptual resources to objects in complex scenes biasing the outcome of their mutual competitive interactions. Would object-related enhancements in gamma activity also occur for unattended objects when perceptual resources are traded off to the processing of concurrent visual material? The present electroencephalogram study investigated event-related potentials and evoked (time- and phase-locked) and induced (non-time- and phase-locked to stimulus onset) gamma-band activity (GBA) using a visual discrimination task of low or high perceptual load at fixation. The task was performed while task-irrelevant familiar or unfamiliar objects coappeared in the surrounding central area. Attentional focus was kept at fixation by varying perceptual load between trials; in such conditions, only holistic object processing or low-level perceptual processing, requiring little or no attention, are thought to occur. Although evoked GBA remained unmodulated, induced GBA enhancements, specific to familiar object presentations, were observed, thus providing evidence for cortical visual representation of unattended objects. In addition, the effect was mostly driven by object-specific activity under low load, implying that, in cluttered or complex scenes, attentional selection likely plays a more significant role in object representation.


1995 ◽  
Vol 38 (6) ◽  
pp. 531-538 ◽  
Author(s):  
Xiao Lei Zhang ◽  
Henri Begleiter ◽  
Bernice Porjesz ◽  
Wenyu Wang ◽  
Ann Litke

2000 ◽  
Vol 12 (4) ◽  
pp. 615-621 ◽  
Author(s):  
Glen M. Doniger ◽  
John J. Foxe ◽  
Micah M. Murray ◽  
Beth A. Higgins ◽  
Joan Gay Snodgrass ◽  
...  

Object recognition is achieved even in circumstances when only partial information is available to the observer. Perceptual closure processes are essential in enabling such recognitions to occur. We presented successively less fragmented images while recording high-density event-related potentials (ERPs), which permitted us to monitor brain activity during the perceptual closure processes leading up to object recognition. We reveal a bilateral ERP component (Ncl) that tracks these processes (onsets ∼ 230 msec, maximal at ∼290 msec). Scalp-current density mapping of the Ncl revealed bilateral occipito-temporal scalp foci, which are consistent with generators in the human ventral visual stream, and specifically the lateral-occipital or LO complex as defined by hemodynamic studies of object recognition.


Sign in / Sign up

Export Citation Format

Share Document