Surprise-driven acquisition of visual object representations for cognitive mobile robots

Author(s):  
Werner Maier ◽  
Eckehard Steinbach
2021 ◽  
Author(s):  
Sophia Shatek ◽  
Amanda K Robinson ◽  
Tijl Grootswagers ◽  
Thomas A. Carlson

The ability to perceive moving objects is crucial for survival and threat identification. The association between the ability to move and being alive is learned early in childhood, yet not all moving objects are alive. Natural, non-agentive movement (e.g., clouds, fire) causes confusion in children and adults under time pressure. Recent neuroimaging evidence has shown that the visual system processes objects on a spectrum according to their ability to engage in self-propelled, goal-directed movement. Most prior work has used only moving stimuli that are also animate, so it is difficult to disentangle the effect of movement from aliveness or animacy in representational categorisation. In the current study, we investigated the relationship between movement and aliveness using both behavioural and neural measures. We examined electroencephalographic (EEG) data recorded while participants viewed static images of moving or non-moving objects that were either natural or artificial. Participants classified the images according to aliveness, or according to capacity for movement. Behavioural classification showed two key categorisation biases: moving natural things were often mistaken to be alive, and often classified as not moving. Movement explained significant variance in the neural data, during both a classification task and passive viewing. These results show that capacity for movement is an important dimension in the structure of human visual object representations.


2015 ◽  
Vol 27 (9) ◽  
pp. 1708-1722 ◽  
Author(s):  
Edward B. O'Neil ◽  
Hilary C. Watson ◽  
Sonya Dhillon ◽  
Nancy J. Lobaugh ◽  
Andy C. H. Lee

Recent work has demonstrated that the perirhinal cortex (PRC) supports conjunctive object representations that aid object recognition memory following visual object interference. It is unclear, however, how these representations interact with other brain regions implicated in mnemonic retrieval and how congruent and incongruent interference influences the processing of targets and foils during object recognition. To address this, multivariate partial least squares was applied to fMRI data acquired during an interference match-to-sample task, in which participants made object or scene recognition judgments after object or scene interference. This revealed a pattern of activity sensitive to object recognition following congruent (i.e., object) interference that included PRC, prefrontal, and parietal regions. Moreover, functional connectivity analysis revealed a common pattern of PRC connectivity across interference and recognition conditions. Examination of eye movements during the same task in a separate study revealed that participants gazed more at targets than foils during correct object recognition decisions, regardless of interference congruency. By contrast, participants viewed foils more than targets for incorrect object memory judgments, but only after congruent interference. Our findings suggest that congruent interference makes object foils appear familiar and that a network of regions, including PRC, is recruited to overcome the effects of interference.


2021 ◽  
Author(s):  
Vladislav Ayzenberg ◽  
Samoni Nag ◽  
Amy Krivoshik ◽  
Stella F. Lourenco

To accurately represent an object, it must be individuated from the surrounding objects and then classified with the appropriate category or identity. To this end, adults flexibly weight different visual cues when perceiving objects. However, less is known about whether, and how, the weighting of visual object information changes over development. The current study examined how children use different types of information— spatial (e.g., left/right location) and featural (e.g., color)—in different object tasks. In Experiment 1, we tested whether infants and preschoolers extract both the spatial and featural properties of objects, and, importantly, how these cues are weighted when pitted against each other. We found that infants relied primarily on spatial cues and neglected featural cues. By contrast, preschoolers showed the opposite pattern of weighting, placing greater weight on featural information. In Experiment 2, we tested the hypothesis that the developmental shift from spatial to featural weighting reflects a shift from a priority on object individuation (how many objects) in infancy to object classification (what are the objects) at preschool age. Here, we found that preschoolers weighted spatial information more than features when the task required individuating objects without identifying them, consistent with a specific role for spatial information in object individuation. We discuss the relevance of spatial-featural weighting in relation to developmental changes in children’s object representations.


2017 ◽  
Vol 29 (10) ◽  
pp. 1778-1789 ◽  
Author(s):  
Su Keun Jeong ◽  
Yaoda Xu

A host of recent studies have reported robust representations of visual object information in the human parietal cortex, similar to those found in ventral visual cortex. In ventral visual cortex, both monkey neurophysiology and human fMRI studies showed that the neural representation of a pair of unrelated objects can be approximated by the averaged neural representation of the constituent objects shown in isolation. In this study, we examined whether such a linear relationship between objects exists for object representations in the human parietal cortex. Using fMRI and multivoxel pattern analysis, we examined object representations in human inferior and superior intraparietal sulcus, two parietal regions previously implicated in visual object selection and encoding, respectively. We also examined responses from the lateral occipital region, a ventral object processing area. We obtained fMRI response patterns to object pairs and their constituent objects shown in isolation while participants viewed these objects and performed a 1-back repetition detection task. By measuring fMRI response pattern correlations, we found that all three brain regions contained representations for both single object and object pairs. In the lateral occipital region, the representation for a pair of objects could be reliably approximated by the average representation of its constituent objects shown in isolation, replicating previous findings in ventral visual cortex. Such a simple linear relationship, however, was not observed in either parietal region examined. Nevertheless, when we equated the amount of task information present by examining responses from two pairs of objects, we found that representations for the average of two object pairs were indistinguishable in both parietal regions from the average of another two object pairs containing the same four component objects but with a different pairing of the objects (i.e., the average of AB and CD vs. that of AD and CB). Thus, when task information was held consistent, the same linear relationship may govern how multiple independent objects are represented in the human parietal cortex as it does in ventral visual cortex. These findings show that object and task representations coexist in the human parietal cortex and characterize one significant difference of how visual information may be represented in ventral visual and parietal regions.


eLife ◽  
2018 ◽  
Vol 7 ◽  
Author(s):  
Martin N Hebart ◽  
Brett B Bankson ◽  
Assaf Harel ◽  
Chris I Baker ◽  
Radoslaw M Cichy

Despite the importance of an observer’s goals in determining how a visual object is categorized, surprisingly little is known about how humans process the task context in which objects occur and how it may interact with the processing of objects. Using magnetoencephalography (MEG), functional magnetic resonance imaging (fMRI) and multivariate techniques, we studied the spatial and temporal dynamics of task and object processing. Our results reveal a sequence of separate but overlapping task-related processes spread across frontoparietal and occipitotemporal cortex. Task exhibited late effects on object processing by selectively enhancing task-relevant object features, with limited impact on the overall pattern of object representations. Combining MEG and fMRI data, we reveal a parallel rise in task-related signals throughout the cerebral cortex, with an increasing dominance of task over object representations from early to higher visual areas. Collectively, our results reveal the complex dynamics underlying task and object representations throughout human cortex.


2014 ◽  
Vol 26 (10) ◽  
pp. 2135-2162 ◽  
Author(s):  
Sidney R. Lehky ◽  
Roozbeh Kiani ◽  
Hossein Esteky ◽  
Keiji Tanaka

We have calculated the intrinsic dimensionality of visual object representations in anterior inferotemporal (AIT) cortex, based on responses of a large sample of cells stimulated with photographs of diverse objects. Because dimensionality was dependent on data set size, we determined asymptotic dimensionality as both the number of neurons and number of stimulus image approached infinity. Our final dimensionality estimate was 93 (SD: [Formula: see text] 11), indicating that there is basis set of approximately 100 independent features that characterize the dimensions of neural object space. We believe this is the first estimate of the dimensionality of neural visual representations based on single-cell neurophysiological data. The dimensionality of AIT object representations was much lower than the dimensionality of the stimuli. We suggest that there may be a gradual reduction in the dimensionality of object representations in neural populations going from retina to inferotemporal cortex as receptive fields become increasingly complex.


Sign in / Sign up

Export Citation Format

Share Document