Conversion of object identity to object-general semantic value in the primate temporal cortex

Science ◽  
2017 ◽  
Vol 357 (6352) ◽  
pp. 687-692 ◽  
Author(s):  
Keita Tamura ◽  
Masaki Takeda ◽  
Rieko Setsuie ◽  
Tadashi Tsubota ◽  
Toshiyuki Hirabayashi ◽  
...  
Science ◽  
2005 ◽  
Vol 310 (5749) ◽  
pp. 863-866 ◽  
Author(s):  
Chou P. Hung ◽  
Gabriel Kreiman ◽  
Tomaso Poggio ◽  
James J. DiCarlo

Understanding the brain computations leading to object recognition requires quantitative characterization of the information represented in inferior temporal (IT) cortex. We used a biologically plausible, classifier-based readout technique to investigate the neural coding of selectivity and invariance at the IT population level. The activity of small neuronal populations (∼100 randomly selected cells) over very short time intervals (as small as 12.5 milliseconds) contained unexpectedly accurate and robust information about both object “identity” and “category.” This information generalized over a range of object positions and scales, even for novel objects. Coarse information about position and scale could also be read out from the same population.


eLife ◽  
2021 ◽  
Vol 10 ◽  
Author(s):  
Xiaoxuan Jia ◽  
Ha Hong ◽  
Jim DiCarlo

Temporal continuity of object identity is a feature of natural visual input, and is potentially exploited -- in an unsupervised manner -- by the ventral visual stream to build the neural representation in inferior temporal (IT) cortex. Here we investigated whether plasticity of individual IT neurons underlies human core-object-recognition behavioral changes induced with unsupervised visual experience. We built a single-neuron plasticity model combined with a previously established IT population-to-recognition-behavior linking model to predict human learning effects. We found that our model, after constrained by neurophysiological data, largely predicted the mean direction, magnitude and time course of human performance changes. We also found a previously unreported dependency of the observed human performance change on the initial task difficulty. This result adds support to the hypothesis that tolerant core object recognition in human and non-human primates is instructed -- at least in part -- by naturally occurring unsupervised temporal contiguity experience.


2018 ◽  
Author(s):  
Moritz F. Wurm ◽  
Alfonso Caramazza

AbstractBoth temporal and frontoparietal brain areas are associated with the representation of knowledge about the world, in particular about actions. However, what these brain regions represent and precisely how they differ remains unknown. Here, we reveal fundamentally distinct functional profiles of lateral temporal and frontoparietal cortex: Using fMRI-based MVPA we found that frontoparietal areas encode representations of observed actions and corresponding written sentences in an overlapping way, but these representations did not generalize across stimulus type. By contrast, only left lateral posterior temporal cortex (LPTC) encoded action representations that generalize across observed action scenes and sentences. The representational organization of stimulus-general action information in LPTC could be predicted from models that describe basic agent-patient relations (object- and person-directedness) and the general semantic similarity between actions. The match between action videos and sentences in LPTC and its representational profile indicate that this region encodes general, conceptual aspects of actions whereas frontoparietal representations appear to be tied to specific stimulus types.


2008 ◽  
Vol 20 (2) ◽  
pp. 356-370 ◽  
Author(s):  
Evelyn Eger ◽  
John Ashburner ◽  
John-Dylan Haynes ◽  
Raymond J. Dolan ◽  
Geraint Rees

The lateral occipital complex (LOC) is a set of areas in the human occipito-temporal cortex responding to objects as opposed to low-level control stimuli. Conventional functional magnetic resonance imaging (fMRI) analysis methods based on regional averages could not detect signals discriminative of different types of objects in this region. Here, we examined fMRI signals using multivariate pattern recognition (support vector classification) to systematically explore the nature of object-related information available in fine-grained activity patterns in the LOC. Distributed fMRI signals from the LOC allowed for above-chance discrimination not only of the category but also of within-category exemplars of everyday man-made objects, and such exemplar-specific information generalized across changes in stimulus size and viewpoint, particularly in posterior subregions. Object identity could also be predicted from responses of the early visual cortex, even significantly across the changes in size and viewpoint used here. However, a dissociation was observed between these two regions of interest in the degree of discrimination for objects relative to size: In the early visual cortex, two different sizes of the same object were even better discriminated than two different objects (in accordance with measures of pixelwise stimulus similarity), whereas the opposite was true in the LOC. These findings provide the first evidence that direct evoked fMRI activity patterns in the LOC can be different for individual object exemplars (within a single category). We propose that pattern recognition methods as used here may provide an alternative approach to study mechanisms of neuronal representation based on aspects of the fMRI response independent of those assessed in adaptation paradigms.


Author(s):  
Xiaoxuan Jia ◽  
Ha Hong ◽  
James J. DiCarlo

AbstractTemporal continuity of object identity is a feature of natural visual input, and is potentially exploited -- in an unsupervised manner -- by the ventral visual stream to build the neural representation in inferior temporal (IT) cortex and IT-dependent core object recognition behavior. Here we investigated whether plasticity of individual IT neurons underlies human behavioral changes induced with unsupervised visual experience by building a single-neuron plasticity model combined with a previously established IT population-to-recognition-behavior linking model to predict human learning effects. We found that our model quite accurately predicted the mean direction, magnitude and time course of human performance changes. We also found a previously unreported dependency of the observed human performance change on the initial task difficulty. This result adds support to the hypothesis that tolerant core object recognition in human and non-human primates is instructed -- at least in part -- by naturally occurring unsupervised temporal contiguity experience.


1971 ◽  
Vol 74 (1, Pt.2) ◽  
pp. 1-29 ◽  
Author(s):  
H. Killackey ◽  
M. Snyder ◽  
I. T. Diamond
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document