Multimodal Computational Modeling of Visual Object Recognition Deficits but Intact Repetition Priming in Schizophrenia

The term perceptual closure refers to the neural processes responsible for “filling-in” missing information in the visual image under highly adverse viewing conditions such as fog or camouflage. Here we used a closure task that required the participants to identify barely recognizable fragmented line-drawings of common objects. Patients with schizophrenia have been shown to perform poorly on this task. Following priming, controls and importantly patients can complete the line-drawings at greater levels of fragmentation behaviorally, suggesting an improvement in their ability to perform the task. Closure phenomena have been shown to involve a distributed network of cortical regions, notably the lateral occipital complex (LOC) of the ventral visual stream, dorsal visual stream (DS), hippocampal formation (HIPP) and the prefrontal cortex (PFC). We have previously demonstrated the failure of closure processes in schizophrenia and shown that the dysregulation in the sensory information transmitted to the prefrontal cortex plays a critical role in this failure. Here, using a multimodal imaging approach in patients, combining event related electrophysiological recordings (ERP) and functional magnetic resonance imaging (fMRI), we characterize the spatiotemporal dynamics of priming in perceptual closure. Using directed functional connectivity measures we demonstrate that priming modifies the network-level interactions between the nodes of closure processing in a manner that is functionally advantageous to patients resulting in the mitigation of their deficit in perceptual closure.

The Time Course of Perceptual Closure of Incomplete Visual Objects: An Event-Related Potential Study

Perceptual organization is an important part of visual and auditory information processing. In the case of visual occlusion, whether the loss of information in images could be recovered and thus perceptually closed affects object recognition. In particular, many elderly subjects have defects in object recognition ability, which may be closely related to the abnormalities of perceptual functions. This phenomenon even can be observed in the early stage of dementia. Therefore, studying the neural mechanism of perceptual closure and its relationship with sensory and cognitive processing is important for understanding how the human brain recognizes objects, inspiring the development of neuromorphic intelligent algorithms of object recognition. In this study, a new experiment was designed to explore the realistic process of perceptual closure under occlusion and intact conditions of faces and building. The analysis of the differences in ERP components P1, N1, and Ncl indicated that the subjective awareness of perceptual closure mainly occurs in Ncl, but incomplete information has been processed and showed different manners compared to complete stimuli in N170 for facial materials. Although occluded, faces, but not buildings, still maintain the specificity of perceptual processing. The Ncl by faces and buildings did not show significant differences in both amplitude and latency, suggesting a “completing” process regardless of categorical features.