Mouse visual cortex areas represent perceptual and semantic features of learned visual categories

Associative memories are stored in distributed networks extending across multiple brain regions. However, it is unclear to what extent sensory cortical areas are part of these networks. Using a paradigm for visual category learning in mice, we investigated whether perceptual and semantic features of learned category associations are already represented at the first stages of visual information processing in the neocortex. Mice learned categorizing visual stimuli, discriminating between categories and generalizing within categories. Inactivation experiments showed that categorization performance was contingent on neuronal activity in the visual cortex. Long-term calcium imaging in nine areas of the visual cortex identified changes in feature tuning and category tuning that occurred during this learning process, most prominently in the postrhinal area (POR). These results provide evidence for the view that associative memories form a brain-wide distributed network, with learning in early stages shaping perceptual representations and supporting semantic content downstream.

Auditory and visual category learning in musicians and non-musicians

We compare the ability of amateur musicians and non-musicians in learning artificial auditory and visual categories that can be described as either rule-based (RB) or information-integration (II) category structures. RB categories are optimally learned using a reflective reasoning process, whereas II categories are optimally learned by integrating information from two stimulus dimensions at a reflexive, pre-decisional processing stage. Across two experiments, we found that music experience was beneficial to learning auditory categories. In Experiment 1, musicians enrolled in a music college demonstrated advantages over non-musicians in learning RB auditory categories defined on pitch frequency and duration dimensions but did not demonstrate differences in learning II auditory categories or either RB or II visual categories. In Experiment 2, a broader online sample of musicians demonstrated advantages over non-musicians in learning both RB and II auditory categories defined on spectral and temporal modulation dimensions. Musicians’ category learning advantage is limited to their modality of expertise and is category-specific in a way that depends on the dimensions used to define the categories.

Comparing perceptual category learning across modalities in the same individuals

Category learning is a fundamental process in human cognition that spans the senses. However, much still remains unknown about the mechanisms supporting learning in different modalities. In the current study, we directly compared auditory and visual category learning in the same individuals. Thirty participants (22 F; 18-32 years old) completed two unidimensional rule-based category learning tasks in a single day—one with auditory stimuli and another with visual stimuli. We replicated the results in a second experiment with a larger online sample (N = 99, 45 F, 18-35 years old). The categories were identically structured in the two modalities to facilitate comparison. We compared categorization accuracy, decision processes as assessed through drift-diffusion models, and the generalizability of resulting category representation through a generalization test. We found that individuals learned auditory and visual categories to similar extents and that accuracies were highly correlated across the two tasks. Participants had similar evidence accumulation rates in later learning, but early on had slower rates for visual than auditory learning. Participants also demonstrated differences in the decision thresholds across modalities. Participants had more categorical generalizable representations for visual than auditory categories. These results suggest that some modality-general cognitive processes support category learning but also suggest that the modality of the stimuli may also affect category learning behavior and outcomes.

Visual Category Learning Results in Rapid Changes in Brain Activation Reflecting Sensitivity to the Category Relation between Perceived Objects and to Decision Correctness

Little is known about the time scales in which sensitivity to novel category identity may become evident in visual and executive cortices in visual category learning (VCL) tasks and the nature of such changes in brain activation. We used fMRI to investigate the processing of category information and trial-by-trial feedback information. In each VCL task, stimuli differed in three feature dimensions. In each trial, either two same-category stimuli or two different-categories stimuli were presented. The participant had to learn which feature dimension was relevant for categorization based on the feedback that followed each categorization decision. We contrasted between same-category stimuli trials and different-category trials and between correct and incorrect categorization decision trials. In each trial, brain activation in the visual stimuli processing phase was modeled separately from activation during the later feedback processing phase. We found activation in the lateral occipital complex, indicating sensitivity to the category relation between stimuli, to be evident in VCL within only few learning trials. Specifically, greater lateral occipital complex activation was evident when same-category stimuli were presented than when different-category stimuli were presented. In the feedback processing phase, greater activation in both executive and visual cortices was evident primarily after “misdetections” of same-category stimuli. Implications regarding the contribution of different learning trials to VCL, and the respective role of key brain regions, at the onset of VCL, are discussed.