Category-specific representational patterns in left inferior frontal and temporal cortex reflect similarities and differences in the sensorimotor and distributional properties of concepts

Neuronal populations code similar concepts by similar activity patterns across the human brain’s networks supporting language comprehension. However, it is unclear to what extent such meaning-to-symbol mapping reflects statistical distributions of symbol meanings in language use, as quantified by word co-occurrence frequencies, or, rather, experiential information thought to be necessary for grounding symbols in sensorimotor knowledge. Here we asked whether integrating distributional semantics with human judgments of grounded sensorimotor semantics better approximates the representational similarity of conceptual categories in the brain, as compared with each of these methods used separately. We examined the similarity structure of activation patterns elicited by action- and object-related concepts using multivariate representational similarity analysis (RSA) of fMRI data. The results suggested that a semantic vector integrating both sensorimotor and distributional information yields best category discrimination on the cognitive-linguistic level, and explains the corresponding activation patterns in left posterior inferior temporal cortex. In turn, semantic vectors based on detailed visual and motor information uncovered category-specific similarity patterns in fusiform and angular gyrus for object-related concepts, and in motor cortex, left inferior frontal cortex (BA 44), and supramarginal gyrus for action-related concepts.

Effects of Cognitive Load on the Categorical Perception of Mandarin Tones

Purpose This study investigated the effect of cognitive load (CL) on the categorical perception (CP) of Mandarin lexical tones to discuss the application of the generalized pulse-skipping hypothesis. This hypothesis assumes that listeners might miss/skip temporal pulses and lose essential speech information due to CL, which consequently affects both the temporal and spectral dimensions of speech perception. Should CL decrease listeners' pitch sensitivity and impair the distinction of tone categories, this study would support the generalized pulse-skipping hypothesis. Method Twenty-four native Mandarin-speaking listeners were recruited to complete a dual-task experiment where they were required to identify or discriminate tone stimuli while concurrently memorizing six Chinese characters or graphic symbols. A no-load condition without a memory recall task was also included as a baseline condition. The position of categorical boundary, identification slope, between- and within-category discrimination, and discrimination peakedness were compared across the three conditions to measure the impact of CL on tone perception. The recall accuracy of Chinese characters and graphic symbols was used to assess the difficulty of memory recall. Results Compared with the no-load condition, both load conditions showed a boundary shift to Tone 3, shallower identification slope, poorer between-category discrimination, and lower discrimination peakedness. Within-category discrimination was negatively affected by CL in the graphic symbol condition only, not in the Chinese character condition. Conclusions CL degraded listeners' sensitivity to subtle fundamental frequency changes and impaired CP of Mandarin lexical tones. This provides support for the generalized pulse-skipping hypothesis. Besides, the involvement of lexical information modulated the effect of CL.

The Development of Categorical Perception of Segments and Suprasegments in Mandarin-Speaking Preschoolers

This study investigated the developmental trajectories of categorical perception (CP) of segments (i.e., stops) and suprasegments (i.e., lexical tones) in an attempt to examine the perceptual development of phonological categories and whether CP of suprasegments develops in parallel with that of segments. Forty-seven Mandarin-speaking monolingual preschoolers aged four to six years old, and fourteen adults completed both identification and discrimination tasks of the Tone 1-2 continuum and the /pa/-/pha/ continuum. Results revealed that children could perceive both lexical tones and aspiration of stops in a categorical manner by age four. The boundary position did not depend on age, with children having similar positions to adults regardless of speech continuum types. The boundary width, on the other hand, reached the adult-like level at age six for lexical tones, but not for stops. In addition, the within-category discrimination score did not differ significantly between children and adults for both continua. The between-category discrimination score improved with age and achieved the adult-like level at age five for lexical tones, but still not for stops even at age six. It suggests that the fine-grained perception of phonological categories is a protracted process, and the improvement and varying timeline of the development of segments and suprasegments are discussed in relation to statistical learning of the regularities of speech sounds in ambient language, ongoing maturation of perceptual systems, the memory mechanism underlying perceptual learning, and the intrinsic nature of speech elements.

Preverbal Categorization and its Neural Correlates: Methods and Findings

This chapter focuses on the very beginnings of categorization in early infancy. Following a general introduction, the authors provide the reader with an overview of methods and paradigms suitable for assessing category discrimination at the behavioural (section, Behavioural measures of preverbal categorization) and at the neurophysiological electroencephalogram (EEG) level (section, EEG methods for studying infant categorization at a preverbal age). Then, the authors summarize main empirical findings on auditory (section, Infant categorization in the auditory domain), visual (section, Infant categorization in the visual domain), and intermodal categorization (section, Intermodal categorization and cross-modal influences on infant categorization), as information processing in these areas is crucial for understanding the emergence of semantic memory. Finally, the authors draw some general conclusions and suggest some promising lines for future research (section, Concluding Remarks).

Pattern Separation Contributes to Categorical Face Perception

Traditionally considered a memory structure, the hippocampus has been shown to contribute to non-memory functions, from perception to language. Recent evidence suggests that the ability to differentiate highly confusable faces could involve pattern separation, a mnemonic process mediated by the hippocampal dentate gyrus (DG). Hippocampal involvement, however, may depend on existing face memories. To investigate these possibilities, we tested BL, a rare individual with bilateral lesions selective to the DG, and healthy controls. Both were administered morphed images of famous and nonfamous faces in a categorical perception (CP) identification and discrimination experiment. All participants exhibited nonlinear identification of famous faces with a midpoint category boundary. Controls identified newly learned nonfamous faces with lesser fidelity, while BL showed a notable shift in category boundary. When discriminating face pairs, controls showed typical CP effects of better between-category than within-category discrimination — but only for famous faces. BL showed extreme within-category “compression,” reflecting his tendency to pattern complete following suboptimal pattern separation. We provide the first evidence that pattern separation contributes to CP of faces.

The Motor Theory of Speech Perception

The Motor Theory of Speech Perception is a proposed explanation of the fundamental relationship between the way speech is produced and the way it is perceived. Associated primarily with the work of Liberman and colleagues, it posited the active participation of the motor system in the perception of speech. Early versions of the theory contained elements that later proved untenable, such as the expectation that the neural commands to the muscles (as seen in electromyography) would be more invariant than the acoustics. Support drawn from categorical perception (in which discrimination is quite poor within linguistic categories but excellent across boundaries) was called into question by studies showing means of improving within-category discrimination and finding similar results for nonspeech sounds and for animals perceiving speech. Evidence for motor involvement in perceptual processes nonetheless continued to accrue, and related motor theories have been proposed. Neurological and neuroimaging results have yielded a great deal of evidence consistent with variants of the theory, but they highlight the issue that there is no single “motor system,” and so different components appear in different contexts. Assigning the appropriate amount of effort to the various systems that interact to result in the perception of speech is an ongoing process, but it is clear that some of the systems will reflect the motor control of speech.

Oil-Slick Category Discrimination (Seeps vs. Spills): A Linear Discriminant Analysis Using RADARSAT-2 Backscatter Coefficients (σ°, β°, and γ°) in Campeche Bay (Gulf of Mexico)

A novel empirical approach to categorize oil slicks’ sea surface expressions in synthetic aperture radar (SAR) measurements into oil seeps or oil spills is investigated, contributing both to academic remote sensing research and to practical applications for the petroleum industry. We use linear discriminant analysis (LDA) to try accuracy improvements from our previously published methods of discriminating seeps from spills that achieved ~70% of overall accuracy. Analyzing 244 RADARSAT-2 scenes containing 4562 slicks observed in Campeche Bay (Gulf of Mexico), our exploratory data analysis evaluates the impact of 61 combinations of SAR backscatter coefficients (σ°, β°, γ°), SAR calibrated products (received radar beam given in amplitude or decibel, with or without a despeckle filter), and data transformations (none, cube root, log10). The LDA ability to discriminate the oil-slick category is rather independent of backscatter coefficients and calibrated products, but influenced by data transformations. The combination of attributes plays a role in the discrimination; combining oil-slicks’ size and SAR information is more effective. We have simplified our analyses using fewer attributes to reach accuracies comparable to those of our earlier studies, and we suggest using other multivariate data analyses—cubist or random forest—to attempt to further improve oil-slick category discrimination.

A Feature Selection Method for Multi-Label Text Based on Feature Importance

Multi-label text classification refers to a text divided into multiple categories simultaneously, which corresponds to a text associated with multiple topics in the real world. The feature space generated by text data has the characteristics of high dimensionality and sparsity. Feature selection is an efficient technology that removes useless and redundant features, reduces the dimension of the feature space, and avoids dimension disaster. A feature selection method for multi-label text based on feature importance is proposed in this paper. Firstly, multi-label texts are transformed into single-label texts using the label assignment method. Secondly, the importance of each feature is calculated using the method based on Category Contribution (CC). Finally, features with higher importance are selected to construct the feature space. In the proposed method, the feature importance is calculated from the perspective of the category, which ensures the selected features have strong category discrimination ability. Specifically, the contributions of the features to each category from two aspects of inter-category and intra-category are calculated, then the importance of the features is obtained with the combination of them. The proposed method is tested on six public data sets and the experimental results are good, which demonstrates the effectiveness of the proposed method.