Behavioral Prioritization Enhances Working Memory Precision and Neural Population Gain

Humans allocate visual working memory (WM) resource according to behavioral relevance, resulting in more precise memories for more important items. Theoretically, items may be maintained by feature-tuned neural populations, where the relative gain of the populations encoding each item determines precision. To test this hypothesis, we compared the amplitudes of delay period activity in the different parts of retinotopic maps representing each of several WM items, predicting the amplitudes would track behavioral priority. Using fMRI, we scanned participants while they remembered the location of multiple items over a WM delay and then reported the location of one probed item using a memory-guided saccade. Importantly, items were not equally probable to be probed (0.6, 0.3, 0.1, 0.0), which was indicated with a precue. We analyzed fMRI activity in 10 visual field maps in occipital, parietal, and frontal cortex known to be important for visual WM. In early visual cortex, but not association cortex, the amplitude of BOLD activation within voxels corresponding to the retinotopic location of visual WM items increased with the priority of the item. Interestingly, these results were contrasted with a common finding that higher-level brain regions had greater delay period activity, demonstrating a dissociation between the absolute amount of activity in a brain area and the activity of different spatially selective populations within it. These results suggest that the distribution of WM resources according to priority sculpts the relative gains of neural populations that encode items, offering a neural mechanism for how prioritization impacts memory precision.

Music-selective cortex is sensitive to structure in both pitch and time

Converging evidence suggests that neural populations within human non-primary auditory cortex respond selectively to music. These neural populations respond strongly to a wide range of music stimuli, and weakly to other natural sounds and to synthetic control stimuli matched to music in many acoustic properties, suggesting that they are driven by high-level musical features. What are these features? Here we used fMRI to test the extent to which musical structure in pitch and time contribute to music-selective neural responses. We used voxel decomposition to derive music-selective response components in each of 15 participants individually, and then measured the response of these components to synthetic music clips in which we selectively disrupted musical structure by scrambling either the note pitches and/or onset times. Both types of scrambling produced lower responses compared to when melodic or rhythmic structure was intact. This effect was much stronger in the music-selective component than in the other response components, even those with substantial spatial overlap with the music component. We further found no evidence for any cortical regions sensitive to pitch but not time structure, or vice versa. Our results suggest that the processing of melody and rhythm are intertwined within auditory cortex.

A somatosensory computation that unifies bodies and tools

It is often claimed that tools are embodied by the user, but whether the brain actually repurposes its body-based computations to perform similar tasks with tools is not known. A fundamental body-based computation used by the somatosensory system is trilateration. Here, the location of touch on a limb is computed by integrating estimates of the distance between sensory input and its boundaries (e.g., elbow and wrist of the forearm). As evidence of this computational mechanism, tactile localization on a limb is most precise near its boundaries and lowest in the middle. If the brain repurposes trilateration to localize touch on a tool, we should observe this computational signature in behavior. In a large sample of participants, we indeed found that localizing touch on a tool produced the signature of trilateration, with highest precision close to the base and tip of the tool. A computational model of trilateration provided a good fit to the observed localization behavior. Importantly, model selection demonstrated that trilateration better explained each participant's behavior than an alternative model of localization. These results have important implications for how trilateration may be implemented by somatosensory neural populations. In sum, the present study suggests that tools are indeed embodied at a computational level, repurposing a fundamental spatial computation.

The interaction between neural populations: Additive versus diffusive coupling

Models of networks of populations of neurons commonly assume that the interactions between neural populations are via additive or diffusive coupling. When using the additive coupling, a population's activity is affected by the sum of the activities of neighbouring populations. In contrast, when using the diffusive coupling a neural population is affected by the sum of the differences between its activity and the activity of its neighbours. These two coupling functions have been used interchangeably for similar applications. Here, we show that the choice of coupling can lead to strikingly different brain network dynamics. We focus on a model of seizure transitions that has been used both with additive and diffusive coupling in the literature. We consider networks with two and three nodes, and large random and scale-free networks with 64 nodes. We further assess functional networks inferred from magnetoencephalography (MEG) from people with epilepsy and healthy controls. To characterize the seizure dynamics on these networks, we use the escape time, the brain network ictogenicity (BNI) and the node ictogenicity (NI), which are measures of the network's global and local ability to generate seizures. Our main result is that the level of ictogenicity of a network is strongly dependent on the coupling function. We find that people with epilepsy have higher additive BNI than controls, as hypothesized, while the diffusive BNI provides the opposite result. Moreover, individual nodes that are more likely to drive seizures with one type of coupling are more likely to prevent seizures with the other coupling function. Our results on the MEG networks and evidence from the literature suggest that the additive coupling may be a better modelling choice than the diffusive coupling, at least for BNI and NI studies. Thus, we highlight the need to motivate and validate the choice of coupling in future studies.

A structured scaffold underlies activity in the hippocampus

Place cells are believed to organize memory across space and time, inspiring the idea of the cognitive map. Yet unlike the structured activity in the associated grid and head-direction cells, they remain an enigma: their responses have been difficult to predict and are complex enough to be statistically well-described by a random process. Here we report one step toward the ultimate goal of understanding place cells well enough to predict their fields. Within a theoretical framework in which place fields are derived as a conjunction of external cues with internal grid cell inputs, we predict that even apparently random place cell responses should reflect the structure of their grid inputs and that this structure can be unmasked if probed in sufficiently large neural populations and large environments. To test the theory, we design experiments in long, locally featureless spaces to demonstrate that structured scaffolds undergird place cell responses. Our findings, together with other theoretical and experimental results, suggest that place cells build memories of external inputs by attaching them to a largely prespecified grid scaffold.

Repetition effects in action planning reflect effector- but not hemisphere-specific coding

Action choices are influenced by future and recent past action states. For example, when performing two actions in succession, response times (RT) to initiate the second action are reduced when the same hand is used. These findings suggest the existence of effector-specific processing for action planning. However, given that each hand is primarily controlled by the contralateral hemisphere, the RT benefit might actually reflect effector-independent, hemisphere-specific rather than effector-specific repetition effects. Here, participants performed two consecutive movements, each with a hand or a foot, in one of two directions. Direction was specified in an egocentric reference frame (inward, outward) or in an allocentric reference frame (left, right). Successive actions were initiated faster when the same limb (e.g., left hand - left hand), but not when the other limb of the same body side (e.g., left foot - left hand) executed the second action. The same-limb advantage was evident even when the two movements involved different directions, whether specified egocentrically or allocentrically. Corroborating evidence from computational modeling lends support to the claim that repetition effects in action planning reflect persistent changes in baseline activity within neural populations that encode effector-specific action plans.

Direct Approach or Detour: A Comparative Model of Inhibition and Neural Ensemble Size in Behavior Selection

Organisms must cope with different risk/reward landscapes in their ecological niche. Hence, species have evolved behavior and cognitive processes to optimally balance approach and avoidance. Navigation through space, including taking detours, appears also to be an essential element of consciousness. Such processes allow organisms to negotiate predation risk and natural geometry that obstruct foraging. One aspect of this is the ability to inhibit a direct approach toward a reward. Using an adaptation of the well-known detour paradigm in comparative psychology, but in a virtual world, we simulate how different neural configurations of inhibitive processes can yield behavior that approximates characteristics of different species. Results from simulations may help elucidate how evolutionary adaptation can shape inhibitive processing in particular and behavioral selection in general. More specifically, results indicate that both the level of inhibition that an organism can exert and the size of neural populations dedicated to inhibition contribute to successful detour navigation. According to our results, both factors help to facilitate detour behavior, but the latter (i.e., larger neural populations) appears to specifically reduce behavioral variation.

Evidence for a deep, distributed and dynamic code for animacy in human ventral anterior temporal cortex

How does the human brain encode semantic information about objects? This paper reconciles two seemingly contradictory views. The first proposes that local neural populations independently encode semantic features; the second, that semantic representations arise as a dynamic distributed code that changes radically with stimulus processing. Combining simulations with a well-known neural network model of semantic memory, multivariate pattern classification, and human electrocorticography, we find that both views are partially correct: information about the animacy of a depicted stimulus is distributed across ventral temporal cortex in a dynamic code possessing feature-like elements posteriorly but with elements that change rapidly and nonlinearly in anterior regions. This pattern is consistent with the view that anterior temporal lobes serve as a deep cross-modal ‘hub’ in an interactive semantic network, and more generally suggests that tertiary association cortices may adopt dynamic distributed codes difficult to detect with common brain imaging methods.

The structure of behavioral variation within a genotype

Individual animals vary in their behaviors. This is true even when they share the same genotype and were reared in the same environment. Clusters of covarying behaviors constitute behavioral syndromes, and an individual’s position along such axes of covariation is a representation of their personality. Despite these conceptual frameworks, the structure of behavioral covariation within a genotype is essentially uncharacterized and its mechanistic origins unknown. Passing hundreds of inbred Drosophila individuals through an experimental pipeline that captured hundreds of behavioral measures, we found sparse but significant correlations among small sets of behaviors. Thus, the space of behavioral variation has many independent dimensions. Manipulating the physiology of the brain, and specific neural populations, altered specific correlations. We also observed that variation in gene expression can predict an individual’s position on some behavioral axes. This work represents the first steps in understanding the biological mechanisms determining the structure of behavioral variation within a genotype.