Why Do Individuals Seek Information? A Selectionist Perspective

Several authors have proposed that mechanisms of adaptive behavior, and reinforcement learning in particular, can be explained by an innate tendency of individuals to seek information about the local environment. In this article, I argue that these approaches adhere to an essentialist view of learning that avoids the question why information seeking should be favorable in the first place. I propose a selectionist account of adaptive behavior that explains why individuals behave as if they had a tendency to seek information without resorting to essentialist explanations. I develop my argument using a formal selectionist framework for adaptive behavior, the multilevel model of behavioral selection (MLBS). The MLBS has been introduced recently as a formal theory of behavioral selection that links reinforcement learning to natural selection within a single unified model. I show that the MLBS implies an average gain in information about the availability of reinforcement. Formally, this means that behavior reaches an equilibrium state, if and only if the Fisher information of the conditional probability of reinforcement is maximized. This coincides with a reduction in the randomness of the expected environmental feedback as captured by the information theoretic concept of expected surprise (i.e., entropy). The main result is that behavioral selection maximizes the information about the expected fitness consequences of behavior, which, in turn, minimizes average surprise. In contrast to existing attempts to link adaptive behavior to information theoretic concepts (e.g., the free energy principle), neither information gain nor surprise minimization is treated as a first principle. Instead, the result is formally deduced from the MLBS and therefore constitutes a mathematical property of the more general principle of behavioral selection. Thus, if reinforcement learning is understood as a selection process, there is no need to assume an active agent with an innate tendency to seek information or minimize surprise. Instead, information gain and surprise minimization emerge naturally because it lies in the very nature of selection to produce order from randomness.

Artificial selection for predatory behavior results in dietary niche differentiation in an omnivorous mammal

The diet of an individual is a result of the availability of dietary items and the individual's foraging skills and preferences. Behavioral differences may thus influence diet variation, but the evolvability of diet choice through behavioral evolution has not been studied. We used experimental evolution combined with a field enclosure experiment to test whether behavioral selection leads to dietary divergence. We analysed the individual dietary niche via stable isotope ratios of nitrogen (δ15N) and carbon (δ13C) in the hair of an omnivorous mammal, bank vole, from 4 lines selected for predatory behavior and 4 unselected control lines. Predatory voles had higher hair δ15N values than control voles, supporting our hypothesis that predatory voles would consume a higher trophic level diet (more animal vs. plant foods). This difference was significant in the early but not the late summer season. The δ13C values also indicated a seasonal change in the consumed plant matter and a difference in food sources among selection lines in the early summer. These results imply that environmental factors interact with evolved behavioral tendencies to determine dietary niche heterogeneity. Behavioral selection thus has potential to contribute to the evolution of diet choice and ultimately the species' ecological niche breadth.

Melanophore metachrosis response in amphibian tadpoles: effect of background colour, light and temperature

The developmental and biochemical mechanisms of colour change through chromatophore metachrosis in amphibian tadpoles are relatively well studied, but the environmental factors driving colour change remain unclear. A cryptic response to background colour in order to reduce predation is an intuitively valid explanation, however, other hypotheses need to be explored. In this study, we aimed to investigate the environmental factors driving the melanophore metachrosis process in Alytes dickhilleni tadpoles. First, we tested the response to two backgrounds with clearly distinct reflectance: black and white. The proportion of dark tadpoles became significantly higher when they were located on the black background, and pale tadpole proportion was dominant on the white background, as expected from the crypsis hypothesis. Secondly, we added two new factors, temperature and photoperiod, maintaining the background variation. Our results suggest that lower temperatures, and short photoperiods were significantly driving a change to dark colouration in tadpoles, possibly allowing a more efficient thermoregulation, and in consequence, development and growth. Next we tested whether dark and pale tadpoles selected backgrounds that matched their colouration (black and white background), and found no evidence for behavioral selection. The apparent response in colour change to background appears to be mediated by the background reflectance of light, that there does not seem to be behavioral selection of matching background by the tadpoles, and therefore it suggests that color change is more likely to be a physiological response with thermoregulatory implications.

Dissociable roles of central striatum and anterior lateral motor area in initiating and sustaining naturalistic behavior

Although much is known about how corticostriatal circuits mediate behavioral selection, most previous work has been conducted in highly trained animals engaged in instrumental tasks. Understanding how corticostriatal circuits mediate behavioral selection and initiation in a naturalistic setting is critical to understanding how the brain chooses and executes behavior in unconstrained situations. Central striatum (CS), an understudied region that lies in the middle of the motor-limbic topography, is well-poised to play an important role in these processes since its main cortical inputs (Corbit et al., 2019) have been implicated in behavioral flexibility (lateral orbitofrontal cortex (Kim and Ragozzino, 2005)) and response preparation (anterior lateral motor area, ALM) (Li et al., 2015), However, although CS activity has been associated with conditioned grooming behavior in transgenic mice (Burguiere et al., 2013), the role of CS and its cortical inputs in the selection of spontaneous behaviors has not been explored. We therefore studied the role of CS corticostriatal circuits in behavioral selection in an open field context.Surprisingly, using fiber photometry in this unconstrained environment, we found that population calcium activity in CS was specifically increased at onset of grooming, and not at onset of other spontaneous behaviors such as rearing or locomotion. Supporting a potential selective role for CS in the initiation of grooming, bilateral optogenetic stimulation of CS evoked immediate onset grooming-related movements. However, these movements resembled subcomponents of grooming behavior and not full-fledged grooming bouts, suggesting that additional input(s) are required to appropriately sequence and sustain this complex motor behavior once initiated. Consistent with this idea, optogenetic stimulation of CS inputs from ALM generated sustained grooming responses that evolved on a time-course paralleling CS activation monitored using single-cell calcium imaging. Furthermore, fiber photometry in ALM demonstrated a gradual ramp in calcium activity that peaked at time of grooming termination, supporting a potential role for ALM in encoding length of this spontaneous sequenced behavior. Finally, dual color dual region fiber photometry indicated that CS activation precedes ALM during naturalistic grooming sequences. Taken together, these data support a novel model in which CS activity is sufficient to initiate grooming behavior, but ALM activity is necessary to sustain and encode the length of grooming bouts. Thus, the use of an unconstrained behavioral paradigm has allowed us to uncover surprising roles for CS and ALM in the initiation and maintenance of spontaneous sequenced behaviors.