Spurious normativity enhances learning of compliance and enforcement behavior in artificial agents

How do societies learn and maintain social norms? Here we use multiagent reinforcement learning to investigate the learning dynamics of enforcement and compliance behaviors. Artificial agents populate a foraging environment and need to learn to avoid a poisonous berry. Agents learn to avoid eating poisonous berries better when doing so is taboo, meaning the behavior is punished by other agents. The taboo helps overcome a credit assignment problem in discovering delayed health effects. Critically, introducing an additional taboo, which results in punishment for eating a harmless berry, further improves overall returns. This “silly rule” counterintuitively has a positive effect because it gives agents more practice in learning rule enforcement. By probing what individual agents have learned, we demonstrate that normative behavior relies on a sequence of learned skills. Learning rule compliance builds upon prior learning of rule enforcement by other agents. Our results highlight the benefit of employing a multiagent reinforcement learning computational model focused on learning to implement complex actions.

Ocean Regime Shift is Driving Collapse of the North Atlantic Right Whale Population

Ocean warming linked to anthropogenic climate change is impacting the ecology of marine species around the world. In 2010, the Gulf of Maine and Scotian Shelf regions of the Northwest Atlantic underwent an unprecedented regime shift. Forced by climate-driven changes in the Gulf Stream, warm slope waters entered the region and created a less favorable foraging environment for the endangered North Atlantic right whale population. By mid-decade, right whales had shifted their late spring/summer foraging grounds from the Gulf of Maine and the western Scotian Shelf to the Gulf of St. Lawrence. The population also began exhibiting unusually high mortality in 2017. Here, we report that climate-driven changes in ocean circulation have altered the foraging environment and habitat use of right whales, reducing the population’s calving rate and exposing it to greater mortality risks from ship strikes and fishing gear entanglement. The case of the North Atlantic right whale provides a cautionary tale for the management of protected species in a changing ocean.

Decadal changes in blood δ 13 C values, at-sea distribution, and weaning mass of southern elephant seals from Kerguelen Islands

Changes in the foraging environment and at-sea distribution of southern elephant seals from Kerguelen Islands were investigated over a decade (2004–2018) using tracking, weaning mass, and blood δ 13 C values. Females showed either a sub-Antarctic or an Antarctic foraging strategy, and no significant shift in their at-sea distribution was detected between 2004 and 2017. The proportion of females foraging in sub-Antarctic versus Antarctic habitats did not change over the 2006–2018 period. Pup weaning mass varied according to the foraging habitat of their mothers. The weaning mass of sub-Antarctic foraging mothers' pups decreased by 11.7 kg over the study period, but they were on average 5.8 kg heavier than pups from Antarctic foraging mothers. Pup blood δ 13 C values decreased by 1.1‰ over the study period regardless of their sex and the presumed foraging habitat of their mothers. Together, these results suggest an ecological change is occurring within the Indian sector of the Southern Ocean with possible consequences on the foraging performance of southern elephant seals. We hypothesize that this shift in δ 13 C is related to a change in primary production and/or in the composition of phytoplankton communities, but this requires further multidisciplinary investigations.

Self-regulation and theforaginggene (PRKG1) in humans

Foraging is a goal-directed behavior that balances the need to explore the environment for resources with the need to exploit those resources. InDrosophila melanogaster, distinct phenotypes have been observed in relation to theforaginggene (for), labeled the rover and sitter. Adult rovers explore their environs more extensively than do adult sitters. We explored whether this distinction would be conserved in humans. We made use of a distinction from regulatory mode theory between those who “get on with it,” so-called locomotors, and those who prefer to ensure they “do the right thing,” so-called assessors. In this logic, rovers and locomotors share similarities in goal pursuit, as do sitters and assessors. We showed that genetic variation inPRKG1, the human ortholog offor, is associated with preferential adoption of a specific regulatory mode. Next, participants performed a foraging task to see whether genetic differences associated with distinct regulatory modes would be associated with distinct goal pursuit patterns. Assessors tended to hug the boundary of the foraging environment, much like behaviors seen inDrosophilaadult sitters. In a patchy foraging environment, assessors adopted more cautious search strategies maximizing exploitation. These results show that distinct patterns of goal pursuit are associated with particular genotypes ofPRKG1, the human ortholog offor.

In polytocous mammals, weakling neonates, but not their stronger littermates, benefit from specialized foraging

Adjusting foraging strategies is a common phenomenon within groups of animals competing for the same resource. In polytocous mammals, neonates concurrently compete for limited milk and alternate between two foraging (suckling) strategies: adaptable exploratory foraging with random sampling of teats, and ordered foraging with a tendency towards exploiting a particular suckling position. Some theoretical (game theory) models have shown that weaker siblings in particular benefit from foraging specialization (suckling order). Neonate piglets establish a well-defined suckling order that develops gradually and fluctuates throughout the lactation period, implying the existence of inter-individual differences in foraging strategies. We therefore analyzed suckling behavior in pigs to determine whether one foraging strategy was more beneficial to neonates in terms of their body weight and foraging environment. We found that intermediate and heavy littermates tended to adjust their suckling strategy according to the foraging environment; however, the selected foraging strategy did not affect their overall growth performance. Lighter individuals that consumed significantly less milk did not greatly alternate their foraging strategy according to the foraging environment, but their growth rate was significantly higher whenever they performed less-exploratory foraging behavior. Although suckling order appeared to be a relatively stable behavioral phenotype, it was beneficial exclusively for weaklings. These results confirm theoretical predictions and indicate that specializing in a suckling position is a beneficial strategy for weaker, light neonates. These findings suggest that physically weaker neonates might have driven the evolution of neonatal foraging specialization.