Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks

Recurrent spiking neural networks (RSNN) in the brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and their training requires very few examples. This motivates the search for biologically inspired learning rules for RSNNs, aiming to improve our understanding of brain computation and the efficiency of artificial intelligence. Several spiking models and learning rules have been proposed, but it remains a challenge to design RSNNs whose learning relies on biologically plausible mechanisms and are capable of solving complex temporal tasks. In this paper, we derive a learning rule, local to the synapse, from a simple mathematical principle, the maximization of the likelihood for the network to solve a specific task. We propose a novel target-based learning scheme in which the learning rule derived from likelihood maximization is used to mimic a specific spatio-temporal spike pattern that encodes the solution to complex temporal tasks. This method makes the learning extremely rapid and precise, outperforming state of the art algorithms for RSNNs. While error-based approaches, (e.g. e-prop) trial after trial optimize the internal sequence of spikes in order to progressively minimize the MSE we assume that a signal randomly projected from an external origin (e.g. from other brain areas) directly defines the target sequence. This facilitates the learning procedure since the network is trained from the beginning to reproduce the desired internal sequence. We propose two versions of our learning rule: spike-dependent and voltage-dependent. We find that the latter provides remarkable benefits in terms of learning speed and robustness to noise. We demonstrate the capacity of our model to tackle several problems like learning multidimensional trajectories and solving the classical temporal XOR benchmark. Finally, we show that an online approximation of the gradient ascent, in addition to guaranteeing complete locality in time and space, allows learning after very few presentations of the target output. Our model can be applied to different types of biological neurons. The analytically derived plasticity learning rule is specific to each neuron model and can produce a theoretical prediction for experimental validation.

Robust Trajectory Generation for Robotic Control on the Neuromorphic Research Chip Loihi

Neuromorphic hardware has several promising advantages compared to von Neumann architectures and is highly interesting for robot control. However, despite the high speed and energy efficiency of neuromorphic computing, algorithms utilizing this hardware in control scenarios are still rare. One problem is the transition from fast spiking activity on the hardware, which acts on a timescale of a few milliseconds, to a control-relevant timescale on the order of hundreds of milliseconds. Another problem is the execution of complex trajectories, which requires spiking activity to contain sufficient variability, while at the same time, for reliable performance, network dynamics must be adequately robust against noise. In this study we exploit a recently developed biologically-inspired spiking neural network model, the so-called anisotropic network. We identified and transferred the core principles of the anisotropic network to neuromorphic hardware using Intel's neuromorphic research chip Loihi and validated the system on trajectories from a motor-control task performed by a robot arm. We developed a network architecture including the anisotropic network and a pooling layer which allows fast spike read-out from the chip and performs an inherent regularization. With this, we show that the anisotropic network on Loihi reliably encodes sequential patterns of neural activity, each representing a robotic action, and that the patterns allow the generation of multidimensional trajectories on control-relevant timescales. Taken together, our study presents a new algorithm that allows the generation of complex robotic movements as a building block for robotic control using state of the art neuromorphic hardware.

Born this way? A review of neurobiological and environmental evidence for the etiology of psychopathy

Across a significant body of research, psychopathy has often been conceptualized as a biologically based malady. In this research, genetic and neurobiological differences have been conceptualized to underlie psychopathy, while affected individuals’ life experiences only influence expressed psychopathic features and their severity. Psychopathy research has largely ignored developmental evidence demonstrating significant influences of environment on both biological and behavioral processes, resulting in several prominent criticisms (Edens & Vincent, 2008; Loeber, Byrd, & Farrington, 2015). The current review was conducted with two main aims: (a) to collect and consider etiological evidence from the extant body of research on genetic and neurobiological factors in psychopathy; and (b) to evaluate findings from genetic, neurotransmitter, brain structure, and brain function studies in the context of relevant evidence from developmental research. Examples from research on adversity and traumatic stress, a common correlate of psychopathy, were used to highlight current research gaps and future directions to aid in the integration of developmental and neurobiological research agendas. While some promising evidence exists regarding possible underlying neurobiological processes of psychopathic traits, this evidence is insufficient to suggest a largely biological etiology for the disorder. Further, information from developmental and epigenetic research may suggest complex, multidimensional trajectories for individuals experiencing psychopathy. Based on these observations, the authors make several recommendations for future research, as well as for current clinical application and practice.