Riemannian classification of single-trial surface EEG and sources during checkerboard and navigational images in humans

Objective Different visual stimuli are classically used for triggering visual evoked potentials comprising well-defined components linked to the content of the displayed image. These evoked components result from the average of ongoing EEG signals in which additive and oscillatory mechanisms contribute to the component morphology. The evoked related potentials often resulted from a mixed situation (power variation and phase-locking) making basic and clinical interpretations difficult. Besides, the grand average methodology produced artificial constructs that do not reflect individual peculiarities. This motivated new approaches based on single-trial analysis as recently used in the brain-computer interface field. Approach We hypothesize that EEG signals may include specific information about the visual features of the displayed image and that such distinctive traits can be identified by state-of-the-art classification algorithms based on Riemannian geometry. The same classification algorithms are also applied to the dipole sources estimated by sLORETA. Main results and significance We show that our classification pipeline can effectively discriminate between the display of different visual items (Checkerboard versus 3D navigational image) in single EEG trials throughout multiple subjects. The present methodology reaches a single-trial classification accuracy of about 84% and 93% for inter-subject and intra-subject classification respectively using surface EEG. Interestingly, we note that the classification algorithms trained on sLORETA sources estimation fail to generalize among multiple subjects (63%), which may be due to either the average head model used by sLORETA or the subsequent spatial filtering failing to extract discriminative information, but reach an intra-subject classification accuracy of 82%.

Algebra dissociates from arithmetic in the brain semantic network

Background Mathematical expressions mainly include arithmetic (such as 8 − (1 + 3)) and algebra (such as a − (b + c)). Previous studies have shown that both algebraic processing and arithmetic involved the bilateral parietal brain regions. Although previous studies have revealed that algebra was dissociated from arithmetic, the neural bases of the dissociation between algebraic processing and arithmetic is still unclear. The present study uses functional magnetic resonance imaging (fMRI) to identify the specific brain networks for algebraic and arithmetic processing. Methods Using fMRI, this study scanned 30 undergraduates and directly compared the brain activation during algebra and arithmetic. Brain activations, single-trial (item-wise) interindividual correlation and mean-trial interindividual correlation related to algebra processing were compared with those related to arithmetic. The functional connectivity was analyzed by a seed-based region of interest (ROI)-to-ROI analysis. Results Brain activation analyses showed that algebra elicited greater activation in the angular gyrus and arithmetic elicited greater activation in the bilateral supplementary motor area, left insula, and left inferior parietal lobule. Interindividual single-trial brain-behavior correlation revealed significant brain-behavior correlations in the semantic network, including the middle temporal gyri, inferior frontal gyri, dorsomedial prefrontal cortices, and left angular gyrus, for algebra. For arithmetic, the significant brain-behavior correlations were located in the phonological network, including the precentral gyrus and supplementary motor area, and in the visuospatial network, including the bilateral superior parietal lobules. For algebra, significant positive functional connectivity was observed between the visuospatial network and semantic network, whereas for arithmetic, significant positive functional connectivity was observed only between the visuospatial network and phonological network. Conclusion These findings suggest that algebra relies on the semantic network and conversely, arithmetic relies on the phonological and visuospatial networks.

An EMD and IMF Energy Entropy Based Optimized Feature Extraction and Classification Scheme for Single Trial EEG Signal

For the purpose of improving the classification accuracy of single trial EEG signal during motor imagery (MI) process, this study proposed a classification method which combined IMF energy entropy and improved EMD scheme. Singular value decomposition (SVD), Gaussian mixture model, EMD and IMF energy entropy were employed for the newly designed scheme. After removing noise and artifacts from acquired EEG signals in EEGLAB, SVD was applied, and the singular values were clustered by Gaussian mixture model. The insignificant characteristics indicated by the small SVD values were then removed, and the signals were reconstructed, feeding to EMD algorithm. Those IMFs mapping to δ、θ、α and β frequencies were selected as the major features of the EEG signal. The SVM classifier with RBF, linear, and polynomial kernel functions and voting mechanism then kicked in for classification. The results were compared with that of the traditional EMD and EEMD through simulation, showing that the proposed scheme can eliminate mode mixing effectively and improve the single trial EEG signal classification accuracy significantly, suggesting the probability of designing a more efficient EEG control system based on the proposed scheme.

A novel theoretical framework for simultaneous measurement of excitatory and inhibitory conductances

The firing of neurons throughout the brain is determined by the precise relations between excitatory and inhibitory inputs, and disruption of their balance underlies many psychiatric diseases. Whether or not these inputs covary over time or between repeated stimuli remains unclear due to the lack of experimental methods for measuring both inputs simultaneously. We developed a new analytical framework for instantaneous and simultaneous measurements of both the excitatory and inhibitory neuronal inputs during a single trial under current clamp recording. This can be achieved by injecting a current composed of two high frequency sinusoidal components followed by analytical extraction of the conductances. We demonstrate the ability of this method to measure both inputs in a single trial under realistic recording constraints and from morphologically realistic CA1 pyramidal model cells. Future experimental implementation of our new method will facilitate the understanding of fundamental questions about the health and disease of the nervous system.

Single-trial detection of EEG error-related potentials in serial visual presentation paradigm

When the outcome of an event is not the same as expected, the cognitive state that monitors performance elicits a time-locked brain response termed as Error-Related Potential (ErrP). Objective – In the existing work, ErrP is not recorded when there is a disassociation between an object and its description. The objective of this work is to propose a Serial Visual Presentation (SVP) experimental paradigm to record ErrP when an image and its label are disassociated. Additionally, this work aims to propose a novel method for detecting ErrP on a single-trial basis. Method – The method followed in this work includes designing of SVP paradigm in which labeled images from six categories (bike, car, flower, fruit, cat, and dog) are presented serially. In this work, a text (visual) or an audio clip describing the image in one word is presented as the label. Further, the ErrP is detected on a single-trial basis using novel electrode-averaged features. Results - The ErrP data recorded from 11 subjects’ have consistent characteristics compared to existing ErrP literature. Detection of ErrP on a single-trial basis is carried out using a novel feature extraction method on two type labeling types separately. The best average classification accuracy achieved is 69.09±4.70% and 63.33±4.56% for the audio and visual type of labeling the image, respectively. The proposed feature extraction method achieved higher classification accuracy when compared with two existing feature extraction methods. Significance - The significance of this work is that it can be used as a Brain-Computer Interface (BCI) system for quantitative evaluation and treatment of mild cognitive impairment. This work can also find non-clinical BCI applications such as image annotation.

Does the brain care about averages? A simple test.

Trial-averaged metrics, e.g. in the form of tuning curves and population response vectors, are a basic and widely accepted way of characterizing neuronal activity. But how relevant are such trial-averaged responses to neuronal computation itself? Here we present a simple test to estimate whether average responses reflect aspects of neuronal activity that contribute to neuronal processing in a specific context. The test probes two assumptions inherent in the usage of average neuronal metrics: 1) Reliability: Neuronal responses repeat consistently enough across single stimulus instances that the average response template they relate to remains recognizable to downstream regions. 2) Behavioural relevance: If a single-trial response is more similar to the average template, this should make it easier for the animal to identify the correct stimulus or action. We apply this test to a large publicly available data set featuring electrophysiological recordings from 42 cortical areas in behaving mice. In this data set, we show that single-trial responses were less correlated to the average response template than one would expect if they simply represented discrete versions of the template, down-sampled to a finite number of spikes. Moreover, single-trial responses were barely stimulus-specific — they could not be clearly assigned to the average response template of one stimulus. Most importantly, better-matched single-trial responses did not predict accurate behaviour for any of the recorded cortical areas. We conclude that in this data set, average responses do not seem particularly relevant to neuronal computation in a majority of brain areas, and we encourage other researchers to apply similar tests when using trial-averaged neuronal metrics.

A deep learning framework for inference of single-trial neural population activity from calcium imaging with sub-frame temporal resolution

In many brain areas, neural populations act as a coordinated network whose state is tied to behavior on a moment-by-moment basis and millisecond timescale. Two-photon (2p) calcium imaging is a powerful tool to probe network-scale computation, as it can measure the activity of many individual neurons, monitor multiple layers simultaneously, and sample from identified cell types. However, estimating network states and dynamics from 2p measurements has proven challenging because of noise, inherent nonlinearities, and limitations on temporal resolution. Here we describe RADICaL, a deep learning method to overcome these limitations at the population level. RADICaL extends methods that exploit dynamics in spiking activity for application to deconvolved calcium signals, whose statistics and temporal dynamics are quite distinct from electrophysiologically-recorded spikes. It incorporates a novel network training strategy that exploits the timing of 2p sampling to recover network dynamics with high temporal precision. In synthetic tests, RADICaL infers network states more accurately than previous methods, particularly for high-frequency components. In real 2p recordings from sensorimotor areas in mice performing a "water grab" task, RADICaL infers network states with close correspondence to single-trial variations in behavior, and maintains high-quality inference even when neuronal populations are substantially reduced.

High-frequency changes in single-trial visual evoked potentials for unattended stimuli in chronic schizophrenia

Patients with schizophrenia reveal changes in information processing associated with external stimuli, which is reflected in the measurements of brain evoked potentials. We discuss actual knowledge on electro- (EEG) and magnetoencephalographic (MEG) changes in schizophrenia. The commonly used averaging technique entails the loss of information regarding the generation of evoked responses. We propose a methodology to describe single-trial (non-averaged) visual evoked potentials (VEP) using spectral and statistical analyses. We analysed EEG data registered in the O1-Cz and O2-Cz leads during unattended pattern-reversal stimulation, collected from a group of adult patients with chronic schizophrenia, and compared them to those of healthy individuals. Short-time single-trial VEP were transformed to the frequency domain using the FFT algorithm. Changes of the spectral power were visualized using spectrograms which were created by stacking single-trial spectra across all trials. Measures of the absolute and the relative spectral power were calculated and compared statistically. In schizophrenia, the energy density of VEP oscillations is shifted towards higher (gamma) frequencies, compared to healthy individuals. These differences are statistically significant in all analysed frequency bands for the relative power. This indicates distorted early processing of visual stimuli in schizophrenia. The presented observations complement the knowledge on gamma oscillations acquired from computationally more complex methods of time--frequency analysis.