scholarly journals Real-time audio processing of real-life soundscapes for EEG analysis: ERPs based on natural sound onsets

2021 ◽  
Author(s):  
Daniel Hölle ◽  
Sarah Blum ◽  
Sven Kissner ◽  
Stefan Debener ◽  
Martin Georg Bleichner

With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS) and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed that the temporal precision of the system is very good. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.

2021 ◽  
Author(s):  
Santiago Morales ◽  
Maureen Bowers

EEG provides a rich measure of brain activity that can be characterized as neuronal oscillations. However, most developmental EEG work to date has focused on analyzing EEG data as Event-Related Potentials (ERPs) or power based on the Fourier transform. While these measures have been productive, they do not leverage all the information contained within the EEG signal. Namely, ERP analyses ignore non-phase-locked signals and Fourier-based power analyses ignore temporal information. Time-frequency analyses can better characterize the oscillations contained in the EEG data. By separating power and phase information across different frequencies, time-frequency measures provide a closer interpretation of the neurophysiological mechanisms, facilitate translation across neurophysiology disciplines, and capture processes not observed by ERP or Fourier-based analyses (e.g., connectivity). Despite their unique contributions, a literature review of this journal reveals that time-frequency analyses of EEG are yet to be embraced by the developmental cognitive neuroscience field. This manuscript presents a conceptual introduction to time-frequency analyses for developmental researchers. To facilitate the use of time-frequency analyses, we include a tutorial of accessible scripts, based on Cohen (2014), to calculate time-frequency power (signal strength), inter-trial phase synchrony (signal consistency), and two types of phase-based connectivity (inter-channel phase synchrony and weighted phase lag index).


2019 ◽  
Author(s):  
Samuel A Neymotin ◽  
Dylan S Daniels ◽  
Blake Caldwell ◽  
Robert A McDougal ◽  
Nicholas T Carnevale ◽  
...  

AbstractMagneto- and electro-encephalography (MEG/EEG) non-invasively record human brain activity with millisecond resolution providing reliable markers of healthy and disease states. Relating these macroscopic signals to underlying cellular- and circuit-level generators is a limitation that constrains using MEG/EEG to reveal novel principles of information processing or to translate findings into new therapies for neuropathology. To address this problem, we built Human Neocortical Neurosolver (HNN, https://hnn.brown.edu) software. HNN has a graphical user interface designed to help researchers and clinicians interpret the neural origins of MEG/EEG. HNN’s core is a neocortical circuit model that accounts for biophysical origins of electrical currents generating MEG/EEG. Data can be directly compared to simulated signals and parameters easily manipulated to develop/test hypotheses on a signal’s origin. Tutorials teach users to simulate commonly measured signals, including event related potentials and brain rhythms. HNN’s ability to associate signals across scales makes it a unique tool for translational neuroscience research.


eLife ◽  
2020 ◽  
Vol 9 ◽  
Author(s):  
Samuel A Neymotin ◽  
Dylan S Daniels ◽  
Blake Caldwell ◽  
Robert A McDougal ◽  
Nicholas T Carnevale ◽  
...  

Magneto- and electro-encephalography (MEG/EEG) non-invasively record human brain activity with millisecond resolution providing reliable markers of healthy and disease states. Relating these macroscopic signals to underlying cellular- and circuit-level generators is a limitation that constrains using MEG/EEG to reveal novel principles of information processing or to translate findings into new therapies for neuropathology. To address this problem, we built Human Neocortical Neurosolver (HNN, https://hnn.brown.edu) software. HNN has a graphical user interface designed to help researchers and clinicians interpret the neural origins of MEG/EEG. HNN’s core is a neocortical circuit model that accounts for biophysical origins of electrical currents generating MEG/EEG. Data can be directly compared to simulated signals and parameters easily manipulated to develop/test hypotheses on a signal’s origin. Tutorials teach users to simulate commonly measured signals, including event related potentials and brain rhythms. HNN’s ability to associate signals across scales makes it a unique tool for translational neuroscience research.


2021 ◽  
Vol 11 (7) ◽  
pp. 835
Author(s):  
Alexander Rokos ◽  
Richard Mah ◽  
Rober Boshra ◽  
Amabilis Harrison ◽  
Tsee Leng Choy ◽  
...  

A consistent limitation when designing event-related potential paradigms and interpreting results is a lack of consideration of the multivariate factors that affect their elicitation and detection in behaviorally unresponsive individuals. This paper provides a retrospective commentary on three factors that influence the presence and morphology of long-latency event-related potentials—the P3b and N400. We analyze event-related potentials derived from electroencephalographic (EEG) data collected from small groups of healthy youth and healthy elderly to illustrate the effect of paradigm strength and subject age; we analyze ERPs collected from an individual with severe traumatic brain injury to illustrate the effect of stimulus presentation speed. Based on these critical factors, we support that: (1) the strongest paradigms should be used to elicit event-related potentials in unresponsive populations; (2) interpretation of event-related potential results should account for participant age; and (3) speed of stimulus presentation should be slower in unresponsive individuals. The application of these practices when eliciting and recording event-related potentials in unresponsive individuals will help to minimize result interpretation ambiguity, increase confidence in conclusions, and advance the understanding of the relationship between long-latency event-related potentials and states of consciousness.


2018 ◽  
Vol 35 (3) ◽  
pp. 315-331 ◽  
Author(s):  
Paula Virtala ◽  
Minna Huotilainen ◽  
Esa Lilja ◽  
Juha Ojala ◽  
Mari Tervaniemi

Guitar distortion used in rock music modifies a chord so that new frequencies appear in its harmonic structure. A distorted dyad (power chord) has a special role in heavy metal music due to its harmonics that create a major third interval, making it similar to a major chord. We investigated how distortion affects cortical auditory processing of chords in musicians and nonmusicians. Electric guitar chords with or without distortion and with or without the interval of the major third (i.e., triads or dyads) were presented in an oddball design where one of them served as a repeating standard stimulus and others served as occasional deviants. This enabled the recording of event-related potentials (ERPs) of the electroencephalogram (EEG) related to deviance processing (the mismatch negativity MMN and the attention-related P3a component) in an ignore condition. MMN and P3a responses were elicited in most paradigms. Distorted chords in a nondistorted context only elicited early P3a responses. However, the power chord did not demonstrate a special role in the level of the ERPs. Earlier and larger MMN and P3a responses were elicited when distortion was modified compared to when only harmony (triad vs. dyad) was modified between standards and deviants. The MMN responses were largest when distortion and harmony deviated simultaneously. Musicians demonstrated larger P3a responses than nonmusicians. The results suggest mostly independent cortical auditory processing of distortion and harmony in Western individuals, and facilitated chord change processing in musicians compared to nonmusicians. While distortion has been used in heavy rock music for decades, this study is among the first ones to shed light on its cortical basis.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Saugat Bhattacharyya ◽  
Davide Valeriani ◽  
Caterina Cinel ◽  
Luca Citi ◽  
Riccardo Poli

AbstractIn this paper we present, and test in two realistic environments, collaborative Brain-Computer Interfaces (cBCIs) that can significantly increase both the speed and the accuracy of perceptual group decision-making. The key distinguishing features of this work are: (1) our cBCIs combine behavioural, physiological and neural data in such a way as to be able to provide a group decision at any time after the quickest team member casts their vote, but the quality of a cBCI-assisted decision improves monotonically the longer the group decision can wait; (2) we apply our cBCIs to two realistic scenarios of military relevance (patrolling a dark corridor and manning an outpost at night where users need to identify any unidentified characters that appear) in which decisions are based on information conveyed through video feeds; and (3) our cBCIs exploit Event-Related Potentials (ERPs) elicited in brain activity by the appearance of potential threats but, uniquely, the appearance time is estimated automatically by the system (rather than being unrealistically provided to it). As a result of these elements, in the two test environments, groups assisted by our cBCIs make both more accurate and faster decisions than when individual decisions are integrated in more traditional manners.


Author(s):  
Luodi Yu ◽  
Jiajing Zeng ◽  
Suiping Wang ◽  
Yang Zhang

Purpose This study aimed to examine whether abstract knowledge of word-level linguistic prosody is independent of or integrated with phonetic knowledge. Method Event-related potential (ERP) responses were measured from 18 adult listeners while they listened to native and nonnative word-level prosody in speech and in nonspeech. The prosodic phonology (speech) conditions included disyllabic pseudowords spoken in Chinese and in English matched for syllabic structure, duration, and intensity. The prosodic acoustic (nonspeech) conditions were hummed versions of the speech stimuli, which eliminated the phonetic content while preserving the acoustic prosodic features. Results We observed language-specific effects on the ERP that native stimuli elicited larger late negative response (LNR) amplitude than nonnative stimuli in the prosodic phonology conditions. However, no such effect was observed in the phoneme-free prosodic acoustic control conditions. Conclusions The results support the integration view that word-level linguistic prosody likely relies on the phonetic content where the acoustic cues embedded in. It remains to be examined whether the LNR may serve as a neural signature for language-specific processing of prosodic phonology beyond auditory processing of the critical acoustic cues at the suprasyllabic level.


1991 ◽  
Vol 3 (2) ◽  
pp. 151-165 ◽  
Author(s):  
Helen Neville ◽  
Janet L. Nicol ◽  
Andrew Barss ◽  
Kenneth I. Forster ◽  
Merrill F. Garrett

Theoretical considerations and diverse empirical data from clinical, psycholinguistic, and developmental studies suggest that language comprehension processes are decomposable into separate subsystems, including distinct systems for semantic and grammatical processing. Here we report that event-related potentials (ERPs) to syntactically well-formed but semantically anomalous sentences produced a pattern of brain activity that is distinct in timing and distribution from the patterns elicited by syntactically deviant sentences, and further, that different types of syntactic deviance produced distinct ERP patterns. Forty right-handed young adults read sentences presented at 2 words/sec while ERPs were recorded from over several positions between and within the hemispheres. Half of the sentences were semantically and grammatically acceptable and were controls for the remainder, which contained sentence medial words that violated (1) semantic expectations, (2) phrase structure rules, or (3) WH-movement constraints on Specificity and (4) Subjacency. As in prior research, the semantic anomalies produced a negative potential, N400, that was bilaterally distributed and was largest over posterior regions. The phrase structure violations enhanced the N125 response over anterior regions of the left hemisphere, and elicited a negative response (300-500 msec) over temporal and parietal regions of the left hemisphere. Violations of Specificity constraints produced a slow negative potential, evident by 125 msec, that was also largest over anterior regions of the left hemisphere. Violations of Subjacency constraints elicited a broadly and symmetrically distributed positivity that onset around 200 msec. The distinct timing and distribution of these effects provide biological support for theories that distinguish between these types of grammatical rules and constraints and more generally for the proposal that semantic and grammatical processes are distinct subsystems within the language faculty.


Sign in / Sign up

Export Citation Format

Share Document