Examining the effects of free gaze and dynamic video stimuli on engagement, eye movements, and EEG signal quality in a visual aesthetic rating task

Free gaze and the use of dynamically changing video stimuli are typically avoided in EEG exper- iments to avoid artefacts and confounds related to uncontrolled eye movements. Yet, often it is unclear whether these artificial secondary manipulations might have unwanted effects on the pri- mary measures of interest and for a growing number of research questions removing them would be beneficial: Among those is the investigation of visual aesthetic experiences, which typically involve open-ended exploration of highly variable stimuli. Here we aimed to quantify the effect of fixation task and using still vs. movie stimuli on EEG signal quality and several behavioral and physiological measures of interest during an aesthetic rating task. Participants observed scenes from landscapes and dance performances and rated each stimulus for both aesthetic appeal and their state of boredom while watching it. The scenes were presented either as dynamic video clips or static pictures, and participants observed them either with unconstrained gaze or under attempted fixation We recorded EEG, ECG and eyetracking from 43 participants. An auditory stream of 40Hz amplitude modulated pink noise was played during each trial and signal-to-noise-ratio (SNR) of the auditory steady-state response measured at the scalp was extracted as a proxy measure for overall EEG signal quality. The study including hypotheses and a priori power analysis was preregistered. We found that both behavioral ratings were influenced by the experimental conditions: boredom and aesthetic ratings were positively affected by dynamic video stimuli, indicating that these are experienced as more engaging; both these effects were stronger in dance. As already reported before, landscape stimuli were experienced as more appealing. Fixaton task, on the other hand, had no significant effect on the ratings which is encouraging given how canonically it is applied. Eye movements were significantly affected not only by viewing task, but by stimulus dynamics and content as well: we observed fewer eyeblinks, saccades and microsaccades in video stimuli, and fewer saccades but more microsaccades in dance than in landscape stimuli, with several significant interactions. EEG SNR, to our surprise, was barely affected by fixation task - despite only minimal preprocessing and no trial rejection. We nevertheless believe that the new metric is sensitive to capture noise: it was significantly correlated with the number of eye blinks, and after cleaning the dataset with an ICA based preprocessing pipeline the significant effect of fixation task and the correlation with blink rate vanished. We see these as promising results indicating that at least in the lab more liberal experimental conditions could be achieved without significant loss of signal quality. Specifically the use of dynamic video material bears a lot of potential for future investigations in human neurophysiological studies.

A biomarker and endophenotype for anorexia nervosa?

Objective: Recent research has suggested that a type of atypical eye movement, called square wave jerks, together with anxiety, may distinguish individuals with anorexia nervosa from those without anorexia nervosa and may represent a biomarker and endophenotype for the illness. The aim of this study was to identify the presence of this proposed marker in individuals currently with anorexia nervosa relative to healthy controls, and to identify the state independence and heritability of this putative marker by exploring whether it also exists in individuals who are weight-restored from anorexia nervosa and first-degree relatives (i.e. sisters of people with anorexia nervosa). Methods: Data from 80 female participants (20/group: current anorexia nervosa, weight-restored from anorexia nervosa, sisters of people with anorexia nervosa and healthy controls) were analysed. Square wave jerk rate was acquired during a fixation task, and anxiety was measured with the State Trait Anxiety Inventory. Results: Current anorexia nervosa, weight-restored from anorexia nervosa and sisters of people with anorexia nervosa groups made significantly more square wave jerks than healthy controls, but did not differ from one another. Square wave jerk rate and anxiety were found to discriminate groups with exceptionally high accuracy (current anorexia nervosa vs healthy control = 92.5%; weight-restored from anorexia nervosa vs healthy control = 77.5%; sisters of people with anorexia nervosa vs healthy control = 77.5%; p < .001). Conclusion: The combination of square wave jerk rate and anxiety was found to be a promising two-element marker for anorexia nervosa, and has the potential to be used as a biomarker or endophenotype to identify people at risk of anorexia nervosa and inform future treatments.

GazeBase, a large-scale, multi-stimulus, longitudinal eye movement dataset

This manuscript presents GazeBase, a large-scale longitudinal dataset containing 12,334 monocular eye-movement recordings captured from 322 college-aged participants. Participants completed a battery of seven tasks in two contiguous sessions during each round of recording, including a – (1) fixation task, (2) horizontal saccade task, (3) random oblique saccade task, (4) reading task, (5/6) free viewing of cinematic video task, and (7) gaze-driven gaming task. Nine rounds of recording were conducted over a 37 month period, with participants in each subsequent round recruited exclusively from prior rounds. All data was collected using an EyeLink 1000 eye tracker at a 1,000 Hz sampling rate, with a calibration and validation protocol performed before each task to ensure data quality. Due to its large number of participants and longitudinal nature, GazeBase is well suited for exploring research hypotheses in eye movement biometrics, along with other applications applying machine learning to eye movement signal analysis. Classification labels produced by the instrument’s real-time parser are provided for a subset of GazeBase, along with pupil area.

Differences in perception and memory for speech fragments in complex versus simple words

Two experiments investigated how people perceived and remembered fragments of spoken words that either corresponded to correct lexical entries (as in the complex word drink-er) or did not (as in the simple word glitt-er). Experiment 1 was a noise-rating task that probed perception. Participants heard stimuli such drinker, where strikethrough indicates noise overlaid at a controlled signal-to-noise ratio, and rated the loudness of the noise. Results showed that participants rated noise on certain pseudo-roots (e.g., glitter) as louder than noise on true roots ( drinker), indicating that they perceived them with less clarity. Experiment 2 was an eye-fixation task that probed memory. Participants heard a word such as drink-er while associating each fragment with a visual shape. At test, they saw the shapes again, and were asked to look at the shape associated with a particular fragment, such as drink. Results showed that fixations to shapes associated with pseudo-affixes (-er in glitter) were less accurate than fixations to shapes associated with true affixes (-er in drinker), which suggests that they remembered the pseudo-affixes more poorly. These findings provide evidence that the presence of correct lexical entries for roots and affixes modulates people’s judgments about the speech that they hear.

Fast responses to images of animate and inanimate objects in the nonhuman primate amygdala

Visual information reaches the amygdala through the various stages of the ventral visual stream. There is, however, evidence that a fast subcortical pathway for the processing of emotional visual input exists. To explore the presence of this pathway in primates, we recorded local field potentials in the amygdala of four rhesus monkeys during a passive fixation task showing images of ten object categories. Additionally, in one of the monkeys we also obtained multi-unit spiking activity during the same task. We observed remarkably fast medium and high gamma responses in the amygdala of the four monkeys. These responses were selective for the different stimulus categories, showed within-category selectivity, and peaked as early as 60 ms after stimulus onset. Multi-unit responses in the amygdala were lagging the gamma responses by about 40 ms. Thus, these observations add further evidence that selective visual information reaches the amygdala of nonhuman primates through a very fast route.

The Investigation of Simultaneous EEG and Eye Tracking Characteristics During Fixation Task in Mild Alzheimer’s Disease

Alzheimer’s disease (AD) is a neurodegenerative disorder that occurs many years before the first clinical symptoms. Finding more exact, significant, and valuable criteria or indices for the diagnosis of the mild form of Alzheimer’s disease is very important for clinical and research purposes. Electroencephalography (EEG) and eye tracking biomarkers would provide noninvasive tools for the early detection of AD. Due to the advantages of EEG and eye tracking, in this study, we employed them simultaneously to conduct research on the mild AD. For this purpose, 19 patients with mild AD were compared with 19 gender- and age-matched normal subjects who did not have any history of cognitive or neurological disorders. EEG and eye-tracking data were concurrently collected in both groups in a fixation task. Our results revealed that the total fixation duration was significantly shorter for the AD patients, but their fixation frequency was more than that of the controls. In addition, increased theta power and decreased alpha power were observed in the AD group. Interestingly, there was a statistically significant correlation between fixation frequency and alpha power in the parietal area in the control group. However, this connection was not statistically significant in the AD group. The findings also indicated an elevated coherence in the AD patients in the parieto-occipital area. It is assumed that the AD patients might use the neural compensational processes for the fixation state. This study provides evidence for the simultaneously EEG and eye-tracking changes in the areas, which are involved in the control of the fixational eye movements.

Functional ultrasound imaging of deep visual cortex in awake nonhuman primates

Deep regions of the brain are not easily accessible to investigation at the mesoscale level in awake animals or humans. We have recently developed a functional ultrasound (fUS) technique that enables imaging hemodynamic responses to visual tasks. Using fUS imaging on two awake nonhuman primates performing a passive fixation task, we constructed retinotopic maps at depth in the visual cortex (V1, V2, and V3) in the calcarine and lunate sulci. The maps could be acquired in a single-hour session with relatively few presentations of the stimuli. The spatial resolution of the technology is illustrated by mapping patterns similar to ocular dominance (OD) columns within superficial and deep layers of the primary visual cortex. These acquisitions using fUS suggested that OD selectivity is mostly present in layer IV but with extensions into layers II/III and V. This imaging technology provides a new mesoscale approach to the mapping of brain activity at high spatiotemporal resolution in awake subjects within the whole depth of the cortex.

Positive Relations Between Vision and Posture in the Fixation Task Performed Upright

In an upright stance, individuals sway in unpredictable ways. Their eyes also move in unpredictable ways in fixation tasks. The objective of this study was to analyze visual functions, postural control, and cognitive involvement in stationary gaze. A total of 14 healthy young adults performed a fixation task and a free-viewing task (three trials per task, 45 s per trial). As expected, the results showed many (n = 32) significant positive Pearson correlation coefficients between the eye and center of pressure/body (head, neck, and lower back) movements in the fixation task. In the free-viewing task, the correlations were nonsignificant. Only 3 of the 32 significant correlations (9.4%) were significantly related to cognitive involvement (measured with a subjective questionnaire). These results indirectly strengthened the validity of the synergistic model of postural control.

Effect of Smartphone Use on Intraocular Pressure

The rapidly increasing utilization of smartphones makes ophthalmic problems associated with their use an important issue. This prospective study aimed to determine whether using a smartphone to view visual material is associated with a change in the intraocular pressure (IOP), and to determine which groups of factors best predict the time-dependent increase in IOP with smartphone use. This study included 158 eyes (127 glaucomatous and 31 healthy eyes) recruited from Seoul National University Bundang Hospital. Participants performed a sustained fixation task consisting of watching a movie on a smartphone screen for 30 minutes continuously at a viewing distance of 30 cm. A small but statistically significant time-dependent increase in IOP was observed while viewing a movie on a smartphone, being 10.6 ± 3.1, 11.0 ± 3.3, 11.2 ± 3.4, and 11.6 ± 3.5 mmHg before and 5, 10, and 30 minutes after the fixation task, respectively (P < 0.0001). Recursive partitioning tree analysis revealed that a shallower anterior chamber (<2.32 mm) was the strongest predictive factor for faster time-dependent increase in IOP (0.68 mmHg/minute). A higher visual field mean deviation (≥–0.22 dB), and an older age (≥48 years) were the second and third most influential factors associated with the rate of IOP increase (0.59 and 0.15 mmHg/minute, respectively).

Automaticity in the reading circuitry

Skilled reading requires years of practice associating visual symbols with speech sounds. Over the course of the learning process, this association becomes effortless and automatic. Here we test whether automatic activation of spoken-language circuits in response to visual words is a hallmark of skilled reading. Magnetoencephalography was used to measure word-selective responses under multiple cognitive tasks (N = 42, 7-12 years of age). Even when attention was drawn away from the words by performing an attention-demanding fixation task, strong word-selective responses were found in a language region (i.e., superior temporal gyrus) starting at ~300 ms after stimulus onset. Critically, this automatic word-selective response was indicative of reading skill: the magnitude of word-selective responses correlated with individual reading skill. Our results suggest that automatic recruitment of spoken-language circuits is a hallmark of skilled reading; with practice, reading becomes effortless as the brain learns to automatically translate letters into sounds and meaning.