Machine Learning Based Color Classification by Means of Visually Evoked Potentials

Visually evoked potentials (VEPs) are widely used for diagnoses of different neurological diseases. Interestingly, there is limited research about the impact of the stimulus color onto the evoked response. Therefore, in our study we investigated the possibility of automatically classifying the stimulus color. The visual stimuli were selected to be red/black and green/black checkerboard patterns with equal light density. Both of these stimuli were presented in a random manner to nine subjects, while the electroencephalogram was recorded at the occipital lobe. After pre-processing and aligning the evoked potentials, an artificial neural network with one hidden layer was used to investigate the general possibility to automatically classify the stimulus color in three different settings. First, color classification with individually trained models, color classification with a common model, and color classification for each individual volunteer with a model trained on the data of the remaining subjects. With an average accuracy (ACC) of 0.83, the best results were achieved for the individually trained model. Also, the second (mean ACC = 0.76) and third experiments (mean ACC = 0.71) indicated a reasonable predictive accuracy across all subjects. Consequently, machine learning tools are able to appropriately classify stimuli colors based on VEPs. Although further studies are needed to improve the classification performance of our approach, this opens new fields of applications for VEPs.

Multiplicative priming of the correct response can explain the interaction between Simon and flanker congruency

In the Simon task, participants perform a decision on non-spatial features (e.g., stimulus color) by responding with a left or right key-press to a stimulus presented on the left or right side of the screen. In the flanker task, they classify the central character while ignoring the flanking characters. In each task, there is a conflict between the response-relevant features and the response-irrelevant features (i.e., the location on the screen for the Simon task, and the flankers for the flanker task). Thus, in both tasks, resolving conflict requires to inhibit irrelevant features and to focus on relevant features. When both tasks were combined within the same trial (e.g., when the row of characters was presented on the left or right side of the screen), most previous research has shown an interaction. In the present study, we investigated whether this interaction is affected by a multiplicative priming of the correct response occurring when both Simon and flanker irrelevant features co-activate the correct response (Exp. 1), a spatial overlap between Simon and flanker features (Exp. 2), and the learning of stimulus-response pairings (Exp. 3). The results only show an impact of multiplicative priming.

Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions

Working memory (WM) plays an important role in action planning and decision making; however, both the informational content of memory and how that information is used in decisions remain poorly understood. To investigate this, we used a color WM task in which subjects viewed colored stimuli and reported both an estimate of a stimulus color and a measure of memory uncertainty, obtained through a rewarded decision. Reported memory uncertainty is correlated with memory error, showing that people incorporate their trial-to-trial memory quality into rewarded decisions. Moreover, memory uncertainty can be combined with other sources of information; after inducing expectations (prior beliefs) about stimuli probabilities, we found that estimates became shifted toward expected colors, with the shift increasing with reported uncertainty. The data are best fit by models in which people incorporate their trial-to-trial memory uncertainty with potential rewards and prior beliefs. Our results suggest that WM represents uncertainty information, and that this can be combined with prior beliefs. This highlights the potential complexity of WM representations and shows that rewarded decision can be a powerful tool for examining WM and informing and constraining theoretical, computational, and neurobiological models of memory.

Oscillatory Mechanisms of Response Conflict Elicited by Color and Motion Direction: An Individual Differences Approach

Goal-directed behavior requires control over automatic behavior, for example, when goal-irrelevant information from the environment captures an inappropriate response and conflicts with the correct, goal-relevant action. Neural oscillations in the theta band (∼6 Hz) measured at midfrontal electrodes are thought to form an important substrate of the detection and subsequent resolution of response conflict. Here, we examined the extent to which response conflict and associated theta-band activity depend on the visual stimulus feature dimension that triggers the conflict. We used a feature-based Simon task to manipulate conflict by motion direction and stimulus color. Analyses were focused on individual differences in behavioral response conflict elicited across different stimulus dimensions and their relationship to conflict-related midfrontal theta. We first confirmed the presence of response conflict elicited by task-irrelevant motion and stimulus color, demonstrating the usefulness of our modified version of the Simon task to assess different sensory origins of response conflict. Despite titrating overall task performance, we observed large individual differences in the behavioral manifestations of response conflict elicited by the different visual dimensions. These behavioral conflict effects were mirrored in a dimension-specific relationship with conflict-related midfrontal theta power, such that, for each dimension, individual midfrontal theta power was generally higher when experienced response conflict was high. Finally, exploratory analyses of interregional functional connectivity suggested a role for phase synchronization between frontal and parietal scalp sites in modulating experienced conflict when color was the task-relevant visual dimension. Highlighting the importance of an individual differences approach in cognitive neuroscience, these results reveal large individual differences in experienced response conflict depending on the source of visual interference, which are predicted by conflict-related midfrontal theta power.