Resting-State Functional Connectivity in the Dorsal Attention Network Relates to Behavioral Performance in Spatial Attention Tasks and May Show Task-Related Adaptation

Between-subject variability in cognitive performance has been related to inter-individual differences in functional brain networks. Targeting the dorsal attention network (DAN) we questioned (i) whether resting-state functional connectivity (FC) within the DAN can predict individual performance in spatial attention tasks and (ii) whether there is short-term adaptation of DAN-FC in response to task engagement. Twenty-seven participants first underwent resting-state fMRI (PRE run), they subsequently performed different tasks of spatial attention [including visual search (VS)] and immediately afterwards received another rs-fMRI (POST run). Intra- and inter-hemispheric FC between core hubs of the DAN, bilateral intraparietal sulcus (IPS) and frontal eye field (FEF), was analyzed and compared between PRE and POST. Furthermore, we investigated rs-fMRI-behavior correlations between the DAN-FC in PRE/POST and task performance parameters. The absolute DAN-FC did not change from PRE to POST. However, different significant rs-fMRI-behavior correlations were revealed for intra-/inter-hemispheric connections in the PRE and POST run. The stronger the FC between left FEF and IPS before task engagement, the better was the learning effect (improvement of reaction times) in VS (r = 0.521, p = 0.024). And the faster the VS (mean RT), the stronger was the FC between right FEF and IPS after task engagement (r = −0.502, p = 0.032). To conclude, DAN-FC relates to the individual performance in spatial attention tasks supporting the view of functional brain networks as priors for cognitive ability. Despite a high inter- and intra-individual stability of DAN-FC, the change of FC-behavior correlations after task performance possibly indicates task-related adaptation of the DAN, underlining that behavioral experiences may shape intrinsic brain activity. However, spontaneous state fluctuations of the DAN-FC over time cannot be fully ruled out as an alternative explanation.

Deterioration Level Estimation Based on Convolutional Neural Network Using Confidence-Aware Attention Mechanism for Infrastructure Inspection

This paper presents deterioration level estimation based on convolutional neural networks using a confidence-aware attention mechanism for infrastructure inspection. Spatial attention mechanisms try to highlight the important regions in feature maps for estimation by using an attention map. The attention mechanism using an effective attention map can improve feature maps. However, the conventional attention mechanisms have a problem as they fail to highlight important regions for estimation when an ineffective attention map is mistakenly used. To solve the above problem, this paper introduces the confidence-aware attention mechanism that reduces the effect of ineffective attention maps by considering the confidence corresponding to the attention map. The confidence is calculated from the entropy of the estimated class probabilities when generating the attention map. Because the proposed method can effectively utilize the attention map by considering the confidence, it can focus more on the important regions in the final estimation. This is the most significant contribution of this paper. The experimental results using images from actual infrastructure inspections confirm the performance improvement of the proposed method in estimating the deterioration level.

Attention graph: Learning effective visual features for large-scale image classification

In recent years, the research of deep learning has received extensive attention, and many breakthroughs have been made in various fields. On this basis, a neural network with the attention mechanism has become a research hotspot. In this paper, we try to solve the image classification task by implementing channel and spatial attention mechanism which improve the expression ability of neural network model. Different from previous studies, we propose an attention module consisting of channel attention module (CAM) and spatial attention module (SAM). The proposed module derives attention graphs from channel dimension and spatial dimension respectively, then the input features are selectively learned according to the importance of the features. Besides, this module is lightweight and can be easily integrated into image classification algorithms. In the experiment, we combine the deep residual network model with the attention module and the experimental results show that the proposed method brings higher image classification accuracy. The channel attention module adds weight to the signals on different convolution channels to represent the correlation. For different channels, the higher the weight, the higher the correlation which required more attention. The main function of spatial attention is to capture the most informative part in the local feature graph, which is a supplement to channel attention. We evaluate our proposed module based on the ImageNet-1K and Cifar-100 respectively. Through a large number of comparative experiments, our proposed model achieved outstanding performance.

A Lightweight Convolutional Neural Network Based on Group-Wise Hybrid Attention for Remote Sensing Scene Classification

With the development of computer vision, attention mechanisms have been widely studied. Although the introduction of an attention module into a network model can help to improve e classification performance on remote sensing scene images, the direct introduction of an attention module can increase the number of model parameters and amount of calculation, resulting in slower model operations. To solve this problem, we carried out the following work. First, a channel attention module and spatial attention module were constructed. The input features were enhanced through channel attention and spatial attention separately, and the features recalibrated by the attention modules were fused to obtain the features with hybrid attention. Then, to reduce the increase in parameters caused by the attention module, a group-wise hybrid attention module was constructed. The group-wise hybrid attention module divided the input features into four groups along the channel dimension, then used the hybrid attention mechanism to enhance the features in the channel and spatial dimensions for each group, then fused the features of the four groups along the channel dimension. Through the use of the group-wise hybrid attention module, the number of parameters and computational burden of the network were greatly reduced, and the running time of the network was shortened. Finally, a lightweight convolutional neural network was constructed based on the group-wise hybrid attention (LCNN-GWHA) for remote sensing scene image classification. Experiments on four open and challenging remote sensing scene datasets demonstrated that the proposed method has great advantages, in terms of classification accuracy, even with a very low number of parameters.

Inhibition of Return (IOR): Is it Consciousness of an Object without Attention or Attention without an Object and Consciousness?

The crux of the dispute on the mutual relations between attention and consciousness, and to which I have referred in this paper, lies in the question of what can be attended in spatial attention that obviously resonates with the phenomenological issue of intentionality (e.g., the noesis-noema structure). The discussion has been initiated by Christopher Mole. He began by calling for a commonsense psychology, according to which one is conscious of everything that one pays attention to, but one does not pay attention to all the things that one is conscious of. In other words, attention is supposed to be a condition which is sufficient but not necessary for consciousness, i.e., consciousness is a necessary concomitant of attention, but attention is not a necessary concomitant of consciousness. Mole seeks to validate his stance with data from psychology labs. His view is, however, partly confronted, for instance, by Robert Kentridge, Lee de-Wit and Charles Heywood, who used their experimental research on a neurological condition called blindsight as evidence of a dissociation between attention and consciousness, i.e., that visual attention is not a sufficient precondition for visual awareness. In this meta-theoretical state of affairs, I would like to focus on the cognitive phenomenon most often referred to as Inhibition of Return (IOR) and suggest that, following its micro dynamics from the perspective of micro-phenomenology, it can be used to actually showcase all of the options on both sides of the argument. One of my leading goals would be also to follow Mole’s attempt to link attention with agency but where we differ is that I wish to heuristically articulate the matter in terms of Merleau-Ponty’s phenomenological notion of embodied pre-reflective intentionality.