Informative subspaces for audio-visual processing: high-level function from low-level fusion

Author(s):  
Fisher ◽  
Darrell
2010 ◽  
Vol 22 (6) ◽  
pp. 1235-1243 ◽  
Author(s):  
Marieke L. Schölvinck ◽  
Geraint Rees

Motion-induced blindness (MIB) is a visual phenomenon in which highly salient visual targets spontaneously disappear from visual awareness (and subsequently reappear) when superimposed on a moving background of distracters. Such fluctuations in awareness of the targets, although they remain physically present, provide an ideal paradigm to study the neural correlates of visual awareness. Existing behavioral data on MIB are consistent both with a role for structures early in visual processing and with involvement of high-level visual processes. To further investigate this issue, we used high field functional MRI to investigate signals in human low-level visual cortex and motion-sensitive area V5/MT while participants reported disappearance and reappearance of an MIB target. Surprisingly, perceptual invisibility of the target was coupled to an increase in activity in low-level visual cortex plus area V5/MT compared with when the target was visible. This increase was largest in retinotopic regions representing the target location. One possibility is that our findings result from an active process of completion of the field of distracters that acts locally in the visual cortex, coupled to a more global process that facilitates invisibility in general visual cortex. Our findings show that the earliest anatomical stages of human visual cortical processing are implicated in MIB, as with other forms of bistable perception.


Author(s):  
Y. S. Kim ◽  
M. K. Kim ◽  
S. W. Lee ◽  
C. S. Lee ◽  
C. H. Lee ◽  
...  

Interior design of space is somewhat different from product design in view of followings: the space should afford the multiple users at the same time and afford appropriate interactions with human and objects which exist inside the space. This paper presents a case study of interior design of a conference room based on affordance concept. We analyzed all of users’ tasks in a conference room based on the human activities that are divided into human-object and human-human interactions. Function decomposition of an every object in conference room was conducted. The concept of a high-level function is used such as “configure the space” to satisfy the given condition of the number of humans, the types of conference, and so forth. The Function-Task Interaction (FTI) method was enhanced to analyze the interactions between functions and user tasks. Many low-level affordances were extracted, and high-level affordances such as enter/exitability, prepare-ability, present-ability, discuss-ability and conclude-ability were also extracted by grouping low-level affordances in the enhanced FTI matrix. In addition, the benchmarking simulation was conducted for several existing conference rooms and the results confirmed that the extracted affordances can be used for checklist and also for good guidance on interior design process.


2019 ◽  
Author(s):  
Ali Pournaghdali ◽  
Bennett L Schwartz

Studies utilizing continuous flash suppression (CFS) provide valuable information regarding conscious and nonconscious perception. There are, however, crucial unanswered questions regarding the mechanisms of suppression and the level of visual processing in the absence of consciousness with CFS. Research suggests that the answers to these questions depend on the experimental configuration and how we assess consciousness in these studies. The aim of this review is to evaluate the impact of different experimental configurations and the assessment of consciousness on the results of the previous CFS studies. We review studies that evaluated the influence of different experimental configuration on the depth of suppression with CFS and discuss how different assessments of consciousness may impact the results of CFS studies. Finally, we review behavioral and brain recording studies of CFS. In conclusion, previous studies provide evidence for survival of low-level visual information and complete impairment of high-level visual information under the influence of CFS. That is, studies suggest that nonconscious perception of lower-level visual information happens with CFS but there is no evidence for nonconscious highlevel recognition with CFS.


Author(s):  
Megan Tomko ◽  
Jacob Nelson ◽  
Robert L. Nagel ◽  
Matthew Bohm ◽  
Julie Linsey

AbstractThis paper aims to situate functional abstraction in light of systems thinking. While function does not extensively appear in systems thinking literature, the literature does identify function as part of systems thinking that enables us to recognize and connect that function has a role in building a systems thinking approach for students. A systems thinking approach is valuable for students since it helps them view a system holistically. In this research, we measure how well students are able to abstract function. We asked students to generate functions for two different products and examined how students taught functional modeling and function enumeration compare to students who are only taught function enumeration. The student responses were examined using a rubric that we developed and validated for assessing function. This rubric may be used to classify functions by correctness (correct, partially correct, and incorrect) and categories (high level, interface, low level, and ambiguous). On questions where students were not explicitly asked to write a high-level function or low-level function, and so on, students who were taught functional modeling were able to better demonstrate systems thinking in their responses (low-level and interface functions) than those students who were only taught function enumeration.


2005 ◽  
Vol 272 (1570) ◽  
pp. 1379-1384 ◽  
Author(s):  
Gillian Rhodes ◽  
Marianne Peters ◽  
Kieran Lee ◽  
M. Concetta Morrone ◽  
David Burr

The role of symmetry detection in early visual processing and the sensitivity of biological visual systems to symmetry across a wide range of organisms suggest that symmetry can be detected by low-level visual mechanisms. However, computational and functional considerations suggest that higher-level mechanisms may also play a role in facial symmetry detection. We tested this hypothesis by examining whether symmetry detection is better for faces than comparable patterns, which share low-level properties with faces. Symmetry detection was better for upright faces than for inverted faces (experiment 1) and contrast-reversed faces (experiment 2), implicating high-level mechanisms in facial symmetry detection. In addition, facial symmetry detection was sensitive to spatial scale, unlike low-level symmetry detection mechanisms (experiment 3), and showed greater sensitivity to a 45° deviation from vertical than is found for other aspects of face perception (experiment 4). These results implicate specialized, higher-level mechanisms in the detection of facial symmetry. This specialization may reflect perceptual learning resulting from extensive experience detecting symmetry in faces or evolutionary selection pressures associated with the important role of facial symmetry in mate choice and ‘mind-reading’ or both.


Author(s):  
Nannan Li ◽  
Zhenzhong Chen

In this paper, a novel image captioning approach is proposed to describe the content of images. Inspired by the visual processing of our cognitive system, we propose a visual-semantic LSTM model to locate the attention objects with their low-level features in the visual cell, and then successively extract high-level semantic features in the semantic cell. In addition, a state perturbation term is introduced to the word sampling strategy in the REINFORCE based method to explore proper vocabularies in the training process. Experimental results on MS COCO and Flickr30K validate the effectiveness of our approach when compared to the state-of-the-art methods.


2021 ◽  
Author(s):  
Sushrut Thorat ◽  
Marius V. Peelen

Feature-based attention supports the selection of goal-relevant stimuli by enhancing the visual processing of attended features. A defining property of feature-based attention is that it modulates visual processing beyond the focus of spatial attention. Previous work has reported such spatially-global effects for low-level features such as color and orientation, as well as for faces. Here, using fMRI, we provide evidence for spatially-global attentional modulation for human bodies. Participants were cued to search for one of six object categories in two vertically-aligned images. Two additional, horizontally-aligned, images were simultaneously presented but were never task-relevant across three experimental sessions. Analyses time-locked to the objects presented in these task-irrelevant images revealed that responses evoked by body silhouettes were modulated by the participants' top-down attentional set, becoming more body-selective when participants searched for bodies in the task-relevant images. These effects were observed both in univariate analyses of the body-selective cortex and in multivariate analyses of the object-selective visual cortex. Additional analyses showed that this modulation reflected response gain rather than a bias induced by the cues, and that it reflected enhancement of body responses rather than suppression of non-body responses. Finally, the features of early layers of a convolutional neural network trained for object recognition could not be used to accurately categorize body silhouettes, indicating that the fMRI results were unlikely to reflect selection based on low-level features. These findings provide the first evidence for spatially-global feature-based attention for human bodies, linking this modulation to body representations in high-level visual cortex.


1997 ◽  
Vol 20 (4) ◽  
pp. 749-750 ◽  
Author(s):  
Mel Goodale

Deictic coding offers a useful model for understanding the interactions between the dorsal and ventral streams of visual processing in the cerebral cortex. By extending Ballard et al.'s ideas on teleassistance, I show how dedicated low-level visuomotor processes in the dorsal stream might be engaged for the services of high-level cognitive operations in the ventral stream.


Sign in / Sign up

Export Citation Format

Share Document