Learning to Search for Objects in Images from Human Gaze Sequences

Author(s):  
Afonso Nunes ◽  
Rui Figueiredo ◽  
Plinio Moreno
Keyword(s):  
2021 ◽  
Author(s):  
Mo Shahdloo ◽  
Emin Çelik ◽  
Burcu A Urgen ◽  
Jack L. Gallant ◽  
Tolga Çukur

Object and action perception in cluttered dynamic natural scenes relies on efficient allocation of limited brain resources to prioritize the attended targets over distractors. It has been suggested that during visual search for objects, distributed semantic representation of hundreds of object categories is warped to expand the representation of targets. Yet, little is known about whether and where in the brain visual search for action categories modulates semantic representations. To address this fundamental question, we studied human brain activity recorded via functional magnetic resonance imaging while subjects viewed natural movies and searched for either communication or locomotion actions. We find that attention directed to action categories elicits tuning shifts that warp semantic representations broadly across neocortex, and that these shifts interact with intrinsic selectivity of cortical voxels for target actions. These results suggest that attention serves to facilitate task performance during social interactions by dynamically shifting semantic selectivity towards target actions, and that tuning shifts are a general feature of conceptual representations in the brain.


2013 ◽  
Vol 47 (5) ◽  
pp. 117-127 ◽  
Author(s):  
Roy Edgar Hansen

AbstractSonar imaging has numerous applications in the underwater domain. High-resolution sonar images are useful in marine research, underwater construction work, offshore oil and gas, search for objects, and in the military sector. Common in many applications is the desire for higher resolution, better image quality, longer range, and smaller hardware footprint. Synthetic aperture sonar (SAS) technology can improve resolution and/or range substantially compared to traditional technology. Recent developments in SAS make this technology more available now. This paper gives a review of SAS technology and shows example of SAS applications. The paper lists the current state-of-the-art and the future trends of SAS.


PLoS ONE ◽  
2012 ◽  
Vol 7 (5) ◽  
pp. e36993 ◽  
Author(s):  
Eric L. G. Legge ◽  
Marcia L. Spetch ◽  
Andrew Cenkner ◽  
Vadim Bulitko ◽  
Craig Anderson ◽  
...  
Keyword(s):  

2015 ◽  
Vol 11 (2) ◽  
pp. 16-27 ◽  
Author(s):  
M.V. Zotov ◽  
N.E. Andrianova ◽  
A.P. Voyt

The aim of our work was to test the hypothesis that one's identification of objects of attention in an observed individual depends on his/her understanding of the context of a communicative situation based on the comparison of the participants' points of view. In the first experimental study the subjects (N=74) carried out visual search for objects of attention of participants of non-verbal communication scenes with/without information on the communication context provided, and with short/prolonged display of information for assessing gaze direction of the participants. Understanding the context resulted in a higher efficiency of iden¬tification and saccadic detection of the participants' objects of attention in the subjects, regardless of their access to the information on gaze direction. In the second experiment the subjects (N=32), after watching videos of communication episodes, were asked to search for changes of different objects in the scenes. Those subjects who had a clear understanding of the context of communication first of all noticed the changes in the future objects of attention of the participants, in spite of the absence of any 'hints' like head or eye orientation. The outcomes of the research are discussed within the framework of concepts focusing on the significance of polyperspective representations for the understanding of communicative signals.


2021 ◽  
Vol 6 ◽  
Author(s):  
Robert S. Hurley ◽  
Jonathan Sander ◽  
Kayleigh Nemeth ◽  
Brittany R. Lapin ◽  
Wei Huang ◽  
...  

In addition to “nonverbal search” for objects, modern life also necessitates “verbal search” for written words in variable configurations. We know less about how we locate words in novel spatial arrangements, as occurs on websites and menus, than when words are located in passages. In this study we leveraged eye tracking technology to examine the hypothesis that objects are simultaneously screened in parallel while words can only be found when each are directly foveated in serial fashion. Participants were provided with a cue (e.g. rabbit) and tasked with finding a thematically-related target (e.g. carrot) embedded within an array including a dozen distractors. The cues and arrays were comprised of object pictures on nonverbal trials, and of written words on verbal trials. In keeping with the well-established “picture superiority effect,” picture targets were identified more rapidly than word targets. Eye movement analysis showed that picture superiority was promoted by parallel viewing of objects, while words were viewed serially. Different factors influenced performance in each stimulus modality; lexical characteristics such as word frequency modulated viewing times during verbal search, while taxonomic category affected viewing times during nonverbal search. In addition to within-platform task conditions, performance was examined in cross-platform conditions where picture cues were followed by word arrays, and vice versa. Although taxonomically-related words did not capture gaze on verbal trials, they were viewed disproportionately when preceded by cross-platform picture cues. Our findings suggest that verbal and nonverbal search are associated with qualitatively different search strategies and forms of distraction, and cross-platform search incorporates characteristics of both.


2021 ◽  
pp. 466-485
Author(s):  
Alla Krylova

Summary. In Ukrainian schools and high schools very little attention is paid to the methodological components of Geoinformatics and teaching methods using historical maps in GIS (geographic information systems). The purpose of the research is to show how GIS can be used in teaching local history. The research methodology is based on the principles of historicism, system-formation, scientific character, verification, the author’s objectivity, moderated narrative constructivism, and the use of general scientific and specially-historical methods. The scientific novelty of the article consists in the creation and use of information maps in GIS with regard to the history of Germans and Mennonites of the Zaporizhzhia oblast, as a basic cartographic material for training courses in local history. Such maps show the territory of Southern Ukraine in relation to various ethnic groups and faiths. In particular, Mennonites and ethnic Germans, who made a huge contribution to the cultural and economic development of the region and left a significant layer of cultural heritage. The maps findings presented in this article are parts of a large database of historical sources, and have already partially become the basis of such courses of local history as "History of the Zaporizhzhia oblast", "Historical Local History" at Melitopol State Pedagogical University. With the help of GIS maps, various primary historical sources (statistical, cartographic, etc.) come to the forefront and allow the study of local territorial units. The article will demonstrate the GIS maps of 27 German settlements of Molochna German settlements (Prishibskaya volost) for a certain time period. Conclusions. The use of historical GIS technologies contributes to the formation of such students’ skills as read the information on the historical maps; search for objects or information by given parameters, for example, by name; carry out calculations on digital maps; to form the spatial thinking of students, demonstrating the historical objects in three dimensions; create digital maps by own, especially based on the results of student observations.


Author(s):  
Ekaterina A. Urusova ◽  

Entering the process of consumption, not only does the person construct their individual being and social reality but also completes their individuality, relying on symbols popular in the environment. Attempts to show one’s own personality are confronted with the ways of self-presentation accepted in the society, as well as with assessments from other people, so a person is faced with the necessity to choose what and how to present. The openness of self-presentation methods results in the spread of interest in individual aspects and characteristics of the personality and also causes its transition to the category of the object of consumption. At the same time, the desire to get a positive external evaluation from others entails «folding» of the individuality due to the demonstration of only certain aspects that are most in demand (that is, the most «consumed» ones). Such a process is associated with the desire to satisfy the needs for recognition and respect, to supplement the qualities, features, characteristics of the image of the «Self» or to hide the lack of the basic reality and understanding of oneself as an integral personality. On the other hand, identification of oneself in the sociocultural space, in the reference group, leads to the search for and selection of individuals that are of the greatest interest. Personality, while becoming a subject of consumption, objectifies the other, endowed with the desired qualities and characteristics, consuming the information communicated by it. However, such a process of consumption causes a feeling of incompleteness and inferiority of oneself, resulting from the impossibility of possessing the desired qualities, thus provoking ongoing search for objects of consumption, distancing from one’s own individuality and the loss of one’s own Self.


Sign in / Sign up

Export Citation Format

Share Document