Feature replenishment for long-term visual motion tracking

Author(s):  
Tak Keung Cheng ◽  
Les Kitchen ◽  
Zhi-Qiang Liu
PLoS ONE ◽  
2021 ◽  
Vol 16 (12) ◽  
pp. e0261266
Author(s):  
Maëlle Tixier ◽  
Stéphane Rousset ◽  
Pierre-Alain Barraud ◽  
Corinne Cian

A large body of research has shown that visually induced self-motion (vection) and cognitive processing may interfere with each other. The aim of this study was to assess the interactive effects of a visual motion inducing vection (uniform motion in roll) versus a visual motion without vection (non-uniform motion) and long-term memory processing using the characteristics of standing posture (quiet stance). As the level of interference may be related to the nature of the cognitive tasks used, we examined the effect of visual motion on a memory task which requires a spatial process (episodic recollection) versus a memory task which does not require this process (semantic comparisons). Results confirm data of the literature showing that compensatory postural response in the same direction as background motion. Repeatedly watching visual uniform motion or increasing the cognitive load with a memory task did not decrease postural deviations. Finally, participants were differentially controlling their balance according to the memory task but this difference was significant only in the vection condition and in the plane of background motion. Increased sway regularity (decreased entropy) combined with decreased postural stability (increase variance) during vection for the episodic task would indicate an ineffective postural control. The different interference of episodic and semantic memory on posture during visual motion is consistent with the involvement of spatial processes during episodic memory recollection. It can be suggested that spatial disorientation due to visual roll motion preferentially interferes with spatial cognitive tasks, as spatial tasks can draw on resources expended to control posture.


2002 ◽  
Vol 87 (3) ◽  
pp. 1554-1571 ◽  
Author(s):  
Kenji Yamamoto ◽  
Yasushi Kobayashi ◽  
Aya Takemura ◽  
Kenji Kawano ◽  
Mitsuo Kawato

To investigate how cerebellar synaptic plasticity guides the acquisition and adaptation of ocular following response (OFR), a large-scale network model was developed. The model includes the cerebral medial superior temporal area (MST), Purkinje cells (P cells) of the ventral paraflocculus, the accessory optic and climbing fiber systems, the brain stem oculomotor network, and the oculomotor plant. The model reconstructed temporal profiles of both firing patterns of MST neurons and P cells and eye movements. Model MST neurons ( n = 1,080) were set to be driven by retinal error and exhibited 12 preferred directions, 30 preferred velocities, and 3 firing waveforms. Correspondingly, each model P cell contained 1,080 excitatory synapses from granule cell axons (GCA) and 1,080 inhibitory synapses. P cells ( n = 40) were classified into four groups by their laterality (hemisphere) and by preferred directions of their climbing fiber inputs (CF) (contralateral or upward). The brain stem neural circuit and the oculomotor plant were modeled on the work of Yamamoto et al. The initial synaptic weights on the P cells were set randomly. At the beginning, P cell simple spikes were not well modulated by visual motion, and the eye was moved only slightly by the accessory optic system. The synaptic weights were updated according to integral-differential equation models of physiologically demonstrated synaptic plasticity: long-term depression and long-term potentiation for GCA synapses and rebound potentiation for inhibitory synapses. We assumed that maximum plasticity was induced when GCA inputs preceded CF inputs by 200 ms. After more than 10,000 presentations of ramp-step visual motion, the strengths of both the excitatory and inhibitory synapses were modified. Subsequently, the simple spike responses became well developed, and ordinary OFRs were acquired. The preferred directions of simple spikes became the opposite of those of CFs. Although the model MST neurons were set to possess a wide variety of firing characteristics, the model P cells acquired only downward or ipsilateral preferred directions, high preferred velocities and stereotypical firing waveforms. Therefore the drastic transition of the neural representation from the population codes in the MST to the firing-rate codes of simple spikes were learned at the GCA-P cell synapses and inhibitory cells-P cell synapses. Furthermore, the model successfully reproduced the gain- and directional-adaptation of OFR, which was demonstrated by manipulating the velocity and direction of visual motion, respectively. When we assumed that synaptic plasticity could only occur if CF inputs preceded GCA inputs, the ordinary OFR were acquired but neither the gain-adaptation nor the directional adaptation could be reproduced.


2020 ◽  
Vol 39 (3) ◽  
pp. 3825-3837
Author(s):  
Yibin Chen ◽  
Guohao Nie ◽  
Huanlong Zhang ◽  
Yuxing Feng ◽  
Guanglu Yang

Kernel Correlation Filter (KCF) tracker has shown great potential on precision, robustness and efficiency. However, the candidate region used to train the correlation filter is fixed, so tracking is difficult when the target escapes from the search window due to fast motion. In this paper, an improved KCF is put forward for long-term tracking. At first, the moth-flame optimization (MFO) algorithm is introduced into tracking to search for lost target. Then, the candidate sample strategy of KCF tracking method is adjusted by MFO algorithm to make it has the capability of fast motion tracking. Finally, we use the conservative learning correlation filter to judge the moving state of the target, and combine the improved KCF tracker to form a unified tracking framework. The proposed algorithm is tested on a self-made dataset benchmark. Moreover, our method obtains scores for both the distance precision plot (0.891 and 0.842) and overlap success plots (0.631 and 0.601) on the OTB-2013 and OTB-2015 data sets, respectively. The results demonstrate the feasibility and effectiveness compared with the state-of-the-art methods, especially in dealing with fast or uncertain motion.


1995 ◽  
Vol 8 (5) ◽  
pp. 275-288 ◽  
Author(s):  
Davide Anguita ◽  
Giancarlo Parodi ◽  
Rodolfo Zunino

2010 ◽  
Vol 20 (5) ◽  
pp. 632-646 ◽  
Author(s):  
Dimitrios S. Alexiadis ◽  
George D. Sergiadis

Author(s):  
Andrew M. Burton ◽  
Hao Liu ◽  
Steven Battersby ◽  
David Brown ◽  
Nasser Sherkat ◽  
...  

Stroke is the main cause of long term disability worldwide. Of those surviving, more than half will fail to regain functional usage of their impaired upper limb. Typically stroke upper limb rehabilitation exercises consist of repeated movements, which when tracked can form the basis of inputs to games. This paper discusses two systems utilizing Wii™ technology, and thermal and visual tracking respectively to capture motions. The captured motions are used as inputs to specially designed games, which encourage the users to perform repeated rehabilitation movements. This paper discusses the implementation of the two systems, the developed games, and their relative advantages and disadvantages. It also describes the upcoming testing phase of the project.


2014 ◽  
Vol 23 (7) ◽  
pp. 3040-3056 ◽  
Author(s):  
Alexandre Heili ◽  
Adolfo Lopez-Mendez ◽  
Jean-Marc Odobez

Sign in / Sign up

Export Citation Format

Share Document