scholarly journals Spike interval coding of translatory optic flow and depth from motion in the fly visual system

2016 ◽  
Author(s):  
Kit D. Longden ◽  
Martina Wicklein ◽  
Benjamin J. Hardcastle ◽  
Stephen J. Huston ◽  
Holger G. Krapp
Keyword(s):  
Optic Flow ◽  
Visual Processing ◽  
Visual Motion ◽  
Receptive Fields ◽  
Cell Types ◽  
Spike Burst ◽  
Cluttered Environments ◽  
Single Spike ◽  
Self Motion ◽  
Spike Bursts

SummaryMany animals use the visual motion generated by travelling in a line, the translatory optic flow, to successfully navigate obstacles: near objects appear larger and to move more quickly than distant ones. Flies are experts at navigating cluttered environments, and while their visual processing of rotatory optic flow is understood in exquisite detail, how they process translatory optic flow remains a mystery. Here, we present novel cell types that have motion receptive fields matched to translation self-motion, the vertical translation (VT) cells. One of these, the VT1 cell, encodes forwards sideslip self-motion, and fires action potentials in clusters of spikes, spike bursts. We show that the spike burst coding is size and speed-tuned, and is selectively modulated by parallax motion, the relative motion experienced during translation. These properties are spatially organized, so that the cell is most excited by clutter rather than isolated objects. When the fly is presented with a simulation of flying past an elevated object, the spike burst activity is modulated by the height of the object, and the single spike rate is unaffected. When the moving object alone is experienced, the cell is weakly driven. Meanwhile, the VT2-3 cells have motion receptive fields matched to the lift axis. In conjunction with previously described horizontal cells, the VT cells have the properties required for the fly to successfully navigate clutter and encode its movements along near cardinal axes of thrust, lift and forward sideslip.

scholarly journals Directional selectivity and its use in early visual processing

1981 ◽  
Vol 211 (1183) ◽  
pp. 151-180 ◽  
Keyword(s):  
Visual Processing ◽  
Visual Motion ◽  
Time Derivative ◽  
Receptive Fields ◽  
Specific Model ◽  
Zero Crossings ◽  
Second Stage ◽  
Early Visual Processing ◽  
Local Direction ◽  
Zero Values

The construction of directionally selective units, and their use in the processing of visual motion, are considered. The zero crossings of ∇ 2 G(x, y) ∗ I(x, y) are located, as in Marr & Hildreth (1980). That is, the image is filtered through centre-surround receptive fields, and the zero values in the output are found. In addition, the time derivative ∂[∇ 2 G(x, y) ∗ l(x, y) ]/∂ t is measured at the zero crossings, and serves to constrain the local direction of motion to within 180°. The direction of motion can be determined in a second stage, for example by combining the local constraints. The second part of the paper suggests a specific model of the information processing by the X and Y cells of the retina and lateral geniculate nucleus, and certain classes of cortical simple cells. A number of psychophysical and neurophysiological predictions are derived from the theory.

scholarly journals Optic Flow: A History

i-Perception ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 204166952110557
Author(s):  
Diederick C. Niehorster
Keyword(s):  
Optic Flow ◽  
Visual Motion ◽  
Scientific Literature ◽  
Archival Research ◽  
Visual World ◽  
Global Pattern ◽  
Self Motion

The concept of optic flow, a global pattern of visual motion that is both caused by and signals self-motion, is canonically ascribed to James Gibson's 1950 book “ The Perception of the Visual World.” There have, however, been several other developments of this concept, chiefly by Gwilym Grindley and Edward Calvert. Based on rarely referenced scientific literature and archival research, this article describes the development of the concept of optic flow by the aforementioned authors and several others. The article furthermore presents the available evidence for interactions between these authors, focusing on whether parts of Gibson's proposal were derived from the work of Grindley or Calvert. While Grindley's work may have made Gibson aware of the geometrical facts of optic flow, Gibson's work is not derivative of Grindley's. It is furthermore shown that Gibson only learned of Calvert's work in 1956, almost a decade after Gibson first published his proposal. In conclusion, the development of the concept of optic flow presents an intriguing example of convergent thought in the progress of science.

State-Dependent Performance of Optic-Flow Processing Interneurons

2009 ◽  
Vol 102 (6) ◽  
pp. 3606-3618 ◽  
Author(s):  
Kit D. Longden ◽  
Holger G. Krapp
Keyword(s):  
Sensory Processing ◽  
Optic Flow ◽  
Visual Processing ◽  
Metabolic Cost ◽  
Sensory Stimuli ◽  
State Dependent ◽  
Directional Motion ◽  
Save Energy ◽  
Self Motion ◽  
The Impact

Active locomotive states are metabolically expensive and require efficient sensory processing both to avoid wasteful movements and to cope with an extended bandwidth of sensory stimuli. This is particularly true for flying animals because flight, as opposed to walking or resting, imposes a steplike increase in metabolism for the precise execution and control of movements. Sensory processing itself carries a significant metabolic cost, but the principles governing the adjustment of sensory processing to different locomotor states are not well understood. We use the blowfly as a model system to study the impact on visual processing of a neuromodulator, octopamine, which is known to be involved in the regulation of flight physiology. We applied an octopamine agonist and recorded the directional motion responses of identified visual interneurons known to process self-motion–induced optic flow to directional motion stimuli. The neural response range of these neurons is increased and the response latency is reduced. We also found that, due to an elevated spontaneous spike rate, the cells' negative signaling range is increased. Meanwhile, the preferred self-motion parameters the cells encode were state independent. Our results indicate that in the blowfly energetically expensive sensory coding strategies, such as rapid, large responses, and high spontaneous spike activity could be adjusted by the neuromodulator octopamine, likely to save energy during quiet locomotor states.

scholarly journals A robust receptive field code for optic flow detection and decomposition during self-motion

2021 ◽  
Author(s):  
Yue Zhang ◽  
Ruoyu Huang ◽  
Wiebke Nörenberg ◽  
Aristides Arrenberg
Keyword(s):  
Receptive Field ◽  
Optic Flow ◽  
Receptive Fields ◽  
Motion Information ◽  
Fine Scale ◽  
Visually Guided ◽  
Behavioral Experiments ◽  
Linear Filters ◽  
Flow Detection ◽  
Self Motion

The perception of optic flow is essential for any visually guided behavior of a moving animal. To mechanistically predict behavior and understand the emergence of self-motion perception in vertebrate brains, it is essential to systematically characterize the motion receptive fields (RFs) of optic flow processing neurons. Here, we present the fine-scale RFs of thousands of motion-sensitive neurons studied in the diencephalon and the midbrain of zebrafish. We found neurons that serve as linear filters and robustly encode directional and speed information of translation-induced optic flow. These neurons are topographically arranged in pretectum according to translation direction. The unambiguous encoding of translation enables the decomposition of translational and rotational self-motion information from mixed optic flow. In behavioral experiments, we successfully demonstrated the predicted decomposition in the optokinetic and optomotor responses. Together, our study reveals the algorithm and the neural implementation for self-motion estimation in a vertebrate visual system.

Fly motion vision: from optic flow to visual course control

e-Neuroforum ◽  
2012 ◽  
Vol 18 (3) ◽  
Author(s):  
A. Borst
Keyword(s):  
Spatial Distribution ◽  
Optic Flow ◽  
Visual Motion ◽  
Neural Circuit ◽  
Receptive Fields ◽  
Motion Vision ◽  
Parallel Motion ◽  
Input Signals ◽  
Course Control ◽  
L1 And L2

AbstractOptic flow-based navigation has been stud­ied extensively in flies, both in tethered as well as in freely flying animals. As neural con­trol elements, the tangential cells of the lobu­la plate seem to play a key role: they are sen­sitive to visual motion, have large receptive fields, and, with their spatial distribution of preferred directions, match the optic flow as elicited during certain types of flight maneu­vers. However, the neural circuit presynaptic to the tangential cells responsible for extract­ing the direction of motion locally has long escaped investigation, due to the small size of the participating neurons. Recent prog­ress was made here by combining genetic si­lencing of candidate neurons with whole-cell patch recording from tangential cells in Dro­sophila. This approach led to the identifica­tion of lamina neurons L1 and L2 providing the input signals to two parallel motion de­tection circuits, specialized for brightness in­crements (L1, ON-pathway) and decrements (L2, OFF-pathway), respectively.

scholarly journals An optimal population code for global motion estimation in local direction-selective cells

2021 ◽  
Author(s):  
Miriam Henning ◽  
Giordano Ramos-Traslosheros ◽  
Burak Gür ◽  
Marion Silies
Keyword(s):  
Optic Flow ◽  
Visual Motion ◽  
Ganglion Cells ◽  
Population Level ◽  
Flow Fields ◽  
Population Code ◽  
Complex Flow ◽  
Essential Information ◽  
Local Direction ◽  
Self Motion

Nervous systems allocate computational resources to match stimulus statistics. However, the physical information that needs to be processed depends on the animal's own behavior. For example, visual motion patterns induced by self-motion provide essential information for navigation. How behavioral constraints affect neural processing is not known. Here we show that, at the population level, local direction-selective T4/T5 neurons in Drosophila represent optic flow fields generated by self-motion, reminiscent to a population code in retinal ganglion cells in vertebrates. Whereas in vertebrates four different cell types encode different optic flow fields, the four uniformly tuned T4/T5 subtypes described previously represent a local snapshot. As a population, six T4/T5 subtypes encode different axes of self-motion. This representation might serve to efficiently encode more complex flow fields generated during flight. Thus, a population code for optic flow appears to be a general coding principle of visual systems, but matching the animal's individual ethological constraints.

scholarly journals When gravity is not where it should be: How perceived orientation affects visual self-motion processing

PLoS ONE ◽  
2021 ◽  
Vol 16 (1) ◽  
pp. e0243381
Author(s):  
Meaghan McManus ◽  
Laurence R. Harris
Keyword(s):  
Optic Flow ◽  
Visual Cues ◽  
Visual Motion ◽  
Human Perception ◽  
Body Posture ◽  
Motion Processing ◽  
Visual Orientation ◽  
Orientation Cues ◽  
Trunk Orientation ◽  
Self Motion

Human perception is based on expectations. We expect visual upright and gravity upright, sensed through vision, vestibular and other sensory systems, to agree. Equally, we expect that visual and vestibular information about self-motion will correspond. What happens when these assumptions are violated? Tilting a person from upright so that gravity is not where it should be impacts both visually induced self-motion (vection) and the perception of upright. How might the two be connected? Using virtual reality, we varied the strength of visual orientation cues, and hence the probability of participants experiencing a visual reorientation illusion (VRI) in which visual cues to orientation dominate gravity, using an oriented corridor and a starfield while also varying head-on-trunk orientation and body posture. The effectiveness of the optic flow in simulating self-motion was assessed by how much visual motion was required to evoke the perception that the participant had reached the position of a previously presented target. VRI was assessed by questionnaire When participants reported higher levels of VRI they also required less visual motion to evoke the sense of traveling through a given distance, regardless of head or body posture, or the type of visual environment. We conclude that experiencing a VRI, in which visual-vestibular conflict is resolved and the direction of upright is reinterpreted, affects the effectiveness of optic flow at simulating motion through the environment. Therefore, any apparent effect of head or body posture or type of environment are largely indirect effects related instead, to the level of VRI experienced by the observer. We discuss potential mechanisms for this such as reinterpreting gravity information or altering the weighting of orientation cues.

scholarly journals Disentangling of Local and Wide-Field Motion Adaptation

2021 ◽  
Vol 15 ◽  
Author(s):  
Jinglin Li ◽  
Miriam Niemeier ◽  
Roland Kern ◽  
Martin Egelhaaf
Keyword(s):  
Optic Flow ◽  
Visual Processing ◽  
Visual Motion ◽  
Spatial Scales ◽  
Stimulus Level ◽  
The Other ◽  
Wide Field ◽  
Local Motion ◽  
Motion Direction ◽  
Motion Adaptation

Motion adaptation has been attributed in flying insects a pivotal functional role in spatial vision based on optic flow. Ongoing motion enhances in the visual pathway the representation of spatial discontinuities, which manifest themselves as velocity discontinuities in the retinal optic flow pattern during translational locomotion. There is evidence for different spatial scales of motion adaptation at the different visual processing stages. Motion adaptation is supposed to take place, on the one hand, on a retinotopic basis at the level of local motion detecting neurons and, on the other hand, at the level of wide-field neurons pooling the output of many of these local motion detectors. So far, local and wide-field adaptation could not be analyzed separately, since conventional motion stimuli jointly affect both adaptive processes. Therefore, we designed a novel stimulus paradigm based on two types of motion stimuli that had the same overall strength but differed in that one led to local motion adaptation while the other did not. We recorded intracellularly the activity of a particular wide-field motion-sensitive neuron, the horizontal system equatorial cell (HSE) in blowflies. The experimental data were interpreted based on a computational model of the visual motion pathway, which included the spatially pooling HSE-cell. By comparing the difference between the recorded and modeled HSE-cell responses induced by the two types of motion adaptation, the major characteristics of local and wide-field adaptation could be pinpointed. Wide-field adaptation could be shown to strongly depend on the activation level of the cell and, thus, on the direction of motion. In contrast, the response gain is reduced by local motion adaptation to a similar extent independent of the direction of motion. This direction-independent adaptation differs fundamentally from the well-known adaptive adjustment of response gain according to the prevailing overall stimulus level that is considered essential for an efficient signal representation by neurons with a limited operating range. Direction-independent adaptation is discussed to result from the joint activity of local motion-sensitive neurons of different preferred directions and to lead to a representation of the local motion direction that is independent of the overall direction of global motion.

Linear and Nonlinear Contributions to the Visual Sensitivity of Neurons in Primate Lateral Geniculate Nucleus

2010 ◽  
Vol 104 (4) ◽  
pp. 1884-1898 ◽  
Author(s):  
Samuel G. Solomon ◽  
Chris Tailby ◽  
Soon K. Cheong ◽  
Aaron J. Camp
Keyword(s):  
Lateral Geniculate Nucleus ◽  
Visual Processing ◽  
Receptive Fields ◽  
Cell Types ◽  
Visual Sensitivity ◽  
M Cells ◽  
Uniform Field ◽  
Lateral Geniculate ◽  
Linear And Nonlinear ◽  
Nonlinear Components

Several parallel pathways convey retinal signals to the visual cortex of primates. The signals of the parvocellular (P) and magnocellular (M) pathways are well characterized; the properties of other rarely encountered cell types are distinctive in many ways, but it is not clear that they can provide signals with the same fidelity. Here we study this by characterizing the temporal receptive field of neurons in the lateral geniculate nucleus of anesthetized marmosets. For each neuron, we measured the response to a flickering uniform field, and, from this, estimated the linear and nonlinear receptive fields using spike-triggered average (STA) and spike-triggered covariance (STC) analyses. As expected the response of most P-cells was dominated by the STA, but the response of most M-cells required additional nonlinear components, and these usually acted to suppress cell responses. The STC analysis showed stronger suppressive axes in suppressed-by-contrast cells, and both suppressive and excitatory axes in on-off cells. Together, the STA and the STC analyses form a model of the temporal response to a large uniform field: under this model, the information that was provided by suppressed-by-contrast cells or on-off cells approached that provided by the P- and M-cells. However, whereas P- and M-cells provided more information about luminance, the nonlinear cells provided more information about the contrast energy. This suggests that the nonlinear cells provide complimentary signals to those of P- and M-cells, with reasonably high fidelity, and may play an important role in normal visual processing.

scholarly journals The emergence of multiple retinal cell types through efficient coding of natural movies

2018 ◽  
Author(s):  
Samuel A. Ocko ◽  
Jack Lindsey ◽  
Surya Ganguli ◽  
Stephane Deny
Keyword(s):  
Visual Processing ◽  
Visual Information ◽  
Ganglion Cells ◽  
Receptive Fields ◽  
Cell Types ◽  
Retinal Cell ◽  
Retinal Eccentricity ◽  
Natural Scenes ◽  
Efficient Coding ◽  
Cell Densities

AbstractOne of the most striking aspects of early visual processing in the retina is the immediate parcellation of visual information into multiple parallel pathways, formed by different retinal ganglion cell types each tiling the entire visual field. Existing theories of efficient coding have been unable to account for the functional advantages of such cell-type diversity in encoding natural scenes. Here we go beyond previous theories to analyze how a simple linear retinal encoding model with different convolutional cell types efficiently encodes naturalistic spatiotemporal movies given a fixed firing rate budget. We find that optimizing the receptive fields and cell densities of two cell types makes them match the properties of the two main cell types in the primate retina, midget and parasol cells, in terms of spatial and temporal sensitivity, cell spacing, and their relative ratio. Moreover, our theory gives a precise account of how the ratio of midget to parasol cells decreases with retinal eccentricity. Also, we train a nonlinear encoding model with a rectifying nonlinearity to efficiently encode naturalistic movies, and again find emergent receptive fields resembling those of midget and parasol cells that are now further subdivided into ON and OFF types. Thus our work provides a theoretical justification, based on the efficient coding of natural movies, for the existence of the four most dominant cell types in the primate retina that together comprise 70% of all ganglion cells.

Sign in / Sign up

Export Citation Format

Share Document