What the eye tells the brain: retinal feature extraction

To provide a compact and efficient input to the brain, sensory systems separate the incoming information into parallel feature channels. In the visual system, parallel processing starts in the retina. Here, the image is decomposed into multiple retinal output channels, each selective for a specific set of visual features like motion, contrast, or edges. In this article, we will summarize recent findings on the functional organization of the retinal output, the neural mechanisms underlying its diversity, and how single visual features, like color, are extracted by the retinal network. Unraveling how the retina – as the first stage of the visual system – filters the visual input is an important step toward understanding how visual information processing guides behavior.

Age-related decline in motion contrast sensitivity due to lower absorption rate of cones and calculation efficiency

Motion perception is affected by healthy aging, which impairs the ability of older adults to perform some daily activities such as driving. The current study investigated the underlying causes of age-related motion contrast sensitivity losses by using an equivalent noise paradigm to decompose motion contrast sensitivity into calculation efficiency, the temporal modulation transfer function (i.e., temporal blur) and 3 sources of internal noise: stochastic absorption of photons by photoreceptors (i.e., photon noise), neural noise occurring at the retinal level (i.e., early noise) and at the cortical level (i.e., late noise). These sources of internal noise can be disentangled because there impacts on motion contrast sensitivity vary differently as a function of luminance intensity. The impact of healthy aging on these factors was evaluated by measuring motion contrast sensitivity of young and older healthy adults at different luminance intensities, temporal frequencies and with/without external noise. The older adults were found to have higher photon noise, which suggests a lower photon absorption rate of cones. When roughly equating the amount of photons being absorbed by the photoreceptors, older adults had lower calculation efficiencies, but no significant aging effect was found on temporal modulation transfer function, early noise and late noise.

Automatic quality measurement of aortic contrast-enhanced CT angiographies for patient-specific dose optimization

Purpose Iodine-containing contrast agent (CA) used in contrast-enhanced CT angiography (CTA) can pose a health risk for patients. A system that adjusts the frequently used standard CA dose for individual patients based on their clinical parameters can be useful. As basis the quality of the image contrast in CTA volumes has to be determined, especially to recognize excessive contrast induced by CA overdosing. However, a manual assessment with a ROI-based image contrast classification is a time-consuming step in everyday clinical practice. Methods We propose a method to automate the contrast measurement of aortic CTA volumes. The proposed algorithm is based on the mean HU values in selected ROIs that were automatically positioned in the CTA volume. First, an automatic localization algorithm determines the CTA image slices for certain ROIs followed by the localization of these ROIs. A rule-based classification using the mean HU values in the ROIs categorizes images with insufficient, optimal and excessive contrast. Results In 95.89% (70 out of 73 CTAs obtained with the ulrich medical CT motion contrast media injector) the algorithm chose the same image contrast class as the radiological expert. The critical case of missing an overdose did not occur with a positive predicative value of 100%. Conclusion The resulting system works well within our range of considered scan protocols detecting enhanced areas in CTA volumes. Our work automized an assessment for classifying CA-induced image contrast which reduces the time needed for medical practitioners to perform such an assessment manually.

Optical Coherence Tomography Angiography in Diabetes and Diabetic Retinopathy

Diabetic retinopathy (DR) is a common complication of diabetes mellitus that disrupts the retinal microvasculature and is a leading cause of vision loss globally. Recently, optical coherence tomography angiography (OCTA) has been developed to image the retinal microvasculature, by generating 3-dimensional images based on the motion contrast of circulating blood cells. OCTA offers numerous benefits over traditional fluorescein angiography in visualizing the retinal vasculature in that it is non-invasive and safer; while its depth-resolved ability makes it possible to visualize the finer capillaries of the retinal capillary plexuses and choriocapillaris. High-quality OCTA images have also enabled the visualization of features associated with DR, including microaneurysms and neovascularization and the quantification of alterations in retinal capillary and choriocapillaris, thereby suggesting a promising role for OCTA as an objective technology for accurate DR classification. Of interest is the potential of OCTA to examine the effect of DR on individual retinal layers, and to detect DR even before it is clinically detectable on fundus examination. We will focus the review on the clinical applicability of OCTA derived quantitative metrics that appear to be clinically relevant to the diagnosis, classification, and management of patients with diabetes or DR. Future studies with longitudinal design of multiethnic multicenter populations, as well as the inclusion of pertinent systemic information that may affect vascular changes, will improve our understanding on the benefit of OCTA biomarkers in the detection and progression of DR.

A quantitative framework for motion visibility in human cortex

Despite the central use of motion visibility to reveal the neural basis of perception, perceptual decision making, and sensory inference there exists no comprehensive quantitative framework establishing how motion visibility parameters modulate human cortical response. Random-dot motion stimuli can be made less visible by reducing image contrast or motion coherence, or by shortening the stimulus duration. Because each of these manipulations modulates the strength of sensory neural responses they have all been extensively used to reveal cognitive and other nonsensory phenomena such as the influence of priors, attention, and choice-history biases. However, each of these manipulations is thought to influence response in different ways across different cortical regions and a comprehensive study is required to interpret this literature. Here, human participants observed random-dot stimuli varying across a large range of contrast, coherence, and stimulus durations as we measured blood-oxygen-level dependent responses. We developed a framework for modeling these responses that quantifies their functional form and sensitivity across areas. Our framework demonstrates the sensitivity of all visual areas to each parameter, with early visual areas V1–V4 showing more parametric sensitivity to changes in contrast and V3A and the human middle temporal area to coherence. Our results suggest that while motion contrast, coherence, and duration share cortical representation, they are encoded with distinct functional forms and sensitivity. Thus, our quantitative framework serves as a reference for interpretation of the vast perceptual literature manipulating these parameters and shows that different manipulations of visibility will have different effects across human visual cortex and need to be interpreted accordingly. NEW & NOTEWORTHY Manipulations of motion visibility have served as a key tool for understanding the neural basis for visual perception. Here we measured human cortical response to changes in visibility across a comprehensive range of motion visibility parameters and modeled these with a quantitative framework. Our quantitative framework can be used as a reference for linking human cortical response to perception and underscores that different manipulations of motion visibility can have greatly different effects on cortical representation.

Bidirectional encoding of motion contrast in the mouse superior colliculus

Detection of salient objects in the visual scene is a vital aspect of an animal’s interactions with its environment. Here, we show that neurons in the mouse superior colliculus (SC) encode visual saliency by detecting motion contrast between stimulus center and surround. Excitatory neurons in the most superficial lamina of the SC are contextually modulated, monotonically increasing their response from suppression by the same-direction surround to maximal potentiation by an oppositely-moving surround. The degree of this potentiation declines with depth in the SC. Inhibitory neurons are suppressed by any surround at all depths. These response modulations in both neuronal populations are much more prominent to direction contrast than to phase, temporal frequency, or static orientation contrast, suggesting feature-specific saliency encoding in the mouse SC. Together, our findings provide evidence supporting locally generated feature representations in the SC, and lay the foundations towards a mechanistic and evolutionary understanding of their emergence.

A quantitative framework for motion visibility in human cortex

Despite the central use of motion visibility to reveal the neural basis of perception, perceptual decision making, and sensory inference there exists no comprehensive quantitative framework establishing how motion visibility parameters modulate human cortical response. Random-dot motion stimuli can be made less visible by reducing image contrast or motion coherence, or by shortening the stimulus duration. Because each of these manipulations modulates the strength of sensory neural responses they have all been extensively used to reveal cognitive and other non-sensory phenomenon such as the influence of priors, attention, and choice-history biases. However, each of these manipulations is thought to influence response in different ways across different cortical regions and a comprehensive study is required to interpret this literature. Here, human participants observed random-dot stimuli varying across a large range of contrast, coherence, and stimulus durations as we measured blood-oxygen-level dependent responses. We developed a framework for modeling these responses which quantifies their functional form and sensitivity across areas. Our framework demonstrates the sensitivity of all visual areas to each parameter, with early visual areas V1-V4 showing more parametric sensitivity to changes in contrast and V3A and MT to coherence. Our results suggest that while motion contrast, coherence, and duration share cortical representation, they are encoded with distinct functional forms and sensitivity. Thus, our quantitative framework serves as a reference for interpretation of the vast perceptual literature manipulating these parameters and shows that different manipulations of visibility will have different effects across human visual cortex and need to be interpreted accordingly.