Adaptive Gain Control for Spike-Based Map Communication in a Neuromorphic Vision System

2008 ◽  
Vol 19 (6) ◽  
pp. 1010-1021 ◽  
Author(s):  
Yicong Meng ◽  
B.E. Shi
2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Qian-Bing Zhu ◽  
Bo Li ◽  
Dan-Dan Yang ◽  
Chi Liu ◽  
Shun Feng ◽  
...  

AbstractThe challenges of developing neuromorphic vision systems inspired by the human eye come not only from how to recreate the flexibility, sophistication, and adaptability of animal systems, but also how to do so with computational efficiency and elegance. Similar to biological systems, these neuromorphic circuits integrate functions of image sensing, memory and processing into the device, and process continuous analog brightness signal in real-time. High-integration, flexibility and ultra-sensitivity are essential for practical artificial vision systems that attempt to emulate biological processing. Here, we present a flexible optoelectronic sensor array of 1024 pixels using a combination of carbon nanotubes and perovskite quantum dots as active materials for an efficient neuromorphic vision system. The device has an extraordinary sensitivity to light with a responsivity of 5.1 × 107 A/W and a specific detectivity of 2 × 1016 Jones, and demonstrates neuromorphic reinforcement learning by training the sensor array with a weak light pulse of 1 μW/cm2.


2020 ◽  
Author(s):  
Shuang Wang ◽  
Chen-Yu Wang ◽  
Pengfei Wang ◽  
Cong Wang ◽  
Zhu-An Li ◽  
...  

Abstract Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe2/h-BN/Al2O3 van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO2/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications.


2008 ◽  
Vol 99 (2) ◽  
pp. 667-682 ◽  
Author(s):  
Midori Sakura ◽  
Dimitrios Lambrinos ◽  
Thomas Labhart

Many insects exploit skylight polarization for visual compass orientation or course control. As found in crickets, the peripheral visual system (optic lobe) contains three types of polarization-sensitive neurons (POL neurons), which are tuned to different (∼60° diverging) e-vector orientations. Thus each e-vector orientation elicits a specific combination of activities among the POL neurons coding any e-vector orientation by just three neural signals. In this study, we hypothesize that in the presumed orientation center of the brain (central complex) e-vector orientation is population-coded by a set of “compass neurons.” Using computer modeling, we present a neural network model transforming the signal triplet provided by the POL neurons to compass neuron activities coding e-vector orientation by a population code. Using intracellular electrophysiology and cell marking, we present evidence that neurons with the response profile of the presumed compass neurons do indeed exist in the insect brain: each of these compass neuron-like (CNL) cells is activated by a specific e-vector orientation only and otherwise remains silent. Morphologically, CNL cells are tangential neurons extending from the lateral accessory lobe to the lower division of the central body. Surpassing the modeled compass neurons in performance, CNL cells are insensitive to the degree of polarization of the stimulus between 99% and at least down to 18% polarization and thus largely disregard variations of skylight polarization due to changing solar elevations or atmospheric conditions. This suggests that the polarization vision system includes a gain control circuit keeping the output activity at a constant level.


Author(s):  
N.S. Allen ◽  
R.D. Allen

Various methods of video-enhanced microscopy combine TV cameras with light microscopes creating images with improved resolution, contrast and visibility of fine detail, which can be recorded rapidly and relatively inexpensively. The AVEC (Allen Video-enhanced Contrast) method avoids polarizing rectifiers, since the microscope is operated at retardations of λ/9- λ/4, where no anomaly is seen in the Airy diffraction pattern. The iris diaphram is opened fully to match the numerical aperture of the condenser to that of the objective. Under these conditions, no image can be realized either by eye or photographically. Yet the image becomes visible using the Hamamatsu C-1000-01 binary camera, if the camera control unit is equipped with variable gain control and an offset knob (which sets a clamp voltage of a D.C. restoration circuit). The theoretical basis for these improvements has been described.


2010 ◽  
Vol 24 (3) ◽  
pp. 198-209 ◽  
Author(s):  
Yan Wang ◽  
Jianhui Wu ◽  
Shimin Fu ◽  
Yuejia Luo

In the present study, we used event-related potentials (ERPs) and behavioral measurements in a peripherally cued line-orientation discrimination task to investigate the underlying mechanisms of orienting and focusing in voluntary and involuntary attention conditions. Informative peripheral cue (75% valid) with long stimulus onset asynchrony (SOA) was used in the voluntary attention condition; uninformative peripheral cue (50% valid) with short SOA was used in the involuntary attention condition. Both orienting and focusing were affected by attention type. Results for attention orienting in the voluntary attention condition confirmed the “sensory gain control theory,” as attention enhanced the amplitude of the early ERP components, P1 and N1, without latency changes. In the involuntary attention condition, compared with invalid trials, targets in the valid trials elicited larger and later contralateral P1 components, and smaller and later contralateral N1 components. Furthermore, but only in the voluntary attention condition, targets in the valid trials elicited larger N2 and P3 components than in the invalid trials. Attention focusing in the involuntary attention condition resulted in larger P1 components elicited by targets in small-cue trials compared to large-cue trials, whereas in the voluntary attention condition, larger P1 components were elicited by targets in large-cue trials than in small-cue trials. There was no interaction between orienting and focusing. These results suggest that orienting and focusing of visual-spatial attention are deployed independently regardless of attention type. In addition, the present results provide evidence of dissociation between voluntary and involuntary attention during the same task.


2004 ◽  
Author(s):  
Michael D. Byrne ◽  
Alex Kirlik ◽  
Michael D. Fleetwood ◽  
David G. Huss ◽  
Alex Kosorukoff ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document