scholarly journals Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception

2020 ◽  
Author(s):  
Shuang Wang ◽  
Chen-Yu Wang ◽  
Pengfei Wang ◽  
Cong Wang ◽  
Zhu-An Li ◽  
...  
Keyword(s):  
Visual Perception ◽  
Large Scale ◽  
Vision System ◽  
Image Sensor ◽  
Letter Recognition ◽  
Human Vision ◽  
Large Power ◽  
Image Sensing ◽  
Conventional Machine ◽  
Neuromorphic Vision

Abstract Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe2/h-BN/Al2O3 van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO2/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications.

scholarly journals A flexible ultrasensitive optoelectronic sensor array for neuromorphic vision systems

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Qian-Bing Zhu ◽  
Bo Li ◽  
Dan-Dan Yang ◽  
Chi Liu ◽  
Shun Feng ◽  
...  
Keyword(s):  
Sensor Array ◽  
Vision System ◽  
Vision Systems ◽  
Neuromorphic Circuits ◽  
Image Sensing ◽  
Perovskite Quantum Dots ◽  
Optoelectronic Sensor ◽  
Weak Light ◽  
Do So ◽  
Neuromorphic Vision

AbstractThe challenges of developing neuromorphic vision systems inspired by the human eye come not only from how to recreate the flexibility, sophistication, and adaptability of animal systems, but also how to do so with computational efficiency and elegance. Similar to biological systems, these neuromorphic circuits integrate functions of image sensing, memory and processing into the device, and process continuous analog brightness signal in real-time. High-integration, flexibility and ultra-sensitivity are essential for practical artificial vision systems that attempt to emulate biological processing. Here, we present a flexible optoelectronic sensor array of 1024 pixels using a combination of carbon nanotubes and perovskite quantum dots as active materials for an efficient neuromorphic vision system. The device has an extraordinary sensitivity to light with a responsivity of 5.1 × 107 A/W and a specific detectivity of 2 × 1016 Jones, and demonstrates neuromorphic reinforcement learning by training the sensor array with a weak light pulse of 1 μW/cm2.

scholarly journals Large-scale functional integration, rather than functional dissociation along dorsal and ventral streams, underlies visual perception and action

2019 ◽  
Author(s):  
Dipanjan Ray ◽  
Nilambari Hajare ◽  
Dipanjan Roy ◽  
Arpan Banerjee
Keyword(s):  
Visual Perception ◽  
Large Scale ◽  
Premotor Cortex ◽  
Functional Integration ◽  
Predictive Coding ◽  
Dorsal Stream ◽  
Brain Regions ◽  
Neural Pathways ◽  
Healthy Human ◽  
Mri Environment

AbstractVisual dual stream theory posits that two distinct neural pathways of specific functional significance originate from primary visual areas and reach the inferior temporal (ventral) and posterior parietal areas (dorsal). However, there are several unresolved questions concerning the fundamental aspects of this theory. For example, is the functional dissociation between ventral and dorsal stream driven by features in input stimuli or is it driven by categorical differences between visuo-perceptual and visuo-motor functions? Is the dual stream rigid or flexible? What is the nature of the interactions between two streams? We addressed these questions using fMRI recordings on healthy human volunteers and employing stimuli and tasks that can tease out the divergence between visuo-perceptual and visuo-motor models of dual stream theory. fMRI scans were repeated after seven practice sessions that were conducted in a non-MRI environment to investigate the effects of neuroplasticity. Brain activation analysis supports an input-based functional dissociation and existence of context-dependent neuroplasticity in dual stream areas. Intriguingly, premotor cortex activation was observed in the position perception task and distributed deactivated regions were observed in all perception tasks thus, warranting a network level analysis. Dynamic causal modelling (DCM) analysis incorporating activated and deactivated brain areas during perception tasks indicates that the brain dynamics during visual perception and actions could be interpreted within the framework of predictive coding. Effectively, the network level findings point towards the existence of more intricate context-driven functional networks selective of “what” and “where” information rather than segregated streams of processing along ventral and dorsal brain regions.

A large-scale ceramic package of the CMOS image sensor chip for remote sensing application

2012 ◽  
Author(s):  
Chia-Hung Chang ◽  
Jer Ling ◽  
Shih-Hung Lo ◽  
Wen-Chih Hsu ◽  
Cynthia Liu
Keyword(s):  
Remote Sensing ◽  
Large Scale ◽  
Cmos Image Sensor ◽  
Image Sensor ◽  
Sensor Chip ◽  
Remote Sensing Application ◽  
Sensing Application

Imaging the Keyhole in PAW of Aluminum Alloys

1999 ◽  
Vol 121 (3) ◽  
pp. 372-377 ◽  
Author(s):  
B. Zheng ◽  
H. J. Wang ◽  
Q. L. Wang ◽  
R. Kovacevic
Keyword(s):  
Aluminum Alloys ◽  
Weld Pool ◽  
Image Sensor ◽  
Band Pass Filter ◽  
Concave Mirror ◽  
Pass Filter ◽  
Image Sensing ◽  
Bottom Width ◽  
Band Pass ◽  
Variable Polarity Plasma Arc

This paper presents a technique for front image sensing of the weld pool in variable polarity plasma arc welding of aluminum alloys, and describes the determination of the geometrical size of the keyhole for subsequent real-time feedback control of a full penetration weld. Image formation occurs when the arc light reflects off the concave mirror-like surface of the depressed keyhole weld pool, and passes through a band-pass filter onto the image sensor. The image of the visual keyhole (nominal keyhole) is a two-dimensional projected picture of the actual keyhole weld pool. The variation in area of the nominal keyhole is closely correlated with the variation of the bottom width of the weld bead.

Recent advances in curved image sensor arrays for bioinspired vision system

Nano Today ◽  
2022 ◽  
Vol 42 ◽  
pp. 101366
Author(s):  
Wenchao Gao ◽  
Zhangsheng Xu ◽  
Xun Han ◽  
Caofeng Pan
Keyword(s):  
Vision System ◽  
Sensor Arrays ◽  
Image Sensor ◽  
Recent Advances
Sign in / Sign up

Export Citation Format

Share Document