A Deep Neural Network-Based Target Recognition Algorithm for Robot Scenes

Intelligent robots are a key vehicle for artificial intelligence and are widely employed in all aspects of everyday life and work, not just in the industry. One of the talents required for intelligent robots to complete their jobs is the capacity to identify their environment, which is a crucial obstacle to be overcome. Deep learning-based target identification algorithms currently do not fully leverage the link between high-level semantic and low-level detail information in the prediction step and hence are less successful in recognizing tiny target objects. Target recognition via vision sensors has also improved in accuracy and efficiency because of the development of deep learning. However, due to the insufficient usage of semantic information and precise texture information of underlying characteristics, tiny target recognition remains a difficulty. To address the aforementioned issues, we propose a target detection method based on a jump-connected pyramid model to improve the target detection performance of robots in complex scenarios. In order to verify the effectiveness of the algorithm, we designed and implemented a software system for target detection of intelligent robots and performed software integration of the proposed algorithm model with excellent experimental results. These experiments reveal that, when compared to other algorithms, our suggested algorithm’s characteristics have higher flexibility and robustness and can deliver a higher scene classification accuracy rate.

Brain-inspired global-local learning incorporated with neuromorphic computing

There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm.

A flexible capacitive photoreceptor for the biomimetic retina

Neuromorphic vision sensors have been extremely beneficial in developing energy-efficient intelligent systems for robotics and privacy-preserving security applications. There is a dire need for devices to mimic the retina’s photoreceptors that encode the light illumination into a sequence of spikes to develop such sensors. Herein, we develop a hybrid perovskite-based flexible photoreceptor whose capacitance changes proportionally to the light intensity mimicking the retina’s rod cells, paving the way for developing an efficient artificial retina network. The proposed device constitutes a hybrid nanocomposite of perovskites (methyl-ammonium lead bromide) and the ferroelectric terpolymer (polyvinylidene fluoride trifluoroethylene-chlorofluoroethylene). A metal-insulator-metal type capacitor with the prepared composite exhibits the unique and photosensitive capacitive behavior at various light intensities in the visible light spectrum. The proposed photoreceptor mimics the spectral sensitivity curve of human photopic vision. The hybrid nanocomposite is stable in ambient air for 129 weeks, with no observable degradation of the composite due to the encapsulation of hybrid perovskites in the hydrophobic polymer. The functionality of the proposed photoreceptor to recognize handwritten digits (MNIST) dataset using an unsupervised trained spiking neural network with 72.05% recognition accuracy is demonstrated. This demonstration proves the potential of the proposed sensor for neuromorphic vision applications.

Impact of Sports Wearable Testing Equipment Based on Vision Sensors on the Sports Industry

Sports wearable monitoring equipment is an intelligent device that collects many physiological signals of the human body through multiple sensors. It has a very active role in promoting data testing in the field of sports. This article is aimed at studying the impact of sports wearable detection devices based on vision sensors on the sports industry and at proposing effective strategies for the development of sports wearable devices in the sports industry. This paper proposes an azimuth integration algorithm based on wearable sensor data. This goal establishes a new feature based on azimuth angle information for a reliable human behavior recognition system based on acceleration data. Based on summarizing and comparing the advantages and disadvantages of existing azimuth conversion algorithms, this paper develops an azimuth code conversion algorithm based on the combination of additional processing and Kalman processing to explore the impact of wearable devices on the sports industry. The experimental results of this article show that in the current sports industry, more than 19.74 million sports wearable testing devices have been put into use normally, which also means that the industry is about to enter a significant stage of development.

A Study on Traditional and CNN Based Computer Vision Sensors for Detection and Recognition of Road Signs with Realization for ADAS

The aim of this chapter is to provide an overview of how road signs can be detected and recognized to aid the ADAS applications and thus enhance the safety employing digital image processing and neural network based methods. The chapter also provides a comparison of these methods.