scholarly journals A Comprehensive Survey on Nanophotonics Neural Networks

2021 ◽  
Author(s):  
Konstantinos Demertzis* ◽  
Georgios Papadopoulos ◽  
Lazaros Iliadis ◽  
Lykourgos Magafas
Keyword(s):  
Neural Networks ◽  
Optical Fibers ◽  
Training Methods ◽  
Optical Elements ◽  
Neuromorphic Circuits ◽  
Simultaneous Processing ◽  
Comprehensive Survey ◽  
Optical Activation ◽  
Computational Systems ◽  
Optical Circuits

: In the last years, materializations of neuromorphic circuits based on nanophotonic arrangements have been proposed, which contain complete optical circuits, laser, photodetectors, photonic crystals, optical fibers, flat waveguides, and other passive optical elements of nanostructured materials, which eliminate the time of simultaneous processing of big groups of data, taking advantage of the quantum perspective and thus highly increasing the potentials of contemporary intelligent computational systems. This article is an effort to record and study the research that has been conducted concerning the methods of development and materialization of neuromorphic circuits of Neural Networks of nanophotonic arrangements. In particular, an investigative study of the methods of developing nanophotonic neuromorphic processors, their originality in neuronic architectural structure, their training methods and their optimization has been realized along with the study of special issues such as optical activation functions and cost functions.

Recurrent Neural Networks for Edge Intelligence

2021 ◽  
Vol 54 (4) ◽  
pp. 1-38
Author(s):  
Varsha S. Lalapura ◽  
J. Amudha ◽  
Hariramn Selvamuruga Satheesh
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Model Performance ◽  
Network Architectures ◽  
Training Procedure ◽  
Resource Constrained ◽  
Compression Technique ◽  
Creative Art ◽  
Comprehensive Survey ◽  
Intelligent Models

Recurrent Neural Networks are ubiquitous and pervasive in many artificial intelligence applications such as speech recognition, predictive healthcare, creative art, and so on. Although they provide accurate superior solutions, they pose a massive challenge “training havoc.” Current expansion of IoT demands intelligent models to be deployed at the edge. This is precisely to handle increasing model sizes and complex network architectures. Design efforts to meet these for greater performance have had inverse effects on portability on edge devices with real-time constraints of memory, latency, and energy. This article provides a detailed insight into various compression techniques widely disseminated in the deep learning regime. They have become key in mapping powerful RNNs onto resource-constrained devices. While compression of RNNs is the main focus of the survey, it also highlights challenges encountered while training. The training procedure directly influences model performance and compression alongside. Recent advancements to overcome the training challenges with their strengths and drawbacks are discussed. In short, the survey covers the three-step process, namely, architecture selection, efficient training process, and suitable compression technique applicable to a resource-constrained environment. It is thus one of the comprehensive survey guides a developer can adapt for a time-series problem context and an RNN solution for the edge.

MetaLearning with Graph Neural Networks

2021 ◽  
Vol 23 (2) ◽  
pp. 13-22
Author(s):  
Debmalya Mandal ◽  
Sourav Medya ◽  
Brian Uzzi ◽  
Charu Aggarwal
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Future Research ◽  
Open Problems ◽  
Research Directions ◽  
Graph Problems ◽  
Meta Learning ◽  
Comprehensive Survey ◽  
Future Research Directions ◽  
Graph Neural Networks

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are few available samples. Meta-learning has been an important framework to address the lack of samples in machine learning, and in recent years, researchers have started to apply meta-learning to GNNs. In this work, we provide a comprehensive survey of different metalearning approaches involving GNNs on various graph problems showing the power of using these two approaches together. We categorize the literature based on proposed architectures, shared representations, and applications. Finally, we discuss several exciting future research directions and open problems.

Understanding Memories of the Past in the Context of Different Complex Neural Network Architectures

2022 ◽  
pp. 1-27
Author(s):  
Clifford Bohm ◽  
Douglas Kirkpatrick ◽  
Arend Hintze
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Mental Representations ◽  
Network Architectures ◽  
Information Theoretic ◽  
Time Points ◽  
The Past ◽  
Black Boxes ◽  
Past Experiences ◽  
Computational Systems

Abstract Deep learning (primarily using backpropagation) and neuroevolution are the preeminent methods of optimizing artificial neural networks. However, they often create black boxes that are as hard to understand as the natural brains they seek to mimic. Previous work has identified an information-theoretic tool, referred to as R, which allows us to quantify and identify mental representations in artificial cognitive systems. The use of such measures has allowed us to make previous black boxes more transparent. Here we extend R to not only identify where complex computational systems store memory about their environment but also to differentiate between different time points in the past. We show how this extended measure can identify the location of memory related to past experiences in neural networks optimized by deep learning as well as a genetic algorithm.

scholarly journals Investor Sentiment In The Financial Market: A Survey

2021 ◽  
Author(s):  
Charles A. Aziegbemhin
Keyword(s):  
Neural Networks ◽  
Risk Management ◽  
Financial Market ◽  
Investor Sentiment ◽  
Management Tool ◽  
Market Behavior ◽  
Market Returns ◽  
Wide Acceptance ◽  
Comprehensive Survey ◽  
Alternative Markets

Many techniques like technical analysis, fundamental analysis, neural networks etc are used to forecast market behavior but none of these methods has been consistently acceptable forecasting tool. This thesis surveys more than 200 related published articles that study investor sentiment techniques as derived and applied to forecasting equity, debt and alternative markets. From the literatures, it shows that the application of investor sentiment for evaluating market behavior is gaining wide acceptance. Changes in investor sentiment can trigger changes in the valuation and pricing of assets, therefore offering the ability to forecasting market directions more accurately than other techniques. This study is the most comprehensive survey on investor sentiment techniques and its impact on forecasting a panel of assets in the equity, debt, derivative and other alternative investment markets. It examines forecasting as it affects sentiment, investor sentiment, it influence on market returns, news analytics and its use as profit and risk management tool.

scholarly journals Enhancement of Speech Recognition System by neural network approaches of Clustering

2013 ◽  
Vol 6 (1) ◽  
pp. 266-271
Author(s):  
Anurag Upadhyay ◽  
Chitranjanjit Kaur
Keyword(s):  
Neural Networks ◽  
Speech Recognition ◽  
Recurrent Neural Networks ◽  
Alternative Energy ◽  
Recognition Rate ◽  
Speech Sound ◽  
Recognition System ◽  
Training Methods ◽  
Indian Languages ◽  
Phone Recognition

This paper addresses the problem of speech recognition to identify various modes of speech data. Speaker sounds are the acoustic sounds of speech. Statistical models of speech have been widely used for speech recognition under neural networks. In paper we propose and try to justify a new model in which speech co articulation the effect of phonetic context on speech sound is modeled explicitly under a statistical framework. We study speech phone recognition by recurrent neural networks and SOUL Neural Networks. A general framework for recurrent neural networks and considerations for network training are discussed in detail. SOUL NN clustering the large vocabulary that compresses huge data sets of speech. This project also different Indian languages utter by different speakers in different modes such as aggressive, happy, sad, and angry. Many alternative energy measures and training methods are proposed and implemented. A speaker independent phone recognition rate of 82% with 25% frame error rate has been achieved on the neural data base. Neural speech recognition experiments on the NTIMIT database result in a phone recognition rate of 68% correct. The research results in this thesis are competitive with the best results reported in the literature. 

scholarly journals Advances in Convolution Neural Networks Based Crowd Counting and Density Estimation

2021 ◽  
Vol 5 (4) ◽  
pp. 50
Author(s):  
Rafik Gouiaa ◽  
Moulay A. Akhloufi ◽  
Mozhdeh Shahbazi
Keyword(s):  
Neural Networks ◽  
Density Estimation ◽  
Traffic Monitoring ◽  
Crowd Counting ◽  
Convolution Neural Networks ◽  
Potential Applications ◽  
Comprehensive Survey ◽  
Camera Perspective ◽  
Aerial Vehicle ◽  
Uav Images

Automatically estimating the number of people in unconstrained scenes is a crucial yet challenging task in different real-world applications, including video surveillance, public safety, urban planning, and traffic monitoring. In addition, methods developed to estimate the number of people can be adapted and applied to related tasks in various fields, such as plant counting, vehicle counting, and cell microscopy. Many challenges and problems face crowd counting, including cluttered scenes, extreme occlusions, scale variation, and changes in camera perspective. Therefore, in the past few years, tremendous research efforts have been devoted to crowd counting, and numerous excellent techniques have been proposed. The significant progress in crowd counting methods in recent years is mostly attributed to advances in deep convolution neural networks (CNNs) as well as to public crowd counting datasets. In this work, we review the papers that have been published in the last decade and provide a comprehensive survey of the recent CNNs based crowd counting techniques. We briefly review detection-based, regression-based, and traditional density estimation based approaches. Then, we delve into detail regarding the deep learning based density estimation approaches and recently published datasets. In addition, we discuss the potential applications of crowd counting and in particular its applications using unmanned aerial vehicle (UAV) images.

Sign in / Sign up

Export Citation Format

Share Document