scholarly journals Towards Better Forecasting by Fusing Near and Distant Future Visions

2020 ◽  
Vol 34 (04) ◽  
pp. 3593-3600
Author(s):  
Jiezhu Cheng ◽  
Kaizhu Huang ◽  
Zibin Zheng
Keyword(s):  
Neural Network ◽  
Multivariate Time Series ◽  
Predictive Performance ◽  
Distant Future ◽  
Forecasting Accuracy ◽  
Learning Framework ◽  
The Neural Network ◽  
Multi Level ◽  
Real World Datasets ◽  
Future Visions

Multivariate time series forecasting is an important yet challenging problem in machine learning. Most existing approaches only forecast the series value of one future moment, ignoring the interactions between predictions of future moments with different temporal distance. Such a deficiency probably prevents the model from getting enough information about the future, thus limiting the forecasting accuracy. To address this problem, we propose Multi-Level Construal Neural Network (MLCNN), a novel multi-task deep learning framework. Inspired by the Construal Level Theory of psychology, this model aims to improve the predictive performance by fusing forecasting information (i.e., future visions) of different future time. We first use the Convolution Neural Network to extract multi-level abstract representations of the raw data for near and distant future predictions. We then model the interplay between multiple predictive tasks and fuse their future visions through a modified Encoder-Decoder architecture. Finally, we combine traditional Autoregression model with the neural network to solve the scale insensitive problem. Experiments on three real-world datasets show that our method achieves statistically significant improvements compared to the most state-of-the-art baseline methods, with average 4.59% reduction on RMSE metric and average 6.87% reduction on MAE metric.

scholarly journals A Neural Network Decomposition Algorithm for Mapping on Crossbar-Based Computing Systems

Electronics ◽  
2020 ◽  
Vol 9 (9) ◽  
pp. 1526 ◽  
Author(s):  
Choongmin Kim ◽  
Jacob A. Abraham ◽  
Woochul Kang ◽  
Jaeyong Chung
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Predictive Performance ◽  
Fixed Number ◽  
Decomposition Algorithm ◽  
Computing Systems ◽  
Network Decomposition ◽  
Von Neumann ◽  
Analog Computing ◽  
The Neural Network

Crossbar-based neuromorphic computing to accelerate neural networks is a popular alternative to conventional von Neumann computing systems. It is also referred as processing-in-memory and in-situ analog computing. The crossbars have a fixed number of synapses per neuron and it is necessary to decompose neurons to map networks onto the crossbars. This paper proposes the k-spare decomposition algorithm that can trade off the predictive performance against the neuron usage during the mapping. The proposed algorithm performs a two-level hierarchical decomposition. In the first global decomposition, it decomposes the neural network such that each crossbar has k spare neurons. These neurons are used to improve the accuracy of the partially mapped network in the subsequent local decomposition. Our experimental results using modern convolutional neural networks show that the proposed method can improve the accuracy substantially within about 10% extra neurons.

scholarly journals SOM-based aggregation for graph convolutional neural networks

2020 ◽  
Author(s):  
Luca Pasa ◽  
Nicolò Navarin ◽  
Alessandro Sperduti
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Predictive Performance ◽  
Aggregation Operator ◽  
Graph Representation ◽  
Approximation Properties ◽  
Neural Network Models ◽  
Self Organizing Maps ◽  
Node Level ◽  
Real World Datasets

AbstractGraph property prediction is becoming more and more popular due to the increasing availability of scientific and social data naturally represented in a graph form. Because of that, many researchers are focusing on the development of improved graph neural network models. One of the main components of a graph neural network is the aggregation operator, needed to generate a graph-level representation from a set of node-level embeddings. The aggregation operator is critical since it should, in principle, provide a representation of the graph that is isomorphism invariant, i.e. the graph representation should be a function of graph nodes treated as a set. DeepSets (in: Advances in neural information processing systems, pp 3391–3401, 2017) provides a framework to construct a set-aggregation operator with universal approximation properties. In this paper, we propose a DeepSets aggregation operator, based on Self-Organizing Maps (SOM), to transform a set of node-level representations into a single graph-level one. The adoption of SOMs allows to compute node representations that embed the information about their mutual similarity. Experimental results on several real-world datasets show that our proposed approach achieves improved predictive performance compared to the commonly adopted sum aggregation and many state-of-the-art graph neural network architectures in the literature.

scholarly journals PERANCANGAN MODEL UNTUK PERAMALAN TINGKAT PERTUMBUHAN PEMBIAYAAN MELALUI METODE JARINGAN SARAF TIRUAN DI BNI SYARIAH

2020 ◽  
Vol 6 (2) ◽  
Author(s):  
Orfyanny S Themba ◽  
Susianah Mokhtar
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Artificial Neural Network Model ◽  
Data Bank ◽  
Forecasting Accuracy ◽  
The Neural Network ◽  
Forecasting Method ◽  
Artificial Neural

ABSTRAKTren perkembangan pembiayaan di Indonesia mulai meningkat namun cenderung melambat dari tahun ke tahun. Peramalan pertumbuhan pembiayaan pada bank syariah menjadi hal yang menarik karena naik turunnya pembiayaan akan berdampak pada perekonomian Indonesia. Tujuan dari penelitian ini melakukan peramalan pertumbuhan pembiayaan dalam jangka waktu setahun melalui metode Jaringan Saraf Tiruan pada data Bank BNI Syariah dari tahun 2015 sampai dengan 2019. Hasil dari peramalan diharapkan memberi informasi bagi bank untuk menunjang pengambilan keputusan dan menyiapkan strategi meningkatkan pembiayaan sehingga semakin besar laba yang akan diperoleh. Model peramalan dibuat berdasarkan metode peramalan dan ditujukan untuk digunakan pada aplikasi peramalan pembiayaan. Model Jaringan Saraf Tiruan memiliki nilai akurasi peramalan yang tinggi karena memiliki nilai error RMSE, MAPE yang minimum. Dari hasil peramalan menggunakan model Jaringan Saraf Tiruan menunjukkan terjadi peningkatan pembiayaan pada setiap bulannya untuk akad murabahah, mudharabah, musyarakah dan qardh. Hanya pembiayaan yang menggunakan ijarah yang mengalami penurunan drastis dibanding tahun-tahun sebelumnya. Pembiayaan murabahah masih tetap mendominasi dibanding akad mudharabah, musyarakah, qardh dan ijarah selama tahun 2020 Kata Kunci: Jaringan Saraf Tiruan ;PembiayaanABSTRACT Trend of financing development in Indonesia is starting to increase but tends to slow down from year to year. It is interesting to forecast the growth of financing in Islamic banks because the up and down of financing will have an impact on the Indonesian economy. The purpose of this study to forecast financing growth within a year through the Neural Network method on BNI Syariah Bank data from 2015 to 2019. The results of the forecast are expected to provide information for banks to support decision making and prepare strategies to increase financing so that greater profits that will be obtained. The forecasting model is made based on the forecasting method and is intended for use in financing forecasting applications. The Artificial Neural Network Model has a high value of forecasting accuracy because it has a minimum error value of RMSE, MAPE. The results of forecasting using the Artificial Neural Network model show an increase in financing every month for murabahah, mudharabah, musyarakah and qardh contracts. Only financing using ijarah has experienced a drastic decline compared to previous years. Murabahah financing still dominates over the mudharabah, musyarakah, qardh and ijarah contracts during 2020Keyword: Arificial Neural Network ;Financing

scholarly journals Combining the Performance Strengths of the Logistic Regression and Neural Network Models: A Medical Outcomes Approach

2003 ◽  
Vol 3 ◽  
pp. 455-476 ◽  
Author(s):  
Wun Wong ◽  
Peter J. Fos ◽  
Frederick E. Petry
Keyword(s):  
Neural Network ◽  
Logistic Regression ◽  
Disease Process ◽  
Network Models ◽  
Predictive Performance ◽  
Medical Outcomes ◽  
Neural Network Models ◽  
The Neural Network ◽  
Combined Use ◽  
Logistic Regression Method

The assessment of medical outcomes is important in the effort to contain costs, streamline patient management, and codify medical practices. As such, it is necessary to develop predictive models that will make accurate predictions of these outcomes. The neural network methodology has often been shown to perform as well, if not better, than the logistic regression methodology in terms of sample predictive performance. However, the logistic regression method is capable of providing an explanation regarding the relationship(s) between variables. This explanation is often crucial to understanding the clinical underpinnings of the disease process. Given the respective strengths of the methodologies in question, the combined use of a statistical (i.e., logistic regression) and machine learning (i.e., neural network) technology in the classification of medical outcomes is warranted under appropriate conditions. The study discusses these conditions and describes an approach for combining the strengths of the models.

scholarly journals Fast automated detection of COVID-19 from medical images using convolutional neural networks

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Shuang Liang ◽  
Huixiang Liu ◽  
Yu Gu ◽  
Xiuhua Guo ◽  
Hongjun Li ◽  
...  
Keyword(s):  
Neural Network ◽  
Medical Images ◽  
Clinical Indicators ◽  
Specimen Handling ◽  
Learning Framework ◽  
Computed Tomography Images ◽  
Classification Framework ◽  
Global Pandemic ◽  
The Neural Network ◽  
Diagnosis Method

AbstractCoronavirus disease 2019 (COVID-19) is a global pandemic posing significant health risks. The diagnostic test sensitivity of COVID-19 is limited due to irregularities in specimen handling. We propose a deep learning framework that identifies COVID-19 from medical images as an auxiliary testing method to improve diagnostic sensitivity. We use pseudo-coloring methods and a platform for annotating X-ray and computed tomography images to train the convolutional neural network, which achieves a performance similar to that of experts and provides high scores for multiple statistical indices (F1 scores > 96.72% (0.9307, 0.9890) and specificity >99.33% (0.9792, 1.0000)). Heatmaps are used to visualize the salient features extracted by the neural network. The neural network-based regression provides strong correlations between the lesion areas in the images and five clinical indicators, resulting in high accuracy of the classification framework. The proposed method represents a potential computer-aided diagnosis method for COVID-19 in clinical practice.

scholarly journals Nanoscale neural network using non-linear spin-wave interference

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Ádám Papp ◽  
Wolfgang Porod ◽  
Gyorgy Csaba
Keyword(s):  
Neural Network ◽  
Spin Wave ◽  
Spin Waves ◽  
Field Pattern ◽  
Small Scale ◽  
Learning Framework ◽  
Wave Interference ◽  
The Neural Network ◽  
Neural Network Hardware ◽  
Signal Routing

AbstractWe demonstrate the design of a neural network hardware, where all neuromorphic computing functions, including signal routing and nonlinear activation are performed by spin-wave propagation and interference. Weights and interconnections of the network are realized by a magnetic-field pattern that is applied on the spin-wave propagating substrate and scatters the spin waves. The interference of the scattered waves creates a mapping between the wave sources and detectors. Training the neural network is equivalent to finding the field pattern that realizes the desired input-output mapping. A custom-built micromagnetic solver, based on the Pytorch machine learning framework, is used to inverse-design the scatterer. We show that the behavior of spin waves transitions from linear to nonlinear interference at high intensities and that its computational power greatly increases in the nonlinear regime. We envision small-scale, compact and low-power neural networks that perform their entire function in the spin-wave domain.

scholarly journals Estimation of Overtopping Discharges with Deep Neural Network(DNN) Method

2021 ◽  
Vol 8 (4) ◽  
pp. 229-236
Author(s):  
Changkyum Kim ◽  
Insik Chun ◽  
Byungcheol Oh
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Cost Function ◽  
Deep Neural Network ◽  
Multiple Linear Regression Model ◽  
Predictive Performance ◽  
Data Sets ◽  
Network Training ◽  
The Neural Network ◽  
The Cost

An Artificial Intelligence(AI) study was conducted to calculate overtopping discharges for various coastal structures. The Deep Neural Network(DNN), one of the artificial intelligence methods, was employed in the study. The neural network was trained, validated and tested using the EurOtop database containing the experimental data collected from all over the world. To improve the accuracy of the deep neural network results, all data were non-dimensionalized and max-min normalized as a preprocessing process. L2 regularization was also introduced in the cost function to secure the convergence of iterative learning, and the cost function was optimized using RMSProp and Adam techniques. In order to compare the performance of DNN, additional calculations based on the multiple linear regression model and EurOtop’s overtopping formulas were done as well, using the data sets which were not included in the network training. The results showed that the predictive performance of the AI technique was relatively superior to the two other methods.

scholarly journals A Comparative Study of Neural Networks and Fuzzy Systems in Modeling of a Nonlinear Dynamic System

2011 ◽  
Vol 1 (1) ◽  
pp. 65-73 ◽  
Author(s):  
Metin DEMIRTAS ◽  
Musa ALCI
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Fuzzy Systems ◽  
Performance Modeling ◽  
Nonlinear Dynamic System ◽  
Predictive Performance ◽  
Model Parameters ◽  
Data Set ◽  
The Neural Network ◽  
Practical Performance

The aim of this paper is to compare the neural network and fuzzy modeling approaches on a nonlinear system. We have taken Permanent Magnet Brushless Direct Current (PMBDC) motor data and have generated models using both approaches. The predictive performance of both methods was compared on the data set for model configurations.The paper describes the results of these tests and discusses the effects of changing model parameters on predictive and practical performance. Modeling sensitivity was used to compare for two methods. 

scholarly journals Nuclear mass systematics by complementing the Finite Range Droplet Model with neural networks

2019 ◽  
Vol 14 ◽  
pp. 65
Author(s):  
S. Athanassopoulos ◽  
E. Mavrommatis ◽  
K. A. Gernoth ◽  
J. W. Clark
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Model ◽  
Neural Network Model ◽  
Predictive Performance ◽  
Finite Range ◽  
Mass Excess ◽  
Nuclear Mass ◽  
Droplet Model ◽  
The Neural Network

A neural-network model is developed to reproduce the differences between experimental nuclear mass-excess values and the theoretical values given by the Finite Range Droplet Model. The results point to the existence of subtle regularities of nuclear structure not yet contained in the best microscopic/phenomenological models of atomic masses. Combining the FRDM and the neural-network model, we create a hybrid model with improved predictive performance on nuclear-mass systematics and related quantities.

Deep Multi-Instance Multi-Label Learning for Image Annotation

2017 ◽  
Vol 32 (03) ◽  
pp. 1859005 ◽  
Author(s):  
Hai-Feng Guo ◽  
Lixin Han ◽  
Shoubao Su ◽  
Zhou-Bao Sun
Keyword(s):  
Neural Network ◽  
Social Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Real World ◽  
Supervised Classification ◽  
Image Annotation ◽  
Learning Framework ◽  
Recent Advancement ◽  
Real World Datasets

Multi-Instance Multi-Label learning (MIML) is a popular framework for supervised classification where an example is described by multiple instances and associated with multiple labels. Previous MIML approaches have focused on predicting labels for instances. The idea of tackling the problem is to identify its equivalence in the traditional supervised learning framework. Motivated by the recent advancement in deep learning, in this paper, we still consider the problem of predicting labels and attempt to model deep learning in MIML learning framework. The proposed approach enables us to train deep convolutional neural network with images from social networks where images are well labeled, even labeled with several labels or uncorrelated labels. Experiments on real-world datasets demonstrate the effectiveness of our proposed approach.

Sign in / Sign up

Export Citation Format

Share Document