On robust randomized neural networks for regression: a comprehensive review and evaluation

2020 ◽  
Vol 32 (22) ◽  
pp. 16931-16950
Author(s):  
Ananda L. Freire ◽  
Ajalmar R. Rocha-Neto ◽  
Guilherme A. Barreto
2016 ◽  
Vol 24 (3) ◽  
pp. 573-588 ◽  
Author(s):  
Kun Zhan ◽  
Jinhui Shi ◽  
Haibo Wang ◽  
Yuange Xie ◽  
Qiaoqiao Li

2022 ◽  
Vol 13 (1) ◽  
pp. 1-54
Author(s):  
Yu Zhou ◽  
Haixia Zheng ◽  
Xin Huang ◽  
Shufeng Hao ◽  
Dengao Li ◽  
...  

Graph neural networks provide a powerful toolkit for embedding real-world graphs into low-dimensional spaces according to specific tasks. Up to now, there have been several surveys on this topic. However, they usually lay emphasis on different angles so that the readers cannot see a panorama of the graph neural networks. This survey aims to overcome this limitation and provide a systematic and comprehensive review on the graph neural networks. First of all, we provide a novel taxonomy for the graph neural networks, and then refer to up to 327 relevant literatures to show the panorama of the graph neural networks. All of them are classified into the corresponding categories. In order to drive the graph neural networks into a new stage, we summarize four future research directions so as to overcome the challenges faced. It is expected that more and more scholars can understand and exploit the graph neural networks and use them in their research community.


Author(s):  
Manish Kumar ◽  
Sudhansu Kumar Mishra

Background: Various kind of medical imaging modalities are available for providing noninvasive view and for analyzing any pathological symptoms of human beings. Different noise may appear in those modalities at the time of acquisition, transmission, scanning, or at the time of storing. The removal of noises from the digital medical images without losing any inherent features is always considered a challenging task because a successful diagnosis relies on them. Numerous techniques have been proposed to fulfill this objective, and each having their own benefits and limitations. Discussion: In this comprehensive review article, more than 65 research articles are investigated to illustrate the applications of Artificial Neural Networks (ANN) in the field of biomedical image denoising. In particular, the zest of this article is to highlight the hybridized filtering model using nature-inspired algorithms and artificial neural networks for suppression of noise. Various other techniques, such as fixed filter, linear adaptive filters and gradient descent learning based neural network filter are also included. Conclusion: This article envisages how to train ANN using derivative free nature-inspired algorithms, and its performance in various medical images modalities and noise conditions.


2021 ◽  
Author(s):  
Zhao Zhang ◽  
Yanyan Wei ◽  
Haijun Zhang ◽  
Yi Yang ◽  
Shuicheng Yan ◽  
...  

<div>Abstract—Due to the powerful fitting ability of neural networks and massive training data, data-driven Single Image Deraining (SID) methods have obtained significant performance, and most of the existing studies focus on improving the deraining performance by proposing different kinds of deraining networks. However, the generalization ability of current SID methods may still be limited in the real scenario, and the deraining results also cannot effectively improve the performance of subsequent high-level tasks (such as object detection). The main reason may be because the current works mainly focus on designing new deraining neural networks, while neglecting the interpretation of the solving process. To investigate these issues, we in this paper re-examine the three important factors (i.e.,data, rain model and network architecture) for the SID task, and specifically analyze them by proposing new and more reasonable criteria (i.e., general vs. specific, synthetical vs. mathematical, black-box vs. white-box). We will also study the relationship of the three factors from new perspectives of data, and reveal two different solving paradigms (explicit vs. implicit) for the SID task. Besides, we also profoundly studied one of the three factors, i.e., data, and measured the performance of current methods on different datasets via extensive experiments to reveal the effectiveness of SID data. Finally, with the above comprehensive review and in-depth analysis, we also draw some valuable conclusions and suggestions for future research.</div>


2021 ◽  
Author(s):  
Zhao Zhang ◽  
Yanyan Wei ◽  
Haijun Zhang ◽  
Yi Yang ◽  
Shuicheng Yan ◽  
...  

<div>Abstract—Due to the powerful fitting ability of neural networks and massive training data, data-driven Single Image Deraining (SID) methods have obtained significant performance, and most of the existing studies focus on improving the deraining performance by proposing different kinds of deraining networks. However, the generalization ability of current SID methods may still be limited in the real scenario, and the deraining results also cannot effectively improve the performance of subsequent high-level tasks (such as object detection). The main reason may be because the current works mainly focus on designing new deraining neural networks, while neglecting the interpretation of the solving process. To investigate these issues, we in this paper re-examine the three important factors (i.e.,data, rain model and network architecture) for the SID task, and specifically analyze them by proposing new and more reasonable criteria (i.e., general vs. specific, synthetical vs. mathematical, black-box vs. white-box). We will also study the relationship of the three factors from new perspectives of data, and reveal two different solving paradigms (explicit vs. implicit) for the SID task. Besides, we also profoundly studied one of the three factors, i.e., data, and measured the performance of current methods on different datasets via extensive experiments to reveal the effectiveness of SID data. Finally, with the above comprehensive review and in-depth analysis, we also draw some valuable conclusions and suggestions for future research.</div>


2019 ◽  
Vol 6 (1) ◽  
Author(s):  
Si Zhang ◽  
Hanghang Tong ◽  
Jiejun Xu ◽  
Ross Maciejewski

Abstract Graphs naturally appear in numerous application domains, ranging from social analysis, bioinformatics to computer vision. The unique capability of graphs enables capturing the structural relations among data, and thus allows to harvest more insights compared to analyzing data in isolation. However, it is often very challenging to solve the learning problems on graphs, because (1) many types of data are not originally structured as graphs, such as images and text data, and (2) for graph-structured data, the underlying connectivity patterns are often complex and diverse. On the other hand, the representation learning has achieved great successes in many areas. Thereby, a potential solution is to learn the representation of graphs in a low-dimensional Euclidean space, such that the graph properties can be preserved. Although tremendous efforts have been made to address the graph representation learning problem, many of them still suffer from their shallow learning mechanisms. Deep learning models on graphs (e.g., graph neural networks) have recently emerged in machine learning and other related areas, and demonstrated the superior performance in various problems. In this survey, despite numerous types of graph neural networks, we conduct a comprehensive review specifically on the emerging field of graph convolutional networks, which is one of the most prominent graph deep learning models. First, we group the existing graph convolutional network models into two categories based on the types of convolutions and highlight some graph convolutional network models in details. Then, we categorize different graph convolutional networks according to the areas of their applications. Finally, we present several open challenges in this area and discuss potential directions for future research.


Sign in / Sign up

Export Citation Format

Share Document