scholarly journals Grammar Guided Genetic Programming for Network Architecture Search and Road Detection on Aerial Orthophotography

2020 ◽  
Vol 10 (11) ◽  
pp. 3953 ◽  
Author(s):  
Víctor de la Fuente Castillo ◽  
Alberto Díaz-Álvarez ◽  
Miguel-Ángel Manso-Callejo ◽  
Francisco Serradilla García
Keyword(s):  
Genetic Programming ◽  
Network Architecture ◽  
Structural Diversity ◽  
Network Architectures ◽  
Complex Structures ◽  
Road Detection ◽  
Learning Techniques ◽  
Candidate Network ◽  
Optimal Network ◽  
Hidden Layer

Photogrammetry involves aerial photography of the Earth’s surface and subsequently processing the images to provide a more accurate depiction of the area (Orthophotography). It is used by the Spanish Instituto Geográfico Nacional to update road cartography but requires a significant amount of manual labor due to the need to perform visual inspection of all tiled images. Deep learning techniques (artificial neural networks with more than one hidden layer) can perform road detection but it is still unclear how to find the optimal network architecture. Our main goal is the automatic design of deep neural network architectures with grammar-guided genetic programming. In this kind of evolutive algorithm, all the population individuals (here candidate network architectures) are constrained to rules specified by a grammar that defines valid and useful structural patterns to guide the search process. Grammar used includes well-known complex structures (e.g., Inception-like modules) combined with a custom designed mutation operator (dynamically links the mutation probability to structural diversity). Pilot results show that the system is able to design models for road detection that obtain test accuracies similar to that reached by state-of-the-art models when evaluated over a dataset from the Spanish National Aerial Orthophotography Plan.

scholarly journals Grammar Guided Genetic Programming for Network Architecture Search and Road Detection on Aerial Orthophotography

2020 ◽  
Author(s):  
Víctor de la Fuente Castillo ◽  
Alberto Díaz-Álvarez ◽  
Miguel-Ángel Manso-Callejo ◽  
Francisco Serradilla García
Keyword(s):  
Genetic Programming ◽  
Network Architecture ◽  
Structural Diversity ◽  
Network Architectures ◽  
Complex Structures ◽  
Road Detection ◽  
Learning Techniques ◽  
Candidate Network ◽  
Optimal Network ◽  
Hidden Layer

Photogrammetry involves aerial photography of the earth’s surface and subsequently processing the images to provide a more accurate depiction of the area (Orthophotography). It’s used by the Spanish Instituto Geográfico Nacional to update road cartography but requires a significant amount of manual labor due to the need to perform visual inspection of all tiled images. Deep Learning techniques (artificial neural networks with more than one hidden layer) can perform road detection but it is still unclear how to find the optimal network architecture. Our system applies grammar guided genetic programming to the search of deep neural network architectures. In this kind of evolutive algorithm all the population individuals (here candidate network architectures) are constrained to rules specified by a grammar that defines valid and useful structural patterns to guide the search process. Grammar used includes well-known complex structures (e.g. Inception-like modules) combined with a custom designed mutation operator (dynamically links the mutation probability to structural diversity). Pilot results show that the system is able to design models for road detection that obtain test accuracies similar to that reached by state of the art models when evaluated over a dataset from the Spanish National Aerial Orthophotography Plan.

scholarly journals A Hybrid Wavelet Transform Based Short-Term Wind Speed Forecasting Approach

2014 ◽  
Vol 2014 ◽  
pp. 1-12 ◽  
Author(s):  
Jujie Wang
Keyword(s):  
Wavelet Transform ◽  
Wind Speed ◽  
Network Architecture ◽  
Hybrid Approach ◽  
Experimental Simulation ◽  
Wind Speed Forecasting ◽  
Optimal Network ◽  
Partial Autocorrelation Function ◽  
Parks Management ◽  
Hidden Layer

It is important to improve the accuracy of wind speed forecasting for wind parks management and wind power utilization. In this paper, a novel hybrid approach known as WTT-TNN is proposed for wind speed forecasting. In the first step of the approach, a wavelet transform technique (WTT) is used to decompose wind speed into an approximate scale and several detailed scales. In the second step, a two-hidden-layer neural network (TNN) is used to predict both approximated scale and detailed scales, respectively. In order to find the optimal network architecture, the partial autocorrelation function is adopted to determine the number of neurons in the input layer, and an experimental simulation is made to determine the number of neurons within each hidden layer in the modeling process of TNN. Afterwards, the final prediction value can be obtained by the sum of these prediction results. In this study, a WTT is employed to extract these different patterns of the wind speed and make it easier for forecasting. To evaluate the performance of the proposed approach, it is applied to forecast Hexi Corridor of China’s wind speed. Simulation results in four different cases show that the proposed method increases wind speed forecasting accuracy.

scholarly journals Image reconstruction through a multimode fiber with a simple neural network architecture

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Changyan Zhu ◽  
Eng Aik Chan ◽  
You Wang ◽  
Weina Peng ◽  
Ruixiang Guo ◽  
...  
Keyword(s):  
Neural Network ◽  
Image Reconstruction ◽  
Network Architecture ◽  
Neural Network Architecture ◽  
Training Time ◽  
Modal Dispersion ◽  
Multimode Fibers ◽  
Speckle Patterns ◽  
Hidden Layer ◽  
Simple Neural Network

AbstractMultimode fibers (MMFs) have the potential to carry complex images for endoscopy and related applications, but decoding the complex speckle patterns produced by mode-mixing and modal dispersion in MMFs is a serious challenge. Several groups have recently shown that convolutional neural networks (CNNs) can be trained to perform high-fidelity MMF image reconstruction. We find that a considerably simpler neural network architecture, the single hidden layer dense neural network, performs at least as well as previously-used CNNs in terms of image reconstruction fidelity, and is superior in terms of training time and computing resources required. The trained networks can accurately reconstruct MMF images collected over a week after the cessation of the training set, with the dense network performing as well as the CNN over the entire period.

scholarly journals Thermal-wet model of knitted double jersey based on backpropagation algorithm of neural network

2020 ◽  
Vol 15 ◽  
pp. 155892501990083
Author(s):  
Xintong Li ◽  
Honglian Cong ◽  
Zhe Gao ◽  
Zhijia Dong
Keyword(s):  
Neural Network ◽  
Water Vapor ◽  
Thermal Resistance ◽  
Resistance Test ◽  
Training Algorithm ◽  
Backpropagation Algorithm ◽  
Optimal Network ◽  
Resistance Model ◽  
Hidden Layer ◽  
The Relationship

In this article, thermal resistance test and water vapor resistance test were experimented to obtain data of heat and humidity performance. Canonical correlation analysis was used on determining influence of basic fabric parameters on heat and humidity performance. Thermal resistance model and water vapor resistance model were established with a three-layered feedforward-type neural network. For the generalization of the network and the difficulty of determining the optimal network structure, trainbr was chosen as training algorithm to find the relationship between input factors and output data. After training and verification, the number of hidden layer neurons in the thermal resistance model was 12, and the error reached 10−3. In the water vapor resistance model, the number of hidden layer neurons was 10, and the error reached 10−3.

Fourier Neural Networks and Generalized Single Hidden Layer Networks in Aircraft Engine Fault Diagnostics

2005 ◽  
Vol 128 (4) ◽  
pp. 773-782 ◽  
Author(s):  
H. S. Tan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Fourier Transforms ◽  
Aircraft Engine ◽  
Fault Classification ◽  
Noise Robustness ◽  
Fault Diagnostics ◽  
Multiple Faults ◽  
Hidden Layer

The conventional approach to neural network-based aircraft engine fault diagnostics has been mainly via multilayer feed-forward systems with sigmoidal hidden neurons trained by back propagation as well as radial basis function networks. In this paper, we explore two novel approaches to the fault-classification problem using (i) Fourier neural networks, which synthesizes the approximation capability of multidimensional Fourier transforms and gradient-descent learning, and (ii) a class of generalized single hidden layer networks (GSLN), which self-structures via Gram-Schmidt orthonormalization. Using a simulation program for the F404 engine, we generate steady-state engine parameters corresponding to a set of combined two-module deficiencies and require various neural networks to classify the multiple faults. We show that, compared to the conventional network architecture, the Fourier neural network exhibits stronger noise robustness and the GSLNs converge at a much superior speed.

Machine Learning for Neurodegenerative Disorder Diagnosis — Survey of Practices and Launch of Benchmark Dataset

2018 ◽  
Vol 27 (03) ◽  
pp. 1850011 ◽  
Author(s):  
Athanasios Tagaris ◽  
Dimitrios Kollias ◽  
Andreas Stafylopatis ◽  
Georgios Tagaris ◽  
Stefanos Kollias
Keyword(s):  
Machine Learning ◽  
Neurodegenerative Disorder ◽  
Developed Countries ◽  
Machine Learning Techniques ◽  
Network Architectures ◽  
Imaging Data ◽  
Learning Techniques ◽  
Medical Examinations

Neurodegenerative disorders, such as Alzheimer’s and Parkinson’s, constitute a major factor in long-term disability and are becoming more and more a serious concern in developed countries. As there are, at present, no effective therapies, early diagnosis along with avoidance of misdiagnosis seem to be critical in ensuring a good quality of life for patients. In this sense, the adoption of computer-aided-diagnosis tools can offer significant assistance to clinicians. In the present paper, we provide in the first place a comprehensive recording of medical examinations relevant to those disorders. Then, a review is conducted concerning the use of Machine Learning techniques in supporting diagnosis of neurodegenerative diseases, with reference to at times used medical datasets. Special attention has been given to the field of Deep Learning. In addition to that, we communicate the launch of a newly created dataset for Parkinson’s disease, containing epidemiological, clinical and imaging data, which will be publicly available to researchers for benchmarking purposes. To assess the potential of the new dataset, an experimental study in Parkinson’s diagnosis is carried out, based on state-of-the-art Deep Neural Network architectures and yielding very promising accuracy results.

scholarly journals Energy performance of 5G backhaul wireless network utilizing hybrid centric-distributed architecture

2019 ◽  
Vol 16 (3) ◽  
pp. 1343
Author(s):  
Hamza Mohammed Ridha Al-Khafaji ◽  
Hasan Shakir Majdi
Keyword(s):  
Energy Efficiency ◽  
Wireless Network ◽  
Network Architecture ◽  
Energy Performance ◽  
Small Cells ◽  
Network Architectures ◽  
Distributed Architecture ◽  
Wireless Backhaul ◽  
Fifth Generation ◽  
5G Network

<p>This paper scrutinizes the influence of deployment scenarios on the energy performance of fifth-generation (5G) network at various backhaul wireless frequency bands. An innovative network architecture, the hybrid centric-distributed, is employed and its energy efficiency (EE) model is analyzed. The obtained results confirm that the EE of the 5G network increases with an increasing number of small cells and degrades with an increasing frequency of wireless backhaul and radius of small cells regardless of the network architectures. Moreover, the hybrid centric-distributed architecture augments the EE when compared with the distributed architecture.</p>

scholarly journals Load Balance in Data Center SDN Networks

2018 ◽  
Vol 8 (5) ◽  
pp. 3084 ◽  
Author(s):  
Tariq Emad Ali ◽  
Ameer Hussein Morad ◽  
Mohammed A. Abdala
Keyword(s):  
Load Balancing ◽  
Data Center ◽  
Network Architecture ◽  
Current Data ◽  
Traffic Load ◽  
Network Architectures ◽  
Data Center Networks ◽  
Network Resources ◽  
Cloud Network ◽  
And Storage

<span>In the last two decades, networks had been changed according to the rapid changing in its requirements.  The current Data Center Networks have large number of hosts (tens or thousands) with special needs of bandwidth as the cloud network and the multimedia content computing is increased. The conventional Data Center Networks (DCNs) are highlighted by the increased number of users and bandwidth requirements which in turn have many implementation limitations.  The current networking devices with its control and forwarding planes coupling result in network architectures are not suitable for dynamic computing and storage needs.  Software Defined networking (SDN) is introduced to change this notion of traditional networks by decoupling control and forwarding planes. So, due to the rapid increase in the number of applications, websites, storage space, and some of the network resources are being underutilized due to static routing mechanisms. To overcome these limitations, a Software Defined Network based Openflow Data Center network architecture is used to obtain better performance parameters and implementing traffic load balancing function. The load balancing distributes the traffic requests over the connected servers, to diminish network congestions, and reduce underutilization problem of servers. As a result, SDN is developed to afford more effective configuration, enhanced performance, and more flexibility to deal with huge network designs</span>

scholarly journals Evolutionary Machine Learning for Classification with Incomplete Data

2021 ◽  
Author(s):  
◽  
Cao Truong Tran
Keyword(s):  
Machine Learning ◽  
Feature Selection ◽  
Genetic Programming ◽  
Incomplete Data ◽  
Missing Values ◽  
Machine Learning Techniques ◽  
Feature Construction ◽  
Classification Algorithms ◽  
Learning Techniques ◽  
Effectiveness And Efficiency

<p>Classification is a major task in machine learning and data mining. Many real-world datasets suffer from the unavoidable issue of missing values. Classification with incomplete data has to be carefully handled because inadequate treatment of missing values will cause large classification errors.    Existing most researchers working on classification with incomplete data focused on improving the effectiveness, but did not adequately address the issue of the efficiency of applying the classifiers to classify unseen instances, which is much more important than the act of creating classifiers. A common approach to classification with incomplete data is to use imputation methods to replace missing values with plausible values before building classifiers and classifying unseen instances. This approach provides complete data which can be then used by any classification algorithm, but sophisticated imputation methods are usually computationally intensive, especially for the application process of classification. Another approach to classification with incomplete data is to build a classifier that can directly work with missing values. This approach does not require time for estimating missing values, but it often generates inaccurate and complex classifiers when faced with numerous missing values. A recent approach to classification with incomplete data which also avoids estimating missing values is to build a set of classifiers which then is used to select applicable classifiers for classifying unseen instances. However, this approach is also often inaccurate and takes a long time to find applicable classifiers when faced with numerous missing values.   The overall goal of the thesis is to simultaneously improve the effectiveness and efficiency of classification with incomplete data by using evolutionary machine learning techniques for feature selection, clustering, ensemble learning, feature construction and constructing classifiers.   The thesis develops approaches for improving imputation for classification with incomplete data by integrating clustering and feature selection with imputation. The approaches improve both the effectiveness and the efficiency of using imputation for classification with incomplete data.   The thesis develops wrapper-based feature selection methods to improve input space for classification algorithms that are able to work directly with incomplete data. The methods not only improve the classification accuracy, but also reduce the complexity of classifiers able to work directly with incomplete data.   The thesis develops a feature construction method to improve input space for classification algorithms with incomplete data by proposing interval genetic programming-genetic programming with a set of interval functions. The method improves the classification accuracy and reduces the complexity of classifiers.   The thesis develops an ensemble approach to classification with incomplete data by integrating imputation, feature selection, and ensemble learning. The results show that the approach is more accurate, and faster than previous common methods for classification with incomplete data.   The thesis develops interval genetic programming to directly evolve classifiers for incomplete data. The results show that classifiers generated by interval genetic programming can be more effective and efficient than classifiers generated the combination of imputation and traditional genetic programming. Interval genetic programming is also more effective than common classification algorithms able to work directly with incomplete data.    In summary, the thesis develops a range of approaches for simultaneously improving the effectiveness and efficiency of classification with incomplete data by using a range of evolutionary machine learning techniques.</p>

scholarly journals Trends in Computer-Aided Diagnosis Using Deep Learning Techniques: A Review of Recent Studies on Algorithm Development

2017 ◽  
Author(s):  
Bosede Iyiade Edwards ◽  
Nosiba Hisham Osman Khougali ◽  
Adrian David Cheok
Keyword(s):  
Deep Learning ◽  
Human Subjects ◽  
Binary Classification ◽  
Computer Aided Diagnosis ◽  
Network Architectures ◽  
Learning Approaches ◽  
Learning Techniques ◽  
Computer Aided ◽  
Multi Class Classification ◽  
Aided Diagnosis

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

Sign in / Sign up

Export Citation Format

Share Document