IMPROVING SUPERVISED LEARNING BY ADAPTING THE PROBLEM TO THE LEARNER

2009 ◽  
Vol 19 (01) ◽  
pp. 1-9 ◽  
Author(s):  
JOSHUA MENKE ◽  
TONY MARTINEZ
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Supervised Learning ◽  
Learning Algorithm ◽  
Training Data ◽  
Data Sets ◽  
Proof Of Concept ◽  
Original Function ◽  
Equivalent Function ◽  
Training Examples

While no supervised learning algorithm can do well over all functions, we show that it may be possible to adapt a given function to a given supervised learning algorithm so as to allow the learning algorithm to better classify the original function. Although this seems counterintuitive, adapting the problem to the learner may result in an equivalent function that is "easier" for the algorithm to learn. One method of adapting a problem to the learner is to relabel the targets given in the training data. The following presents two problem adaptation methods, SOL-CTR-E and SOL-CTR-P, variants of Self-Oracle Learning with Confidence-based Target Relabeling (SOL-CTR) as a proof of concept for problem adaptation. The SOL-CTR methods produce "easier" target functions for training artificial neural networks (ANNs). Applying SOL-CTR over 41 data sets consistently results in a statistically significant (p < 0.05) improvement in accuracy over 0/1 targets on data sets containing over 10,000 training examples.

scholarly journals Simulation of flood flow in a river system using artificial neural networks

2005 ◽  
Vol 9 (4) ◽  
pp. 313-321 ◽  
Author(s):  
R. R. Shrestha ◽  
S. Theobald ◽  
F. Nestmann
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Flow Simulation ◽  
Simulation Models ◽  
River System ◽  
Training Data ◽  
Data Sets ◽  
Network Training ◽  
Artificial Neural ◽  
Flood Flow

Abstract. Artificial neural networks (ANNs) provide a quick and flexible means of developing flood flow simulation models. An important criterion for the wider applicability of the ANNs is the ability to generalise the events outside the range of training data sets. With respect to flood flow simulation, the ability to extrapolate beyond the range of calibrated data sets is of crucial importance. This study explores methods for improving generalisation of the ANNs using three different flood events data sets from the Neckar River in Germany. An ANN-based model is formulated to simulate flows at certain locations in the river reach, based on the flows at upstream locations. Network training data sets consist of time series of flows from observation stations. Simulated flows from a one-dimensional hydrodynamic numerical model are integrated for network training and validation, at a river section where no measurements are available. Network structures with different activation functions are considered for improving generalisation. The training algorithm involved backpropagation with the Levenberg-Marquardt approximation. The ability of the trained networks to extrapolate is assessed using flow data beyond the range of the training data sets. The results of this study indicate that the ANN in a suitable configuration can extend forecasting capability to a certain extent beyond the range of calibrated data sets.

scholarly journals Advanced approach to numerical forecasting using artificial neural networks

2009 ◽  
Vol 57 (6) ◽  
pp. 297-304 ◽  
Author(s):  
Michael Štencl ◽  
Jiří Šťastný
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Learning Algorithm ◽  
Information Age ◽  
Back Propagation ◽  
Global Market ◽  
Data Sets ◽  
Incoming Information ◽  
Past Data ◽  
Artificial Neural

Current global market is driven by many factors, such as the information age, the time and amount of information distributed by many data channels it is practically impossible analyze all kinds of incoming information flows and transform them to data with classical methods. New requirements could be met by using other methods. Once trained on patterns artificial neural networks can be used for forecasting and they are able to work with extremely big data sets in reasonable time. The patterns used for learning process are samples of past data. This paper uses Radial Basis Functions neural network in comparison with Multi Layer Perceptron network with Back-propagation learning algorithm on prediction task. The task works with simplified numerical time series and includes forty observations with prediction for next five observations. The main topic of the article is the identification of the main differences between used neural networks architectures together with numerical forecasting. Detected differences then verify on practical comparative example.

scholarly journals Transfer Learning–Based Artificial Neural Networks Post-Equalizers for Underwater Visible Light Communication

2021 ◽  
Vol 2 ◽  
Author(s):  
Yiheng Zhao ◽  
Shaohua Yu ◽  
Nan Chi
Keyword(s):  
Neural Networks ◽  
Big Data ◽  
Artificial Neural Networks ◽  
Visible Light ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Visible Light Communication ◽  
Training Data ◽  
Training Set ◽  
Artificial Neural

In this article, we demonstrate two transfer learning–based dual-branch multilayer perceptron post-equalizers (TL-DBMLPs) in carrierless amplitude and phase (CAP) modulation-based underwater visible light communication (UVLC) system. The transfer learning algorithm could reduce the dependence of artificial neural networks (ANN)–based post-equalizer on big data and extended training cycles. Compared with DBMLP, the TL-DBMLP is more robust to the jitter of the bias current (Ibias) of light-emitting diode (LED), which indicates that TL-DBMLP does not require further training in Ibias varying UVLC system. In terms of voltage peak-to-peak (Vpp) varying VLC system, DBMLP requires a training set with a size of more than 105 and 50 training epochs, which quantitatively prove the effectiveness of DBMLP in reducing reliance on large amount of training epochs. On the counterpart, the TL-DBMLP only requires a training set with a size of less than 2×104 and 10 training epochs, which quantitatively prove the effectiveness of DBMLP in reducing reliance on big data. Finally, we experimentally demonstrate that transfer learning can effectively reduce ANN dependence on extensive size training data and large amount of training epochs, whether in VLC systems with varying Ibias and varying Vpp.

scholarly journals Improving Semi-Supervised Learning for Audio Classification with FixMatch

Electronics ◽  
2021 ◽  
Vol 10 (15) ◽  
pp. 1807
Author(s):  
Sascha Grollmisch ◽  
Estefanía Cano
Keyword(s):  
Neural Networks ◽  
Supervised Learning ◽  
Transfer Learning ◽  
Data Transfer ◽  
State Of The Art ◽  
Training Data ◽  
Audio Classification ◽  
Image Domain ◽  
Full Dataset ◽  
Audio Data

Including unlabeled data in the training process of neural networks using Semi-Supervised Learning (SSL) has shown impressive results in the image domain, where state-of-the-art results were obtained with only a fraction of the labeled data. The commonality between recent SSL methods is that they strongly rely on the augmentation of unannotated data. This is vastly unexplored for audio data. In this work, SSL using the state-of-the-art FixMatch approach is evaluated on three audio classification tasks, including music, industrial sounds, and acoustic scenes. The performance of FixMatch is compared to Convolutional Neural Networks (CNN) trained from scratch, Transfer Learning, and SSL using the Mean Teacher approach. Additionally, a simple yet effective approach for selecting suitable augmentation methods for FixMatch is introduced. FixMatch with the proposed modifications always outperformed Mean Teacher and the CNNs trained from scratch. For the industrial sounds and music datasets, the CNN baseline performance using the full dataset was reached with less than 5% of the initial training data, demonstrating the potential of recent SSL methods for audio data. Transfer Learning outperformed FixMatch only for the most challenging dataset from acoustic scene classification, showing that there is still room for improvement.

scholarly journals Autonomous flight cycles and extreme landings of airliners beyond the current limits and capabilities using artificial neural networks

2021 ◽  
Author(s):  
Haitham Baomar ◽  
Peter J. Bentley
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Weather Conditions ◽  
Extreme Weather ◽  
Training Data ◽  
Aviation Industry ◽  
Control Models ◽  
Novel Approach ◽  
Network Modules ◽  
Artificial Neural

AbstractWe describe the Intelligent Autopilot System (IAS), a fully autonomous autopilot capable of piloting large jets such as airliners by learning from experienced human pilots using Artificial Neural Networks. The IAS is capable of autonomously executing the required piloting tasks and handling the different flight phases to fly an aircraft from one airport to another including takeoff, climb, cruise, navigate, descent, approach, and land in simulation. In addition, the IAS is capable of autonomously landing large jets in the presence of extreme weather conditions including severe crosswind, gust, wind shear, and turbulence. The IAS is a potential solution to the limitations and robustness problems of modern autopilots such as the inability to execute complete flights, the inability to handle extreme weather conditions especially during approach and landing where the aircraft’s speed is relatively low, and the uncertainty factor is high, and the pilots shortage problem compared to the increasing aircraft demand. In this paper, we present the work done by collaborating with the aviation industry to provide training data for the IAS to learn from. The training data is used by Artificial Neural Networks to generate control models automatically. The control models imitate the skills of the human pilot when executing all the piloting tasks required to pilot an aircraft between two airports. In addition, we introduce new ANNs trained to control the aircraft’s elevators, elevators’ trim, throttle, flaps, and new ailerons and rudder ANNs to counter the effects of extreme weather conditions and land safely. Experiments show that small datasets containing single demonstrations are sufficient to train the IAS and achieve excellent performance by using clearly separable and traceable neural network modules which eliminate the black-box problem of large Artificial Intelligence methods such as Deep Learning. In addition, experiments show that the IAS can handle landing in extreme weather conditions beyond the capabilities of modern autopilots and even experienced human pilots. The proposed IAS is a novel approach towards achieving full control autonomy of large jets using ANN models that match the skills and abilities of experienced human pilots and beyond.

scholarly journals Estimation of electrical resistivity using artificial neural networks: a case study from Lublin Basin, SE Poland

2021 ◽  
Author(s):  
Jakub Ważny ◽  
Michał Stefaniuk ◽  
Adam Cygal
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Training Data ◽  
Multilayer Perceptrons ◽  
Borehole Data ◽  
Geological Interpretation ◽  
Se Poland ◽  
Geological Conditions ◽  
Artificial Neural ◽  
Reliable Solution

AbstractArtificial neural networks method (ANNs) is a common estimation tool used for geophysical applications. Considering borehole data, when the need arises to supplement a missing well log interval or whole logging—ANNs provide a reliable solution. Supervised training of the network on a reliable set of borehole data values with further application of this network on unknown wells allows creation of synthetic values of missing geophysical parameters, e.g., resistivity. The main assumptions for boreholes are: representation of similar geological conditions and the use of similar techniques of well data collection. In the analyzed case, a set of Multilayer Perceptrons were trained on five separate chronostratigraphic intervals of borehole, considered as training data. The task was to predict missing deep laterolog (LLD) logging in a borehole representing the same sequence of layers within the Lublin Basin area. Correlation between well logs data exceeded 0.8. Subsequently, magnetotelluric parametric soundings were modeled and inverted on both boreholes. Analysis showed that congenial Occam 1D models had better fitting of TM mode of MT data in each case. Ipso facto, synthetic LLD log could be considered as a basis for geophysical and geological interpretation. ANNs provided solution for supplementing datasets based on this analytical approach.

Sign in / Sign up

Export Citation Format

Share Document