Constructive Incremental Learning from Only Local Information

1998 ◽  
Vol 10 (8) ◽  
pp. 2047-2084 ◽  
Author(s):  
Stefan Schaal ◽  
Christopher G. Atkeson
Keyword(s):  
Linear Model ◽  
Incremental Learning ◽  
Linear Models ◽  
Expert Knowledge ◽  
Receptive Fields ◽  
Learning System ◽  
Independent Learning ◽  
Independent Expert ◽  
Learning Capabilities ◽  
Locally Linear

We introduce a constructive, incremental learning system for regression problems that models data by means of spatially localized linear models. In contrast to other approaches, the size and shape of the receptive field of each locally linear model, as well as the parameters of the locally linear model itself, are learned independently, that is, without the need for competition or any other kind of communication. Independent learning is accomplished by incrementally minimizing a weighted local cross-validation error. As a result, we obtain a learning system that can allocate resources as needed while dealing with the bias-variance dilemma in a principled way. The spatial localization of the linear models increases robustness toward negative interference. Our learning system can be interpreted as a nonparametric adaptive bandwidth smoother, as a mixture of experts where the experts are trained in isolation, and as a learning system that profits from combining independent expert knowledge on the same problem. This article illustrates the potential learning capabilities of purely local learning and offers an interesting and powerful approach to learning with receptive fields.

scholarly journals Analysis of a Linear Model for Non-Synchronous Vibrations Near Stall

2021 ◽  
Vol 6 (3) ◽  
pp. 26
Author(s):  
Christoph Brandstetter ◽  
Sina Stapelfeldt
Keyword(s):  
Linear Model ◽  
Linear Models ◽  
Structural Vibration ◽  
Experimental Investigations ◽  
Vibration Modes ◽  
Critical Problem ◽  
Safety Critical ◽  
Unstable Vibration ◽  
Aero Engines ◽  
Lock In

Non-synchronous vibrations arising near the stall boundary of compressors are a recurring and potentially safety-critical problem in modern aero-engines. Recent numerical and experimental investigations have shown that these vibrations are caused by the lock-in of circumferentially convected aerodynamic disturbances and structural vibration modes, and that it is possible to predict unstable vibration modes using coupled linear models. This paper aims to further investigate non-synchronous vibrations by casting a reduced model for NSV in the frequency domain and analysing stability for a range of parameters. It is shown how, and why, under certain conditions linear models are able to capture a phenomenon, which has traditionally been associated with aerodynamic non-linearities. The formulation clearly highlights the differences between convective non-synchronous vibrations and flutter and identifies the modifications necessary to make quantitative predictions.

scholarly journals A Cascaded Unsupervised Model for PoS Tagging

2021 ◽  
Vol 20 (1) ◽  
pp. 1-23
Author(s):  
Necva Bölücü ◽  
Burcu Can
Keyword(s):  
Linear Model ◽  
Language Processing ◽  
Bayesian Model ◽  
Linear Models ◽  
Syntactic Category ◽  
Semantic Parsing ◽  
Pos Tagging ◽  
Part Of Speech ◽  
Sentence Level ◽  
Log Linear

Part of speech (PoS) tagging is one of the fundamental syntactic tasks in Natural Language Processing, as it assigns a syntactic category to each word within a given sentence or context (such as noun, verb, adjective, etc.). Those syntactic categories could be used to further analyze the sentence-level syntax (e.g., dependency parsing) and thereby extract the meaning of the sentence (e.g., semantic parsing). Various methods have been proposed for learning PoS tags in an unsupervised setting without using any annotated corpora. One of the widely used methods for the tagging problem is log-linear models. Initialization of the parameters in a log-linear model is very crucial for the inference. Different initialization techniques have been used so far. In this work, we present a log-linear model for PoS tagging that uses another fully unsupervised Bayesian model to initialize the parameters of the model in a cascaded framework. Therefore, we transfer some knowledge between two different unsupervised models to leverage the PoS tagging results, where a log-linear model benefits from a Bayesian model’s expertise. We present results for Turkish as a morphologically rich language and for English as a comparably morphologically poor language in a fully unsupervised framework. The results show that our framework outperforms other unsupervised models proposed for PoS tagging.

scholarly journals Linear power-flow analysis method for AC-DC electric power networks

2021 ◽  
Author(s):  
Mohammadreza Vatani
Keyword(s):  
Power Systems ◽  
Linear Model ◽  
Power Flow ◽  
Linear Models ◽  
Power Converters ◽  
Power Balance ◽  
Balance Equations ◽  
Dc Power ◽  
Phase Angles ◽  
Dc Power Systems

AC-DC power systems have been operating more than sixty years. Nonlinear bus-wise power balance equations provide accurate model of AC-DC power systems. However, optimization tools for planning and operation require linear version, even if approximate, for creating tractable algorithms, considering modern elements such as DERs (distributed energy resources). Hitherto, linear models of only AC power systems are available, which coincidentally are called DC power flow. To address this drawback, linear bus-wise power balance equations are developed for AC-DC power systems and presented. As a first contribution, while AC and DC lines are represented by susceptance and conductance elements, AC-DC power converters are represented by a proposed linear relationship. As a second contribution, a three-step linear AC-DC power flow method is proposed. The first step solves the whole network considering it as a linear AC network, yielding bus phase angles at all busses. The second step computes attributes of the proposed linear model of all AC-DC power converters. The third step solves the linear model of the AC-DC system including converters, yielding bus phase angles at AC busses and voltage magnitudes at DC busses. The benefit of the proposed linear power flow model of AC-DC power system, while an approximation of the nonlinear model, enables representation of bus-wise power balance of AC-DC systems in complex planning and operational optimization formulations and hence holds the promise of phenomenal progress. The proposed linear AC-DC power systems is tested on numerous IEEE test systems and demonstrated to be fast, reliable, and consistent.

scholarly journals Incremental and developmental perspectives for general-purpose learning systems

2017 ◽  
Vol 20 (60) ◽  
pp. 24
Author(s):  
Fernando Martínez-Plumed
Keyword(s):  
Knowledge Acquisition ◽  
Recommender Systems ◽  
Cognitive Abilities ◽  
Incremental Learning ◽  
General Purpose ◽  
Learning Systems ◽  
Learning System ◽  
Self Driving Cars ◽  
Evaluation Techniques ◽  
Standing Problem

The stupefying success of Articial Intelligence (AI) for specic problems, from recommender systems to self-driving cars, has not yet been matched with a similar progress in general AI systems, coping with a variety of (dierent) problems. This dissertation deals with the long-standing problem of creating more general AI systems, through the analysis of their development and the evaluation of their cognitive abilities. It presents a declarative general-purpose learning system and a developmental and lifelong approach for knowledge acquisition, consolidation and forgetting. It also analyses the use of the use of more ability-oriented evaluation techniques for AI evaluation and provides further insight for the understanding of the concepts of development and incremental learning in AI systems.

scholarly journals Imitation Learning System Design with Small Training Data for Flexible Tool Manipulation

2021 ◽  
Vol 15 (5) ◽  
pp. 669-677
Author(s):  
Harumo Sasatake ◽  
Ryosuke Tasaki ◽  
Takahito Yamashita ◽  
Naoki Uchiyama ◽  
◽  
...  
Keyword(s):  
Deep Learning ◽  
Expert Knowledge ◽  
Teaching Method ◽  
Population Aging ◽  
Developed Countries ◽  
Learning System ◽  
Training Data ◽  
Robot Arm ◽  
Flexible Tool ◽  
Human Labor

Population aging has become a major problem in developed countries. As the labor force declines, robot arms are expected to replace human labor for simple tasks. A robotic arm attaches a tool specialized for a task and acquires the movement through teaching by an engineer with expert knowledge. However, the number of such engineers is limited; therefore, a teaching method that can be used by non-technical personnel is necessitated. As a teaching method, deep learning can be used to imitate human behavior and tool usage. However, deep learning requires a large amount of training data for learning. In this study, the target task of the robot is to sweep multiple pieces of dirt using a broom. The proposed learning system can estimate the initial parameters for deep learning based on experience, as well as the shape and physical properties of the tools. It can reduce the number of training data points when learning a new tool. A virtual reality system is used to move the robot arm easily and safely, as well as to create training data for imitation. In this study, cleaning experiments are conducted to evaluate the effectiveness of the proposed method. The experimental results confirm that the proposed method can accelerate the learning speed of deep learning and acquire cleaning ability using a small amount of training data.

scholarly journals Experimental validation of wind energy estimation

2020 ◽  
Vol 24 (6 Part A) ◽  
pp. 3795-3806
Author(s):  
Predrag Zivkovic ◽  
Mladen Tomic ◽  
Vukman Bakic
Keyword(s):  
Wind Speed ◽  
Linear Model ◽  
Linear Models ◽  
Stokes Equations ◽  
Momentum Conservation ◽  
Electricity Production ◽  
Navier Stokes ◽  
Energy Estimation ◽  
Navier Stokes Equations ◽  
Non Linear

Wind power assessment in complex terrain is a very demanding task. Modeling wind conditions with standard linear models does not sufficiently reproduce wind conditions in complex terrains, especially on leeward sides of terrain slopes, primarily due to the vorticity. A more complex non-linear model, based on Reynolds averaged Navier-Stokes equations has been used. Turbulence was modeled by modified two-equations k-? model for neutral atmospheric boundary-layer conditions, written in general curvelinear non-orthogonal co-ordinate system. The full set of mass and momentum conservation equations as well as turbulence model equations are numerically solved, using the as CFD technique. A comparison of the application of linear model and non-linear model is presented. Considerable discrepancies of estimated wind speed have been obtained using linear and non-linear models. Statistics of annual electricity production vary up to 30% of the model site. Even anemometer measurements directly at a wind turbine?s site do not necessarily deliver the results needed for prediction calculations, as extrapolations of wind speed to hub height is tricky. The results of the simulation are compared by means of the turbine type, quality and quantity of the wind data and capacity factor. Finally, the comparison of the estimated results with the measured data at 10, 30, and 50 m is shown.

scholarly journals A linear model for leaf area measurement to screen potential leaf material for herbal drug in Adhatoda vasica L.

2016 ◽  
Vol 8 (1) ◽  
pp. 140-143
Author(s):  
J. V. Thaker ◽  
R. P. Kuvad ◽  
V. S. Thaker
Keyword(s):  
Water Content ◽  
Leaf Area ◽  
Linear Model ◽  
Plant Species ◽  
Linear Models ◽  
Dry Weight ◽  
Nondestructive Method ◽  
Area Measurement ◽  
Adhatoda Vasica ◽  
Linear Correlations

Leaf area is an important parameter in physiology and agronomy studies. Linear models for leaf area measurement are developed for plant species as a nondestructive method. The plant Adhatoda vasica L. (a medicinal plant) was selected and the leaves of this plant were used for development of linear model for leaf area using Leaf Area Meter (LAM) software. Planimetric parameters (length, length2, width and width2) and gravimetric (dry weight and water content) parameters are considered for the development of linear model for this plant species. Single factor ANOVA and linear correlations were worked out using these parameters and leaf area. The plant was showed significant relationship with the parameters studied. The best correlation as represented by regression coefficient (R2) was used and improved R2 is worked out. It is observed that with increase in leaf area, water content is also increased and showed best correlation with the leaf area. Thus water content can be taken as a parameter for developing linear model for leaf area is concluded.

scholarly journals The Application of Log-Linear Model to Selected Poison Patients

2020 ◽  
pp. 1-7
Author(s):  
Fatin N.S.A. ◽  
Norlida M.N. ◽  
Siti Z.M.J.
Keyword(s):  
Linear Model ◽  
Linear Models ◽  
Demographic Data ◽  
Contingency Tables ◽  
Categorical Variables ◽  
State Variables ◽  
Exposure Route ◽  
Higher Dimensional ◽  
Route Of Exposure ◽  
Log Linear

Log-linear model is a technique used to analyze the cross-classification categorical data or the contingency table. It is used to obtain the parsimony models that describe the interaction between the categorical variables in contingency tables. Log-linear models are commonly used in evaluating higher dimensional contingency tables that involves more than two categorical variables. This study focuses on analyzing data of poisoned patients from 2012 to 2014 using log-linear model. There are two model analyzed; model for demographic data of patients and model of poisoning information. For the first model, the variables involved are gender, age, race and state. Variables for the second model are circumstance of exposure, type of exposure, location of exposure, route of exposure and types of poison. Both log-linear models are developed to investigate the association between variables in the model. As a result of this study, the best model for demographic data and poisoning information are the model with three-ways interaction. For the best model of demographic data, there is an association between gender, age and race, race, gender and state as well as age, race and state. Meanwhile, the best model for poisoning information reveals that there is relationship between circumstance of exposure, route of exposure and type of poison, location of exposure, route of exposure and type of poison, circumstance of exposure, type of exposure and route of exposure, circumstance of exposure, location of exposure and route of exposure, circumstance of exposure, type of exposure and type of poison and also type of exposure, location of exposure and type of poison. Keywords: log-linear; demographic; gender; age; race; state; circumstance of exposure; type of exposure; location of exposure; route of exposure; types of poison

scholarly journals Sensitivity of the General Linear Model to Assumptions

2020 ◽  
Vol 6 (5) ◽  
pp. 21-25
Keyword(s):  
Linear Model ◽  
Gaussian Noise ◽  
Linear Models ◽  
General Linear Model ◽  
White Gaussian Noise ◽  
General Linear ◽  
Optimal Estimator ◽  
Significant Performance ◽  
Non Gaussian ◽  
Noise Models

Non-Gaussian noise often causes in significant performance abatement for systems which are designed using Gaussian assumption. This report challenges the question of General Linear Model with White Gaussian Noise assumption in order to define the sensitivity of the performance of an optimal estimator. Gaussian noise models provide an important role in many signal processing applications. The Laplacian and Uniform signal are two worthy examples of noise that can be compared to the White Gaussian Noise, though the sensitivity which can be compared with any non-Gaussian. White Gaussian Noise has been considered for General Linear Models and deviation from whiteness would affect on our estimates under different circumstances. Moreover, new assumptions have been considered to generate different type of signals in order to evaluate the sensitivity of the General Linear Model.

Sign in / Sign up

Export Citation Format

Share Document