Shift of Bias as Non-Monotonic Reasoning

1990 ◽  
pp. 55-83 ◽  
Author(s):  
Benjamin N. Grosof ◽  
Stuart J. Russell
Keyword(s):  
Shift Of Bias

DC-Voltage-Induced Thermal Shift of Bias Point in<tex>$hboxLiNbO_3$</tex>Optical Modulators

2004 ◽  
Vol 16 (11) ◽  
pp. 2460-2462 ◽  
Author(s):  
H. Nagata ◽  
N.F. O'Brien ◽  
W.R. Bosenberg ◽  
G.L. Reiff ◽  
K.R. Voisine
Keyword(s):  
Optical Modulators ◽  
Dc Voltage ◽  
Bias Point ◽  
Shift Of Bias ◽  
Thermal Shift

scholarly journals How to Shift Bias: Lessons from the Baldwin Effect

1996 ◽  
Vol 4 (3) ◽  
pp. 271-295 ◽  
Author(s):  
Peter Turney
Keyword(s):  
Learning Algorithm ◽  
Inductive Learning ◽  
Learning Algorithms ◽  
Darwinian Evolution ◽  
Baldwin Effect ◽  
Lamarckian Evolution ◽  
Inheritance Of Acquired Characteristics ◽  
The Baldwin Effect ◽  
Fixed Bias ◽  
Shift Of Bias

An inductive learning algorithm takes a set of data as input and generates a hypothesis as output. A set of data is typically consistent with an infinite number of hypotheses; therefore, there must be factors other than the data that determine the output of the learning algorithm. In machine learning, these other factors are called the bias of the learner. Classical learning algorithms have a fixed bias, implicit in their design. Recently developed learning algorithms dynamically adjust their bias as they search for a hypothesis. Algorithms that shift bias in this manner are not as well understood as classical algorithms. In this paper, we show that the Baldwin effect has implications for the design and analysis of bias shifting algorithms. The Baldwin effect was proposed in 1896 to explain how phenomena that might appear to require Lamarckian evolution (inheritance of acquired characteristics) can arise from purely Darwinian evolution. Hinton and Nowlan presented a computational model of the Baldwin effect in 1987. We explore a variation on their model, which we constructed explicitly to illustrate the lessons that the Baldwin effect has for research in bias shifting algorithms. The main lesson is that it appears that a good strategy for shift of bias in a learning algorithm is to begin with a weak bias and gradually shift to a strong bias.

Sign in / Sign up

Export Citation Format

Share Document