Finite State Machines and Recurrent Neural Networks — Automata and Dynamical Systems Approaches

Author(s):  
Peter Tiňo ◽  
Bill G. Horne ◽  
C. Lee Giles ◽  
Pete C. Collingwood
1995 ◽  
Vol 7 (5) ◽  
pp. 931-949 ◽  
Author(s):  
R. Alquézar ◽  
A. Sanfeliu

In this paper we present an algebraic framework to represent finite state machines (FSMs) in single-layer recurrent neural networks (SLRNNs), which unifies and generalizes some of the previous proposals. This framework is based on the formulation of both the state transition function and the output function of an FSM as a linear system of equations, and it permits an analytical explanation of the representational capabilities of first-order and higher-order SLRNNs. The framework can be used to insert symbolic knowledge in RNNs prior to learning from examples and to keep this knowledge while training the network. This approach is valid for a wide range of activation functions, whenever some stability conditions are met. The framework has already been used in practice in a hybrid method for grammatical inference reported elsewhere (Sanfeliu and Alquézar 1994).


Author(s):  
CLEMENS FREY

In this work a co-evolutionary approach is used in conjunction with Genetic Programming operators in order to find certain transition rules for two-step discrete dynamical systems. This issue is similar to the well-known artificial-ant problem. We seek the dynamic system to produce a trajectory leading from given initial values to a maximum of a given spatial functional.This problem is recast into the framework of input-output relations for controllers, and the optimization is performed on program trees describing input filters and finite state machines incorporated by these controllers simultaneously. In the context of Genetic Programming there is always a set of test cases which has to be maintained for the evaluation of program trees. These test cases are subject to evolution here, too, so we employ a so-called host-parasitoid model in order to evolve optimizing dynamical systems.Reinterpreting these systems as algorithms for finding the maximum of a functional under constraints, we have derived a paradigm for the automatic generation of adapted optimization algorithms via optimal control. We provide numerical examples generated by the GP-system MathEvEco. These examples refer to key properties of the resulting strategies and they include statistical evidence showing that for this problem of system identification the co-evolutionary approach is superior to standard Genetic Programming.


1997 ◽  
Vol 8 (5) ◽  
pp. 1065-1070 ◽  
Author(s):  
D.S. Clouse ◽  
C.L. Giles ◽  
B.G. Horne ◽  
G.W. Cottrell

Sign in / Sign up

Export Citation Format

Share Document