On-line learning algorithm based on signal flow graph theory for PID neural networks

Author(s):  
Li Ming ◽  
Yang Cheng ◽  
Shu Yu ◽  
Yang Cheng-wu
1994 ◽  
Vol 6 (2) ◽  
pp. 296-306 ◽  
Author(s):  
Françoise Beaufays ◽  
Eric A. Wan

We show that signal flow graph theory provides a simple way to relate two popular algorithms used for adapting dynamic neural networks, real-time backpropagation and backpropagation-through-time. Starting with the flow graph for real-time backpropagation, we use a simple transposition to produce a second graph. The new graph is shown to be interreciprocal with the original and to correspond to the backpropagation-through-time algorithm. Interreciprocity provides a theoretical argument to verify that both flow graphs implement the same overall weight update.


Sign in / Sign up

Export Citation Format

Share Document