scholarly journals Comparison of Echo State Networks with Simple Recurrent Networks and Variable-Length Markov Models on Symbolic Sequences

Author(s):  
Michal Čerňanský ◽  
Peter Tiňo
2002 ◽  
Vol 14 (9) ◽  
pp. 2039-2041 ◽  
Author(s):  
J. Schmidhuber ◽  
F. Gers ◽  
D. Eck

In response to Rodriguez's recent article (2001), we compare the performance of simple recurrent nets and long short-term memory recurrent nets on context-free and context-sensitive languages.


2008 ◽  
Vol 3 (3) ◽  
pp. 359-369 ◽  
Author(s):  
D.S. Fava ◽  
S.R. Byers ◽  
S.J. Yang

2013 ◽  
Vol 17 (1) ◽  
pp. 253-267 ◽  
Author(s):  
N. J. de Vos

Abstract. Despite theoretical benefits of recurrent artificial neural networks over their feedforward counterparts, it is still unclear whether the former offer practical advantages as rainfall–runoff models. The main drawback of recurrent networks is the increased complexity of the training procedure due to their architecture. This work uses the recently introduced and conceptually simple echo state networks for streamflow forecasts on twelve river basins in the Eastern United States, and compares them to a variety of traditional feedforward and recurrent approaches. Two modifications on the echo state network models are made that increase the hydrologically relevant information content of their internal state. The results show that the echo state networks outperform feedforward networks and are competitive with state-of-the-art recurrent networks, across a range of performance measures. This, along with their simplicity and ease of training, suggests that they can be considered promising alternatives to traditional artificial neural networks in rainfall–runoff modelling.


2007 ◽  
Vol 108 (1-2) ◽  
pp. 98-115 ◽  
Author(s):  
Nikolay Stefanov ◽  
Aphrodite Galata ◽  
Roger Hubbold

Sign in / Sign up

Export Citation Format

Share Document