Neural networks of data inhibiting long memory pattern

1998 ◽  
Vol 35 (3-4) ◽  
pp. 551-554
Author(s):  
Masood A. Badri ◽  
Ahmed Al-Mutawa ◽  
Amr Murtagy
Keyword(s):  
Neural Networks ◽  
Long Memory ◽  
Memory Pattern

Memory pattern analysis of cellular neural networks

2005 ◽  
Vol 342 (1-2) ◽  
pp. 114-128 ◽  
Author(s):  
Zhigang Zeng ◽  
De-Shuang Huang ◽  
Zengfu Wang
Keyword(s):  
Neural Networks ◽  
Pattern Analysis ◽  
Cellular Neural Networks ◽  
Memory Pattern

MEMORY PATTERN ANALYSIS OF BAM NEURAL NETWORKS WITH TIME-DELAY

2009 ◽  
Vol 19 (03) ◽  
pp. 843-856 ◽  
Author(s):  
YUNQUAN KE ◽  
CHUN-FANG MIAO
Keyword(s):  
Neural Networks ◽  
Time Delay ◽  
Pattern Analysis ◽  
Synaptic Connection ◽  
Sufficient Conditions ◽  
External Input ◽  
Bam Neural Networks ◽  
Bidirectional Associative Memory ◽  
Exponentially Stable ◽  
Memory Pattern

In this paper, memory patterns of bidirectional associative memory (BAM) neural networks with time-delay are investigated based on stability theory. Several sufficient conditions are obtained such that the equilibrium point is locally exponentially stable when the point is located at the designated position. These conditions, which can be directly derived from the synaptic connection weights and the external input of the BAM neural networks, are very easy to be verified. In addition, three examples are given to show the effectiveness of the results.

scholarly journals Time Trends and Persistence in the Snowpack Percentages by Watershed in Colorado

2021 ◽  
Author(s):  
Luis Alberiko Gil-Alana
Keyword(s):  
Long Memory ◽  
Time Trends ◽  
Time Trend ◽  
Significant Decline ◽  
Long Range Dependence ◽  
Annual Data ◽  
Long Memory Processes ◽  
Negative Time ◽  
Memory Pattern ◽  
Over Time

In this paper we investigate the time trend coefficients in snowpack percentages by watershed in Colorado, US, allowing for the possibility of long range dependence or long memory processes. Nine series corresponding to the following watersheds are examined: Arkansas, Colorado, Gunnison, North Platte, Rio Grande, South Platte, San Juan-Animas-Dolores-San Miguel, Yampa & White and Colorado Statewide, based on annual data over the last eighty years. The longest series start in 1937 and all end in 2019. The results indicate that most of the series display a significant decline over time, showing negative time trend coefficients, and thus supporting the hypothesis of climate change and global warming. Nevertheless, there is no evidence of a long memory pattern in the data.

scholarly journals Evaluating Computational Language Models with Scaling Properties of Natural Language

2019 ◽  
Vol 45 (3) ◽  
pp. 481-513
Author(s):  
Shuntaro Takahashi ◽  
Kumiko Tanaka-Ishii
Keyword(s):  
Neural Networks ◽  
Natural Language ◽  
Recurrent Neural Networks ◽  
Long Memory ◽  
Computational Models ◽  
Language Models ◽  
Generative Adversarial Networks ◽  
Scaling Properties ◽  
Gating Mechanism ◽  
Taylor’S Law

In this article, we evaluate computational models of natural language with respect to the universal statistical behaviors of natural language. Statistical mechanical analyses have revealed that natural language text is characterized by scaling properties, which quantify the global structure in the vocabulary population and the long memory of a text. We study whether five scaling properties (given by Zipf’s law, Heaps’ law, Ebeling’s method, Taylor’s law, and long-range correlation analysis) can serve for evaluation of computational models. Specifically, we test n-gram language models, a probabilistic context-free grammar, language models based on Simon/Pitman-Yor processes, neural language models, and generative adversarial networks for text generation. Our analysis reveals that language models based on recurrent neural networks with a gating mechanism (i.e., long short-term memory; a gated recurrent unit; and quasi-recurrent neural networks) are the only computational models that can reproduce the long memory behavior of natural language. Furthermore, through comparison with recently proposed model-based evaluation methods, we find that the exponent of Taylor’s law is a good indicator of model quality.

Sign in / Sign up

Export Citation Format

Share Document