Incremental Learning of Context Free Grammars by Bridging Rule Generation and Search for Semi-optimum Rule Sets

2006 ◽  
pp. 72-83 ◽  
Author(s):  
Katsuhiko Nakamura
Keyword(s):  
Incremental Learning ◽  
Rule Generation ◽  
Rule Sets ◽  
Context Free ◽  
Context Free Grammars

Incremental learning of context free grammars based on bottom-up parsing and search

2005 ◽  
Vol 38 (9) ◽  
pp. 1384-1392 ◽  
Author(s):  
Katsuhiko Nakamura ◽  
Masashi Matsumoto
Keyword(s):  
Incremental Learning ◽  
Bottom Up ◽  
Context Free ◽  
Context Free Grammars

scholarly journals Synthesizing Context-free Grammars from Recurrent Neural Networks

2021 ◽  
pp. 351-369
Author(s):  
Daniel M. Yellin ◽  
Gail Weiss
Keyword(s):  
Neural Network ◽  
Recurrent Neural Networks ◽  
Regular Language ◽  
Predictive Accuracy ◽  
Finite Automata ◽  
Deterministic Finite Automata ◽  
Rule Sets ◽  
Context Free ◽  
New Framework ◽  
Context Free Grammars

AbstractWe present an algorithm for extracting a subclass of the context free grammars (CFGs) from a trained recurrent neural network (RNN). We develop a new framework, pattern rule sets (PRSs), which describe sequences of deterministic finite automata (DFAs) that approximate a non-regular language. We present an algorithm for recovering the PRS behind a sequence of such automata, and apply it to the sequences of automata extracted from trained RNNs using the $$L^{*}$$ L ∗ algorithm. We then show how the PRS may converted into a CFG, enabling a familiar and useful presentation of the learned language.Extracting the learned language of an RNN is important to facilitate understanding of the RNN and to verify its correctness. Furthermore, the extracted CFG can augment the RNN in classifying correct sentences, as the RNN’s predictive accuracy decreases when the recursion depth and distance between matching delimiters of its input sequences increases.

Lower bounds for context-free grammars

2011 ◽  
Vol 111 (18) ◽  
pp. 895-898 ◽  
Author(s):  
Yuval Filmus
Keyword(s):  
Lower Bounds ◽  
Context Free ◽  
Context Free Grammars
Sign in / Sign up

Export Citation Format

Share Document