scholarly journals Autonomous Reusing Policy Selection using Spreading Activation Model in Deep Reinforcement Learning

Author(s):  
Yusaku Takakuwa ◽  
Hitoshi Kono ◽  
Hiromitsu Fujii ◽  
Wen Wen ◽  
Tsuyoshi Suzuki
Author(s):  
Yusaku TAKAKUWA ◽  
Hitoshi KONO ◽  
Wen WEN ◽  
Akiya KAMIMURA ◽  
Kohji TOMITA ◽  
...  

2021 ◽  
Vol 15 ◽  
Author(s):  
Emery Schubert

Creativity is commonly defined as a process that leads to a novel and useful outcome (an idea, product, or expression). However, two dilemmas about this definition remain unresolved: (1) A strict application of usefulness is difficult to apply to artistic works: who decides what artwork is useful, and how it is useful? (2) The implied boundary conditions of novelty are problematic: The default perspective is that novelty has a monotonic increasing relationship with creativity, or it is categorical—i.e., novel or not. To address these dilemmas, this paper proposes a spreading activation model of creativity (SAMOC), a model built on a brain-architecture-inspired vast interconnected network of nodes, each node representing information, and assigned meanings through interaction with the environment. Nodes are linked to each other according to principles of temporal contiguity (linking objects/events in time) and similarity (linking objects/events by shared features). A node activated by attention spreads through the network through previously linked nodes. Nodes that are well connected activate each other easily, while those that are weakly connected do not. Net total activation corresponds to positive affect (e.g., pleasure), and this is proposed as an essential criteria for a creative work of art, instead of usefulness. SAMOC also predicts that creativity will be optimized at an intermediate, not extreme, level of novelty. Too much activation will occur with the activation of preexisting ideas (hence reproduction rather than creativity), and too much novelty will not produce spread of activation. The two functions (spreading activation and the novelty curve) are superposed to demonstrate this optimal novelty hypothesis. Early evidence of the hypothesis comes from the data that some great works of art were critically rejected at premiers (suggesting excessive novelty), but after sufficient repetition (and therefore linking) became suitably associated and commenced generating activation. The hypothesis has important implications for future empirical research programs on creativity, and for the definition of creativity itself.


2009 ◽  
Vol 29 (1) ◽  
pp. 155-157
Author(s):  
Tao HAN ◽  
Jin-min YANG ◽  
Da-fang ZHANG ◽  
Yin LI

Systems ◽  
2021 ◽  
Vol 9 (2) ◽  
pp. 22
Author(s):  
Ismo T. Koponen

Associative knowledge networks are often explored by using the so-called spreading activation model to find their key items and their rankings. The spreading activation model is based on the idea of diffusion- or random walk -like spreading of activation in the network. Here, we propose a generalisation, which relaxes an assumption of simple Brownian-like random walk (or equally, ordinary diffusion process) and takes into account nonlocal jump processes, typical for superdiffusive processes, by using fractional graph Laplacian. In addition, the model allows a nonlinearity of the diffusion process. These generalizations provide a dynamic equation that is analogous to fractional porous medium diffusion equation in a continuum case. A solution of the generalized equation is obtained in the form of a recently proposed q-generalized matrix transformation, the so-called q-adjacency kernel, which can be adopted as a systemic state describing spreading activation. Based on the systemic state, a new centrality measure called activity centrality is introduced for ranking the importance of items (nodes) in spreading activation. To demonstrate the viability of analysis based on systemic states, we use empirical data from a recently reported case of a university students’ associative knowledge network about the history of science. It is shown that, while a choice of model does not alter rankings of the items with the highest rank, rankings of nodes with lower ranks depend essentially on the diffusion model.


Sign in / Sign up

Export Citation Format

Share Document