scholarly journals A Connection between Clone Theory and FCA Provided by Duality Theory

Author(s):  
Sebastian Kerkhoff
Keyword(s):  
1995 ◽  
Vol 60 (4) ◽  
pp. 1087-1114 ◽  
Author(s):  
B. A. Davey ◽  
M. Haviar ◽  
H. A. Priestley

AbstractBoth syntactic and semantic solutions are given for the entailment problem of duality theory. The test algebra theorem provides both a syntactic solution to the entailment problem in terms of primitive positive formula and a new derivation of the corresponding result in clone theory, viz. the syntactic description of Inv(Pol(R)) for a given set R of unitary relations on a finite set. The semantic solution to the entailment problem follows from the syntactic one, or can be given in the form of an algorithm. It shows, in the special case of a purely relational type, that duality-theoretic entailment is describable in terms of five constructs, namely trivial relations, intersection, repetition removal, product, and retractive projection. All except the last are concrete, in the sense that they are described by a quantifier-free formula. It is proved that if the finite algebra M generates a congruence-distributive variety and all subalgebras of M are subdirectly irreducible, then concrete constructs suffice to describe entailment. The concept of entailment appropriate to strong dualities is also introduced, and described in terms of coordinate projections, restriction of domains, and composition of partial functions.


2021 ◽  
Vol 36 ◽  
Author(s):  
Sergio Valcarcel Macua ◽  
Ian Davies ◽  
Aleksi Tukiainen ◽  
Enrique Munoz de Cote

Abstract We propose a fully distributed actor-critic architecture, named diffusion-distributed-actor-critic Diff-DAC, with application to multitask reinforcement learning (MRL). During the learning process, agents communicate their value and policy parameters to their neighbours, diffusing the information across a network of agents with no need for a central station. Each agent can only access data from its local task, but aims to learn a common policy that performs well for the whole set of tasks. The architecture is scalable, since the computational and communication cost per agent depends on the number of neighbours rather than the overall number of agents. We derive Diff-DAC from duality theory and provide novel insights into the actor-critic framework, showing that it is actually an instance of the dual-ascent method. We prove almost sure convergence of Diff-DAC to a common policy under general assumptions that hold even for deep neural network approximations. For more restrictive assumptions, we also prove that this common policy is a stationary point of an approximation of the original problem. Numerical results on multitask extensions of common continuous control benchmarks demonstrate that Diff-DAC stabilises learning and has a regularising effect that induces higher performance and better generalisation properties than previous architectures.


2019 ◽  
Vol 37 (4) ◽  
pp. 410-453
Author(s):  
Jared Culbertson ◽  
Dan P. Guralnik ◽  
Peter F. Stiller
Keyword(s):  

2005 ◽  
Vol 23 (3/2005) ◽  
Author(s):  
Alexander Schied ◽  
Ching-Tang Wu

Sign in / Sign up

Export Citation Format

Share Document