scholarly journals AsymDPOP: Complete Inference for Asymmetric Distributed Constraint Optimization Problems

2019 ◽  
Author(s):  
Yanchen Deng ◽  
Ziyu Chen ◽  
Dingding Chen ◽  
Wenxin Zhang ◽  
Xingqiong Jiang
Keyword(s):  
Optimization Problems ◽  
State Of The Art ◽  
Empirical Evaluation ◽  
The State ◽  
Constraint Optimization ◽  
Memory Consumption ◽  
Distributed Constraint Optimization ◽  
Constraint Optimization Problems

Asymmetric distributed constraint optimization problems (ADCOPs) are an emerging model for coordinating agents with personal preferences. However, the existing inference-based complete algorithms which use local eliminations cannot be applied to ADCOPs, as the parent agents are required to transfer their private functions to their children. Rather than disclosing private functions explicitly to facilitate local eliminations, we solve the problem by enforcing delayed eliminations and propose AsymDPOP, the first inference-based complete algorithm for ADCOPs. To solve the severe scalability problems incurred by delayed eliminations, we propose to reduce the memory consumption by propagating a set of smaller utility tables instead of a joint utility table, and to reduce the computation efforts by sequential optimizations instead of joint optimizations. The empirical evaluation indicates that AsymDPOP significantly outperforms the state-of-the-art, as well as the vanilla DPOP with PEAV formulation.

scholarly journals Solving Highly Cyclic Distributed Optimization Problems Without Busting the Bank: A Decimation-based Approach

2020 ◽  
Author(s):  
Jesús Cerquides ◽  
Juan Antonio Rodríguez-Aguilar ◽  
Rémi Emonet ◽  
Gauthier Picard
Keyword(s):  
Belief Propagation ◽  
Optimization Problems ◽  
State Of The Art ◽  
Empirical Evaluation ◽  
The Novel ◽  
Constraint Optimization ◽  
Distributed Constraint Optimization ◽  
Inference Algorithms ◽  
Solution Methods ◽  
Constraint Optimization Problems

Abstract In the context of solving large distributed constraint optimization problems, belief-propagation and incomplete inference algorithms are candidates of choice. However, in general, when the problem structure is very cyclic, these solution methods suffer from bad performance, due to non-convergence and many exchanged messages. As to improve performances of the MaxSum inference algorithm when solving cyclic constraint optimization problems, we propose here to take inspiration from the belief-propagation-guided decimation used to solve sparse random graphs ($k$-satisfiability). We propose the novel DeciMaxSum method, which is parameterized in terms of policies to decide when to trigger decimation, which variables to decimate and which values to assign to decimated variables. Based on an empirical evaluation on a classical constraint optimization benchmarks (graph coloring, random graph and Ising model), some of these combinations of policies, using periodic decimation, cycle detection-based decimation, parallel and non parallel decimation, random or deterministic variable selection and deterministic or random sampling for value selection, outperform state-of-the-art competitors in many settings.

scholarly journals A Particle Swarm Based Algorithm for Functional Distributed Constraint Optimization Problems

2020 ◽  
Vol 34 (05) ◽  
pp. 7111-7118
Author(s):  
Moumita Choudhury ◽  
Saaduddin Mahmud ◽  
Md. Mosaddek Khan
Keyword(s):  
Optimization Problems ◽  
State Of The Art ◽  
Particle Swarm ◽  
Continuous Optimization ◽  
Continuous Variables ◽  
Constraint Optimization ◽  
Solution Quality ◽  
Distributed Constraint Optimization ◽  
Continuous Optimization Problems ◽  
Constraint Optimization Problems

Distributed Constraint Optimization Problems (DCOPs) are a widely studied constraint handling framework. The objective of a DCOP algorithm is to optimize a global objective function that can be described as the aggregation of several distributed constraint cost functions. In a DCOP, each of these functions is defined by a set of discrete variables. However, in many applications, such as target tracking or sleep scheduling in sensor networks, continuous valued variables are more suited than the discrete ones. Considering this, Functional DCOPs (F-DCOPs) have been proposed that can explicitly model a problem containing continuous variables. Nevertheless, state-of-the-art F-DCOPs approaches experience onerous memory or computation overhead. To address this issue, we propose a new F-DCOP algorithm, namely Particle Swarm based F-DCOP (PFD), which is inspired by a meta-heuristic, Particle Swarm Optimization (PSO). Although it has been successfully applied to many continuous optimization problems, the potential of PSO has not been utilized in F-DCOPs. To be exact, PFD devises a distributed method of solution construction while significantly reducing the computation and memory requirements. Moreover, we theoretically prove that PFD is an anytime algorithm. Finally, our empirical results indicate that PFD outperforms the state-of-the-art approaches in terms of solution quality and computation overhead.

scholarly journals HS-CAI: A Hybrid DCOP Algorithm via Combining Search with Context-Based Inference

2020 ◽  
Vol 34 (05) ◽  
pp. 7087-7094
Author(s):  
Dingding Chen ◽  
Yanchen Deng ◽  
Ziyu Chen ◽  
Wenxing Zhang ◽  
Zhongshi He
Keyword(s):  
Lower Bounds ◽  
Optimization Problems ◽  
State Of The Art ◽  
Search Process ◽  
Constraint Optimization ◽  
Distributed Constraint Optimization ◽  
Limited Memory ◽  
Inference Algorithms ◽  
Evaluation Mechanism ◽  
Constraint Optimization Problems

Search and inference are two main strategies for optimally solving Distributed Constraint Optimization Problems (DCOPs). Recently, several algorithms were proposed to combine their advantages. Unfortunately, such algorithms only use an approximated inference as a one-shot preprocessing phase to construct the initial lower bounds which lead to inefficient pruning under the limited memory budget. On the other hand, iterative inference algorithms (e.g., MB-DPOP) perform a context-based complete inference for all possible contexts but suffer from tremendous traffic overheads. In this paper, (i) hybridizing search with context-based inference, we propose a complete algorithm for DCOPs, named HS-CAI where the inference utilizes the contexts derived from the search process to establish tight lower bounds while the search uses such bounds for efficient pruning and thereby reduces contexts for the inference. Furthermore, (ii) we introduce a context evaluation mechanism to select the context patterns for the inference to further reduce the overheads incurred by iterative inferences. Finally, (iii) we prove the correctness of our algorithm and the experimental results demonstrate its superiority over the state-of-the-art.

scholarly journals Beyond Trees: Analysis and Convergence of Belief Propagation in Graphs with Multiple Cycles

2020 ◽  
Vol 34 (05) ◽  
pp. 7333-7340
Author(s):  
Roie Zivan ◽  
Omer Lev ◽  
Rotem Galiki
Keyword(s):  
Graphical Models ◽  
Belief Propagation ◽  
Optimization Problems ◽  
Optimal Solution ◽  
Damping Factor ◽  
Constraint Optimization ◽  
Single Cycle ◽  
Distributed Constraint Optimization ◽  
Multiple Cycles ◽  
Constraint Optimization Problems

Belief propagation, an algorithm for solving problems represented by graphical models, has long been known to converge to the optimal solution when the graph is a tree. When the graph representing the problem includes a single cycle, the algorithm either converges to the optimal solution or performs periodic oscillations. While the conditions that trigger these two behaviors have been established, the question regarding the convergence and divergence of the algorithm on graphs that include more than one cycle is still open.Focusing on Max-sum, the version of belief propagation for solving distributed constraint optimization problems (DCOPs), we extend the theory on the behavior of belief propagation in general – and Max-sum specifically – when solving problems represented by graphs with multiple cycles. This includes: 1) Generalizing the results obtained for graphs with a single cycle to graphs with multiple cycles, by using backtrack cost trees (BCT). 2) Proving that when the algorithm is applied to adjacent symmetric cycles, the use of a large enough damping factor guarantees convergence to the optimal solution.

scholarly journals Multi-Context System for Optimization Problems

2019 ◽  
Vol 33 ◽  
pp. 2929-2937
Author(s):  
Tiep Le ◽  
Tran Cao Son ◽  
Enrico Pontelli
Keyword(s):  
Complexity Analysis ◽  
Optimization Problems ◽  
Distributed Optimization ◽  
Multi Agent System ◽  
Constraint Optimization ◽  
Agent System ◽  
Distributed Constraint Optimization ◽  
Multi Agent ◽  
Definition Of ◽  
Constraint Optimization Problems

This paper proposes Multi-context System for Optimization Problems (MCS-OP) by introducing conditional costassignment bridge rules to Multi-context Systems (MCS). This novel feature facilitates the definition of a preorder among equilibria, based on the total incurred cost of applied bridge rules. As an application of MCS-OP, the paper describes how MCS-OP can be used in modeling Distributed Constraint Optimization Problems (DCOP), a prominent class of distributed optimization problems that is frequently employed in multi-agent system (MAS) research. The paper shows, by means of an example, that MCS-OP is more expressive than DCOP, and hence, could potentially be useful in modeling distributed optimization problems which cannot be easily dealt with using DCOPs. It also contains a complexity analysis of MCS-OP.

scholarly journals Distributed Constraint Optimization Problems and Applications: A Survey

2018 ◽  
Vol 61 ◽  
pp. 623-698 ◽  
Author(s):  
Ferdinando Fioretto ◽  
Enrico Pontelli ◽  
William Yeoh
Keyword(s):  
Autonomous Agents ◽  
Optimization Problems ◽  
Constraint Optimization ◽  
Uncertain Environments ◽  
Distributed Constraint Optimization ◽  
Agent Model ◽  
Autonomous Behavior ◽  
Multi Agent ◽  
Constraint Optimization Problems

The field of multi-agent system (MAS) is an active area of research within artificial intelligence, with an increasingly important impact in industrial and other real-world applications. In a MAS, autonomous agents interact to pursue personal interests and/or to achieve common objectives. Distributed Constraint Optimization Problems (DCOPs) have emerged as a prominent agent model to govern the agents' autonomous behavior, where both algorithms and communication models are driven by the structure of the specific problem. During the last decade, several extensions to the DCOP model have been proposed to enable support of MAS in complex, real-time, and uncertain environments. This survey provides an overview of the DCOP model, offering a classification of its multiple extensions and addressing both resolution methods and applications that find a natural mapping within each class of DCOPs. The proposed classification suggests several future perspectives for DCOP extensions and identifies challenges in the design of efficient resolution algorithms, possibly through the adaptation of strategies from different areas.

Sign in / Sign up

Export Citation Format

Share Document