A Symmetric Alternating Direction Method of Multipliers for Separable Nonconvex Minimization Problems

2017 ◽  
Vol 34 (06) ◽  
pp. 1750030 ◽  
Author(s):  
Zhongming Wu ◽  
Min Li ◽  
David Z. W. Wang ◽  
Deren Han

In this paper, we propose a symmetric alternating method of multipliers for minimizing the sum of two nonconvex functions with linear constraints, which contains the classic alternating direction method of multipliers in the algorithm framework. Based on the powerful Kurdyka–Łojasiewicz property, and under some assumptions about the penalty parameter and objective function, we prove that each bounded sequence generated by the proposed method globally converges to a critical point of the augmented Lagrangian function associated with the given problem. Moreover, we report some preliminary numerical results on solving [Formula: see text] regularized sparsity optimization and nonconvex feasibility problems to indicate the feasibility and effectiveness of the proposed method.

Author(s):  
Ning Quan ◽  
Harrison Kim

The Alternating Direction Method of Multipliers (ADMM) is a distributed algorithm suitable for quasi-separable problems in Multi-disciplinary Design Optimization. Previous authors have studied the convergence and complexity of the ADMM algorithm by treating it as an instance of the proximal point algorithm. In this paper, those previous results are extended to an alternate form of the ADMM algorithm applied to the quasi-separable problem. Secondly, a dynamic penalty parameter updating heuristic for the ADMM algorithm is introduced and compared against a previously proposed updating heuristic. The proposed updating heuristic was tested on a distributed linear model fitting example and performed favorably against the other heuristic and the fixed penalty parameter scheme.


2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Miantao Chao ◽  
Yongxin Zhao ◽  
Dongying Liang

In this paper, we considers the separable convex programming problem with linear constraints. Its objective function is the sum of m individual blocks with nonoverlapping variables and each block consists of two functions: one is smooth convex and the other one is convex. For the general case m≥3, we present a gradient-based alternating direction method of multipliers with a substitution. For the proposed algorithm, we prove its convergence via the analytic framework of contractive-type methods and derive a worst-case O1/t convergence rate in nonergodic sense. Finally, some preliminary numerical results are reported to support the efficiency of the proposed algorithm.


Sign in / Sign up

Export Citation Format

Share Document