scholarly journals On convergence and complexity analysis of an accelerated forward–backward algorithm with linesearch technique for convex minimization problems and applications to data prediction and classification

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Panitarn Sarnmeta ◽  
Warunun Inthakon ◽  
Dawan Chumpungam ◽  
Suthep Suantai

AbstractIn this work, we introduce a new accelerated algorithm using a linesearch technique for solving convex minimization problems in the form of a summation of two lower semicontinuous convex functions. A weak convergence of the proposed algorithm is given without assuming the Lipschitz continuity on the gradient of the objective function. Moreover, the convexity of this algorithm is also analyzed. Some numerical experiments in machine learning are also discussed, namely regression and classification problems. Furthermore, in our experiments, we evaluate the convergent behavior of this new algorithm, then compare it with various algorithms mentioned in the literature. It is found that our algorithm performs better than the others.

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Suthep Suantai ◽  
Muhammad Aslam Noor ◽  
Kunrada Kankam ◽  
Prasit Cholamjiak

AbstractThe forward–backward algorithm is a splitting method for solving convex minimization problems of the sum of two objective functions. It has a great attention in optimization due to its broad application to many disciplines, such as image and signal processing, optimal control, regression, and classification problems. In this work, we aim to introduce new forward–backward algorithms for solving both unconstrained and constrained convex minimization problems by using linesearch technique. We discuss the convergence under mild conditions that do not depend on the Lipschitz continuity assumption of the gradient. Finally, we provide some applications to solving compressive sensing and image inpainting problems. Numerical results show that the proposed algorithm is more efficient than some algorithms in the literature. We also discuss the optimal choice of parameters in algorithms via numerical experiments.


2020 ◽  
Vol 269 (12) ◽  
pp. 10717-10757 ◽  
Author(s):  
Radu Ioan Boţ ◽  
Ernö Robert Csetnek ◽  
Szilárd Csaba László

Sign in / Sign up

Export Citation Format

Share Document