Adaptive Global Algorithm for Solving Box-Constrained Non-convex Quadratic Minimization Problems

Author(s):  
Amar Andjouh ◽  
Mohand Ouamer Bibi
2012 ◽  
Vol 60 (3) ◽  
pp. 481-489 ◽  
Author(s):  
J.M. Łęski ◽  
N. Henzel

Abstract Linear regression analysis has become a fundamental tool in experimental sciences. We propose a new method for parameter estimation in linear models. The ’Generalized Ordered Linear Regression with Regularization’ (GOLRR) uses various loss functions (including the ǫ-insensitive ones), ordered weighted averaging of the residuals, and regularization. The algorithm consists in solving a sequence of weighted quadratic minimization problems where the weights used for the next iteration depend not only on the values but also on the order of the model residuals obtained for the current iteration. Such regression problem may be transformed into the iterative reweighted least squares scenario. The conjugate gradient algorithm is used to minimize the proposed criterion function. Finally, numerical examples are given to demonstrate the validity of the method proposed.


2018 ◽  
Vol 61 (1) ◽  
pp. 76-98 ◽  
Author(s):  
TING LI ◽  
ZHONG WAN

We propose a new adaptive and composite Barzilai–Borwein (BB) step size by integrating the advantages of such existing step sizes. Particularly, the proposed step size is an optimal weighted mean of two classical BB step sizes and the weights are updated at each iteration in accordance with the quality of the classical BB step sizes. Combined with the steepest descent direction, the adaptive and composite BB step size is incorporated into the development of an algorithm such that it is efficient to solve large-scale optimization problems. We prove that the developed algorithm is globally convergent and it R-linearly converges when applied to solve strictly convex quadratic minimization problems. Compared with the state-of-the-art algorithms available in the literature, the proposed step size is more efficient in solving ill-posed or large-scale benchmark test problems.


1995 ◽  
Vol 5 (1) ◽  
pp. 57-74 ◽  
Author(s):  
Ana Friedlander ◽  
José Mario Martínez ◽  
Marcos Raydon

2017 ◽  
Vol 27 (2) ◽  
pp. 219-225
Author(s):  
Sudipta Roy ◽  
Sandip Chatterjee ◽  
R.N. Mukherjee

In this paper the duality and optimality of a class of constrained convex quadratic optimization problems have been studied. Furthermore, the global optimality condition of a class of interval quadratic minimization problems has also been discussed.


Author(s):  
А.А. Дряженков

Предложен алгоритм численного решения задачи квадратичной минимизации на эллипсоиде, заданном в гильбертовом пространстве компактным оператором. Алгоритм представляет собой определенную трансформацию обобщенного метода невязки, предназначенную для применения в неклассических информационных условиях, когда априорная информация об уровне погрешности в операторе, задающем функционал, доступна лишь в нормах, ослабленных по сравнению с исходными. При этом сходимость алгоритма устанавливается в исходных нормах. Приводятся простейшие вычислительные иллюстрации. An algorithm is proposed for the numerical solution of a quadratic minimization problem on an ellipsoid specified in the Hilbert space by a compact operator. This algorithm is a certain transform of the generalized residual method designed previously for the application in nonclassical information conditions when {\it a priori} information on the error level in an operator defining the cost functional is available only in the norms being weaker than the original ones. At the same time, the convergence of the algorithm is proved in the original norms. A number of simple numerical examples are discussed.


Sign in / Sign up

Export Citation Format

Share Document