Minimum ℓ1, ℓ2, and ℓ∞ Norm Approximate Solutions to an Overdetermined System of Linear Equations

2002 ◽  
Vol 12 (4) ◽  
pp. 524-560 ◽  
Author(s):  
James A. Cadzow
Author(s):  
David Ek ◽  
Anders Forsgren

AbstractThe focus in this paper is interior-point methods for bound-constrained nonlinear optimization, where the system of nonlinear equations that arise are solved with Newton’s method. There is a trade-off between solving Newton systems directly, which give high quality solutions, and solving many approximate Newton systems which are computationally less expensive but give lower quality solutions. We propose partial and full approximate solutions to the Newton systems. The specific approximate solution depends on estimates of the active and inactive constraints at the solution. These sets are at each iteration estimated by basic heuristics. The partial approximate solutions are computationally inexpensive, whereas a system of linear equations needs to be solved for the full approximate solution. The size of the system is determined by the estimate of the inactive constraints at the solution. In addition, we motivate and suggest two Newton-like approaches which are based on an intermediate step that consists of the partial approximate solutions. The theoretical setting is introduced and asymptotic error bounds are given. We also give numerical results to investigate the performance of the approximate solutions within and beyond the theoretical framework.


Author(s):  
Jack-Kang Chan

We show that the well-known least squares (LS) solution of an overdetermined system of linear equations is a convex combination of all the non-trivial solutions weighed by the squares of the corresponding denominator determinants of the Cramer's rule. This Least Squares Decomposition (LSD) gives an alternate statistical interpretation of least squares, as well as another geometric meaning. Furthermore, when the singular values of the matrix of the overdetermined system are not small, the LSD may be able to provide flexible solutions. As an illustration, we apply the LSD to interpret the LS-solution in the problem of source localization.


2019 ◽  
Vol 1 (1) ◽  
pp. 19-30
Author(s):  
Bijan Bidabad

In this paper, three algorithms for weighted median, simple linear, and multiple m parameters L1 norm regressions are introduced. The corresponding computer programs are also included.   


2019 ◽  
Vol 12 (4) ◽  
pp. 1360-1370
Author(s):  
Vedran Novoselac ◽  
Zlatko Pavic

The paper considers the solution properties of an overdetermined system of linear equations in a given norm. The problem is observed as a minimization of the corresponding functional of the errors. Presenting the main results of $p$ norm it is shown that the functional is convex. Following the convex properties we examine minimization properties showing that the problem possesses regression, scale, and affine equivariant properties. As an example we illustrated the problem of finding weighted mean and weighted median of the data.


1957 ◽  
Vol 4 (3) ◽  
pp. 341-347 ◽  
Author(s):  
Allen A. Goldstein ◽  
Norman Levine ◽  
James B. Hereshoff

1968 ◽  
Vol 35 (2) ◽  
pp. 279-284 ◽  
Author(s):  
C. F. Wang

Methods of solving an integral equation that represents the elastic contact of a strip pressed between two identical cylinders are discussed. Fourier cosine transformation is used to derive the integral equation of the contact problem, and approximation kernels are used to obtain the solutions for the cases of thick and thin layers. The solutions for both cases are given as a truncated series of the weighted Tchebyshev polynomials of the first kind, whose coefficients are determined from a system of linear equations. The problem of two circular cylinders pressing on a strip is given as an example. The nature of two approximate solutions are also briefly discussed.


Sign in / Sign up

Export Citation Format

Share Document