scholarly journals An Improved Tikhonov-Regularized Variable Projection Algorithm for Separable Nonlinear Least Squares

Axioms ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 196
Author(s):  
Hua Guo ◽  
Guolin Liu ◽  
Luyao Wang

In this work, we investigate the ill-conditioned problem of a separable, nonlinear least squares model by using the variable projection method. Based on the truncated singular value decomposition method and the Tikhonov regularization method, we propose an improved Tikhonov regularization method, which neither discards small singular values, nor treats all singular value corrections. By fitting the Mackey–Glass time series in an exponential model, we compare the three regularization methods, and the numerically simulated results indicate that the improved regularization method is more effective at reducing the mean square error of the solution and increasing the accuracy of unknowns.

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Ke Wang ◽  
Guolin Liu ◽  
Qiuxiang Tao ◽  
Luyao Wang ◽  
Yang Chen

Light detection and ranging (LiDAR) is commonly used to create high-resolution maps; however, the efficiency and convergence of parameter estimation are difficult. To address this issue, we evaluated the structural characteristics of received LiDAR signals by decomposing them into Gaussian functions and applied the variable projection algorithm of the separable nonlinear least-squares problem to the process of waveform fitting. First, using a variable projection algorithm, we separated the linear (amplitude) and nonlinear (center position and width) parameters in the Gaussian function model; the linear parameters are expressed with nonlinear parameters by the function. Thereafter, the optimal estimation of the characteristic parameters of the Gaussian function components was transformed into a least-squares problem only comprising nonlinear parameters. Finally, the Levenberg–Marquardt algorithm was used to solve these nonlinear parameters, whereas the linear parameters were calculated simultaneously in each iteration, and the estimation results satisfying the nonlinear least-square criterion were obtained. Five groups of waveform decomposition simulation data and ICESat/GLAS satellite LiDAR waveform data were used for the parameter estimation experiments. During the experiments, for the same accuracy, the separable nonlinear least-squares optimization method required fewer iterations and lesser calculation time than the traditional method of not separating parameters; the maximum number of iterations was reached before the traditional method converged to the optimal estimate. The method of separating variables only required 14 iterations to obtain the optimal estimate, reducing the computational time from 1128 s to 130 s. Therefore, the application of the separable nonlinear least-squares problem can improve the calculation efficiency and convergence speed of the parameter solution process. It can also provide a new method for parameter estimation in the Gaussian model for LiDAR waveform decomposition.


2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Jiayan Wang ◽  
Lanlan Guo ◽  
Zongmin Li ◽  
Xueqin Wang ◽  
Zhengqing Fu

For separable nonlinear least squares models, a variable projection algorithm based on matrix factorization is studied, and the ill-conditioning of the model parameters is considered in the specific solution process of the model. When the linear parameters are estimated, the Tikhonov regularization method is used to solve the ill-conditioned problems. When the nonlinear parameters are estimated, the QR decomposition, Gram–Schmidt orthogonalization decomposition, and SVD are applied in the Jacobian matrix. These methods are then compared with the method in which the variables are not separated. Numerical experiments are performed using RBF neural network data, and the experimental results are analyzed in terms of both qualitative and quantitative indicators. The results show that the proposed algorithms are effective and robust.


2020 ◽  
Vol 18 (1) ◽  
pp. 1685-1697
Author(s):  
Zhenyu Zhao ◽  
Lei You ◽  
Zehong Meng

Abstract In this paper, a Cauchy problem for the Laplace equation is considered. We develop a modified Tikhonov regularization method based on Hermite expansion to deal with the ill posed-ness of the problem. The regularization parameter is determined by a discrepancy principle. For various smoothness conditions, the solution process of the method is uniform and the convergence rate can be obtained self-adaptively. Numerical tests are also carried out to verify the effectiveness of the method.


Sign in / Sign up

Export Citation Format

Share Document