EXPRESS: Baseline Correction Based on a Search Algorithm from Artificial Intelligence

2020 ◽  
pp. 000370282097751
Author(s):  
Xin Wang ◽  
Xia Chen

Many spectra have a polynomial-like baseline. Iterative polynomial fitting (IPF) is one of the most popular methods for baseline correction of these spectra. However, the baseline estimated by IPF may have substantially error when the spectrum contains significantly strong peaks or have strong peaks located at the endpoints. First, IPF uses temporary baseline estimated from the current spectrum to identify peak data points. If the current spectrum contains strong peaks, then the temporary baseline substantially deviates from the true baseline. Some good baseline data points of the spectrum might be mistakenly identified as peak data points and are artificially re-assigned with a low value. Second, if a strong peak is located at the endpoint of the spectrum, then the endpoint region of the estimated baseline might have significant error due to overfitting. This study proposes a search algorithm-based baseline correction method (SA) that aims to compress sample the raw spectrum to a dataset with small number of data points and then convert the peak removal process into solving a search problem in artificial intelligence (AI) to minimize an objective function by deleting peak data points. First, the raw spectrum is smoothened out by the moving average method to reduce noise and then divided into dozens of unequally spaced sections on the basis of Chebyshev nodes. Finally, the minimal points of each section are collected to form a dataset for peak removal through search algorithm. SA selects the mean absolute error (MAE) as the objective function because of its sensitivity to overfitting and rapid calculation. The baseline correction performance of SA is compared with those of three baseline correction methods: Lieber and Mahadevan–Jansen method, adaptive iteratively reweighted penalized least squares method, and improved asymmetric least squares method. Simulated and real FTIR and Raman spectra with polynomial-like baselines are employed in the experiments. Results show that for these spectra, the baseline estimated by SA has fewer error than those by the three other methods.

1979 ◽  
Vol 25 (3) ◽  
pp. 432-438 ◽  
Author(s):  
P J Cornbleet ◽  
N Gochman

Abstract The least-squares method is frequently used to calculate the slope and intercept of the best line through a set of data points. However, least-squares regression slopes and intercepts may be incorrect if the underlying assumptions of the least-squares model are not met. Two factors in particular that may result in incorrect least-squares regression coefficients are: (a) imprecision in the measurement of the independent (x-axis) variable and (b) inclusion of outliers in the data analysis. We compared the methods of Deming, Mandel, and Bartlett in estimating the known slope of a regression line when the independent variable is measured with imprecision, and found the method of Deming to be the most useful. Significant error in the least-squares slope estimation occurs when the ratio of the standard deviation of measurement of a single x value to the standard deviation of the x-data set exceeds 0.2. Errors in the least-squares coefficients attributable to outliers can be avoided by eliminating data points whose vertical distance from the regression line exceed four times the standard error the estimate.


2014 ◽  
Vol 3 (2) ◽  
pp. 174
Author(s):  
Yaser Abdelhadi

Linear transformations are performed for selected exponential engineering functions. The Optimum values of parameters of the linear model equation that fits the set of experimental or simulated data points are determined by the linear least squares method. The classical and matrix forms of ordinary least squares are illustrated. Keywords: Exponential Functions; Linear Modeling; Ordinary Least Squares; Parametric Estimation; Regression Steps.


Author(s):  
Yuriy Mihailovich Andrjejev

The well-known problem of calibration of an arbitrary robotic manipulator, which is formulated in the most general form, is considered. To solve the direct problem of kinematics, an alternative to the Denavit-Hartenberg method, a universal analytical description of the kinematic scheme, taking into account possible errors in the manufacture and assembly of robot parts, is proposed. At the same time, a universal description of the errors in the orientation of the axes of the articulated joints of the links is proposed. On the basis of such a description, the direct and inverse problem of kinematics of robots as spatial mechanisms can be solved, taking into account the distortions of dimensions, the position of the axes of the joints and the positions of the zeros of the angles of their rotation. The problem of calibration of manipulators is formulated as a problem of the least squares method. Analytical formulas of the objective function of the least squares method for solving the problem are obtained. Expressions for the gradient vector and the Hessian of the objective function for the direct algorithm, Newton-Gauss and Levenberg-Marquardt algorithms are obtained by analytical differentiation using a special computer algebra system KiDyM. The procedures in the C ++ language for calculating the elements of the gradient and hessian are automatically generated. On the example of a projected angular 6-degree robot-manipulator, the results of modeling the solution to the problem of its calibration, that is, determination of 36 unknown angular and linear errors, are presented. A comparison is made of the solution of the calibration problem for simulated 64 and 729 experiments, in which the generalized coordinates - the angles in the joints took the values ±90° and -90°, 0, +90°.


Sensors ◽  
2020 ◽  
Vol 20 (7) ◽  
pp. 2015
Author(s):  
Feng Zhang ◽  
Xiaojun Tang ◽  
Angxin Tong ◽  
Bin Wang ◽  
Jingwei Wang

Baseline drift spectra are used for quantitative and qualitative analysis, which can easily lead to inaccurate or even wrong results. Although there are several baseline correction methods based on penalized least squares, they all have one or more parameters that must be optimized by users. For this purpose, an automatic baseline correction method based on penalized least squares is proposed in this paper. The algorithm first linearly expands the ends of the spectrum signal, and a Gaussian peak is added to the expanded range. Then, the whole spectrum is corrected by the adaptive smoothness parameter penalized least squares (asPLS) method, that is, by turning the smoothing parameter λ of asPLS to obtain a different root-mean-square error (RMSE) in the extended range, the optimal λ is selected with minimal RMSE. Finally, the baseline of the original signal is well estimated by asPLS with the optimal λ. The paper concludes with the experimental results on the simulated spectra and measured infrared spectra, demonstrating that the proposed method can automatically deal with different types of baseline drift.


2020 ◽  
Vol 53 (3) ◽  
pp. 222-233 ◽  
Author(s):  
Feng Zhang ◽  
Xiaojun Tang ◽  
Angxin Tong ◽  
Bin Wang ◽  
Jingwei Wang ◽  
...  

Author(s):  
Sam Anand ◽  
Sridhar Jaganathan ◽  
Sampath Damodarasamy

Abstract This paper presents a new and accurate algorithm for assessing circularity tolerance from a set of data points obtained from a Coordinate Measuring Machine (CMM). This method, called Selective Zone Search algorithm, divides the workspace into small sectors called search zones and searches for the extreme points in these zones. These extreme points are used to draw a pair of concentric circles with minimum radial separation. The radial difference gives the circularity. The methodology has been tested with several example data sets and the results have been compared with the Least Squares method, Minimum Spanning Circle method and the Voronoi Diagram method.


2020 ◽  
pp. 004051752097700
Author(s):  
Zehai Gao ◽  
Yan Zhang ◽  
Shisheng Zhou ◽  
Wei Lyu

Spot color is widely applied to printing and packing in modern industry, which can satisfy the individualization requirements and express the emotion of products. Color prediction is the core technique for spot color restoration. In this paper, a method that combines the least squares method and gravitation search algorithm is proposed to address the color prediction by using the absorption spectrum. Firstly, the spectral transmittance of the thin film with high transmission and low reflectance characteristics is researched to find the absorbance. Secondly, the least squares method is used to ascertain the primary colors of the spot color. Thirdly, an enhanced quantum gravitation search algorithm is designed to predict the spot color. The predicted results on the 30 spot colors show that the proposed method has higher accuracy in comparison with the three existed methods. The color differences between the prepared spot colors and the reproduced spot colors are all less than 3, in which 75% of the color differences are less 1 and 35% of the color differences are less 0.1. All the results confirm that the proposed method can predict the spot color accurately.


2021 ◽  
Author(s):  
Qingxian Zhang ◽  
Hui Li ◽  
Hongfei Xiao ◽  
Jian Zhang ◽  
Xiaozhe Li ◽  
...  

Baseline correction is an important step in energy-dispersive X-ray fluorescence analysis. The asymmetric least squares method (AsLS), adaptive iteratively reweighted penalized least squares method (airPLS), and asymmetrically reweighted penalized least...


2014 ◽  
Vol 6 (12) ◽  
pp. 4402-4407 ◽  
Author(s):  
Shixuan He ◽  
Wei Zhang ◽  
Lijuan Liu ◽  
Yu Huang ◽  
Jiming He ◽  
...  

The proposed IAsLS method is successfully applied to practical Raman spectral baseline correction.


Geophysics ◽  
2020 ◽  
Vol 85 (4) ◽  
pp. S217-S232
Author(s):  
Milad Farshad ◽  
Hervé Chauris

For quantitative seismic imaging, iterative least-squares reverse time migration is the recommended approach. The existence of an inverse of the forward modeling operator would considerably reduce the number of required iterations. In the context of the extended model, such a pseudoinverse does exist and is built as a weighted version of the adjoint that accounts for the deconvolution, geometric spreading, and uneven illumination. The application of the pseudoinverse Born modeling is based on constant-density acoustic media, which is a limiting factor for practical applications. To consider density perturbations, we have adopted and investigated two approaches. The first one is a generalization of a recent study proposing to recover acoustic perturbations from the angle-dependent response of the pseudoinverse Born modeling operator. This new version is based on the weighted least-squares objective function. The method not only provides more robust results, but it also offers the flexibility to include constraints in the objective function to reduce the parameters’ crosstalk. We also propose an alternative approach based on Taylor expansion that does not require any Radon transform. Numerical examples based on a simple model and the Marmousi2 models using correct and incorrect background models for the variable density pseudoinverse Born modeling verify the effectiveness of the weighted least-squares method when compared with the other two approaches. The Taylor expansion approach appears to contain too many artifacts for successful applicability.


Sign in / Sign up

Export Citation Format

Share Document