A neural network least-square estimator

1990 ◽  
Author(s):  
K. Gao ◽  
M.O. Ahmad ◽  
M.N.S. Swamy
Keyword(s):  
Neural Network ◽  
Least Square ◽  
Least Square Estimator

scholarly journals Distance Measurements in UWB-Radio Localization Systems Corrected with a Feedforward Neural Network Model

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2294
Author(s):  
Peter Krapež ◽  
Matjaž Vidmar ◽  
Marko Munih
Keyword(s):  
Neural Network ◽  
Signal Strength ◽  
Calibration Method ◽  
Least Square ◽  
Ultra Wideband ◽  
Distance Measurements ◽  
Least Square Estimator ◽  
Channel Response ◽  
Received Power ◽  
Measured Distance

An ultra-wideband (UWB) localization system is an alternative in a GPS-denied environment. However, a distance measurement with UWB modules using a two-way communication protocol induces an orientation-dependent error. Previous research studied this error by looking at parameters such as the received power and the channel response signal. In this paper, the neural network (NN) method for correcting the orientation-induced distance error without the need to calculate the signal strength, obtain the channel response or know any parameters of the antenna and the UWB modules is presented. The NN method utilizes only the measured distance and the tag orientation, and implements an NN model obtained by machine learning, using measurements at different distances and orientations of the two UWB modules. The verification of the experimental setup with 12 anchors and a tag shows that with the proposed NN method, 5 cm better root mean square error values (RMSEs) are obtained for the measured distance between the anchors and the tag compared to the calibration method that did not include orientation information. With the least-square estimator, 14 cm RMSE in 3D is obtained with the NN model corrected distances, with a 9 cm improvement compared to when raw distances are used. The method produces better results without the need to obtain the UWB module’s diagnostics parameters that are required to calculate the received signal strength or channel response, and in this way maintain the minimum packet size for the ranging protocol.

scholarly journals Matching Large Baseline Oblique Stereo Images Using an End-to-End Convolutional Neural Network

2021 ◽  
Vol 13 (2) ◽  
pp. 274
Author(s):  
Guobiao Yao ◽  
Alper Yilmaz ◽  
Li Zhang ◽  
Fei Meng ◽  
Haibin Ai ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Stereo Matching ◽  
Least Square ◽  
Affine Invariant ◽  
Stereo Images ◽  
Distance Ratio ◽  
Matching Algorithm ◽  
End To End

The available stereo matching algorithms produce large number of false positive matches or only produce a few true-positives across oblique stereo images with large baseline. This undesired result happens due to the complex perspective deformation and radiometric distortion across the images. To address this problem, we propose a novel affine invariant feature matching algorithm with subpixel accuracy based on an end-to-end convolutional neural network (CNN). In our method, we adopt and modify a Hessian affine network, which we refer to as IHesAffNet, to obtain affine invariant Hessian regions using deep learning framework. To improve the correlation between corresponding features, we introduce an empirical weighted loss function (EWLF) based on the negative samples using K nearest neighbors, and then generate deep learning-based descriptors with high discrimination that is realized with our multiple hard network structure (MTHardNets). Following this step, the conjugate features are produced by using the Euclidean distance ratio as the matching metric, and the accuracy of matches are optimized through the deep learning transform based least square matching (DLT-LSM). Finally, experiments on Large baseline oblique stereo images acquired by ground close-range and unmanned aerial vehicle (UAV) verify the effectiveness of the proposed approach, and comprehensive comparisons demonstrate that our matching algorithm outperforms the state-of-art methods in terms of accuracy, distribution and correct ratio. The main contributions of this article are: (i) our proposed MTHardNets can generate high quality descriptors; and (ii) the IHesAffNet can produce substantial affine invariant corresponding features with reliable transform parameters.

Intelligent Control of Flocculation Process Based on Radial Basis Probabilistic Neural Network for Sewage Treatment

2010 ◽  
Vol 44-47 ◽  
pp. 3289-3293
Author(s):  
Jing Wen Tian ◽  
Mei Juan Gao
Keyword(s):  
Neural Network ◽  
Control System ◽  
Process Model ◽  
Probabilistic Neural Network ◽  
Sewage Treatment ◽  
Sewage Treatment Plant ◽  
Treatment Plant ◽  
Least Square ◽  
Radial Basis ◽  
Flocculation Process

The flocculating process of sewage treatment is a complicated and nonlinear system, and it is very difficult to found the process model to describe it. The radial basis probabilistic neural network (RBPNN) has the ability of strong function approach and fast convergence. In this paper, an intelligent optimized control system based on radial basis probabilistic neural network is presented. We constructed the structure of radial basis probabilistic neural network that used for controlling the flocculation process, and adopt the K-Nearest Neighbor algorithm and least square method to train the network. We given the architecture of control system and analyzed the working process of system. In this system, the parameters of flocculation process were measured using sensors, and then the control system can control the flocculation process real-time. The system was used in the sewage treatment plant. The experimental results prove that this system is feasible.

QSPR MODELLING OF STABILITY CONSTANTS OF METAL-THIOSEMICARBAZONE COMPLEXES USING MULTIVARIATE REGRESSION METHODS AND ARTIFICIAL NEURAL NETWORK

2021 ◽  
Vol 36 (06) ◽  
Author(s):  
NGUYEN MINH QUANG ◽  
TRAN NGUYEN MINH AN ◽  
NGUYEN HOANG MINH ◽  
TRAN XUAN MAU ◽  
PHAM VAN TAT
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Stability Constants ◽  
Partial Least Square ◽  
Least Square ◽  
Partial Least Square Regression ◽  
Structure Property ◽  
Least Square Regression ◽  
Thiosemicarbazone Complexes ◽  
Artificial Neural

In this study, the stability constants of metal-thiosemicarbazone complexes, logb11 were determined by using the quantitative structure property relationship (QSPR) models. The molecular descriptors, physicochemical and quantum descriptors of complexes were generated from molecular geometric structure and semi-empirical quantum calculation PM7 and PM7/sparkle. The QSPR models were built by using the ordinary least square regression (QSPROLS), partial least square regression (QSPRPLS), primary component regression (QSPRPCR) and artificial neural network (QSPRANN). The best linear model QSPROLS (with k of 9) involves descriptors C5, xp9, electric energy, cosmo volume, N4, SsssN, cosmo area, xp10 and core-core repulsion. The QSPRPLS, QSPR PCR and QSPRANN models were developed basing on 9 varibles of the QSPROLS model. The quality of the QSPR models were validated by the statistical values; The QSPROLS: R2train = 0.944, Q2LOO = 0.903 and MSE = 1.035; The QSPRPLS: R2train = 0.929, R2CV = 0.938 and MSE = 1.115; The QSPRPCR: R2train = 0.934, R2CV = 0.9485 and MSE = 1.147. The neural network model QSPRANN with architecture I(9)-HL(12)-O(1) was presented also with the statistical values: R2train = 0.9723, and R2CV = 0.9731. The QSPR models also were evaluated externally and got good performance results with those from the experimental literature.

scholarly journals Estimation of carcass weight of Hanwoo (Korean native cattle) as a function of body measurements using statistical models and a neural network

2020 ◽  
Vol 33 (10) ◽  
pp. 1633-1641
Author(s):  
Dae-Hyun Lee ◽  
Seung-Hyun Lee ◽  
Byoung-Kwan Cho ◽  
Collins Wakholi ◽  
Young-Wook Seo ◽  
...  
Keyword(s):  
Neural Network ◽  
Multiple Regression ◽  
Partial Least Square ◽  
Least Square ◽  
Partial Least Square Regression ◽  
Carcass Weight ◽  
Body Measurements ◽  
Least Square Regression ◽  
Data Points ◽  
Hanwoo Cattle

Objective: The objective of this study was to develop a model for estimating the carcass weight of Hanwoo cattle as a function of body measurements using three different modeling approaches: i) multiple regression analysis, ii) partial least square regression analysis, and iii) a neural network.Methods: Data from a total of 134 Hanwoo cattle were obtained from the National Institute of Animal Science in South Korea. Among the 372 variables in the raw data, 20 variables related to carcass weight and body measurements were extracted to use in multiple regression, partial least square regression, and an artificial neural network to estimate the cold carcass weight of Hanwoo cattle by any of seven body measurements significantly related to carcass weight or by all 19 body measurement variables. For developing and training the model, 100 data points were used, whereas the 34 remaining data points were used to test the model estimation.Results: The R2 values from testing the developed models by multiple regression, partial least square regression, and an artificial neural network with seven significant variables were 0.91, 0.91, and 0.92, respectively, whereas all the methods exhibited similar R2 values of approximately 0.93 with all 19 body measurement variables. In addition, relative errors were within 4%, suggesting that the developed model was reliable in estimating Hanwoo cattle carcass weight. The neural network exhibited the highest accuracy.Conclusion: The developed model was applicable for estimating Hanwoo cattle carcass weight using body measurements. Because the procedure and required variables could differ according to the type of model, it was necessary to select the best model suitable for the system with which to calculate the model.

scholarly journals On shrinkage and selection: ANOVA model

2018 ◽  
Vol 51 (2) ◽  
pp. 165-191 ◽  
Author(s):  
A. K. Md. Ehsanes Saleh ◽  
M. Arashi ◽  
M. Norouzirad ◽  
B M Goalm Kibria
Keyword(s):  
Lower Bound ◽  
Preliminary Test ◽  
Least Square ◽  
Graphical Display ◽  
Ridge Estimator ◽  
Least Square Estimator ◽  
Projection Scheme ◽  
Anova Model ◽  
Compare And Contrast ◽  
Risk Equivalent

This paper considers the estimation of the parameters of an ANOVA model when sparsity is suspected. Accordingly, we consider the least square estimator (LSE), restricted LSE, preliminary test and Stein-type estimators, together with three penalty estimators, namely, the ridge estimator, subset selection rules (hard threshold estimator) and the LASSO (soft threshold estimator). We compare and contrast the L2-risk of all the estimators with the lower bound of L2-risk of LASSO in a family of diagonal projection scheme which is also the lower bound of the exact L2-risk of LASSO. The result of this comparison is that neither LASSO nor the LSE, preliminary test, and Stein-type estimators outperform each other uniformly. However, when the model is sparse, LASSO outperforms all estimators except “ridge” estimator since both LASSO and ridge are L2-risk equivalent under sparsity. We also find that LASSO and the restricted LSE are L2-risk equivalent and both outperform all estimators (except ridge) depending on the dimension of sparsity. Finally, ridge estimator outperforms all estimators uniformly. Our finding are based on L2-risk of estimators and lower bound of the risk of LASSO together with tables of efficiency and graphical display of efficiency and not based on simulation.

A Cooperative Recurrent Neural Network for Solving L1 Estimation Problems with General Linear Constraints

2008 ◽  
Vol 20 (3) ◽  
pp. 844-872 ◽  
Author(s):  
Youshen Xia ◽  
Mohamed S. Kamel
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Recurrent Neural Network ◽  
Parallel Implementation ◽  
Linear Constraints ◽  
Estimation Problem ◽  
Least Square ◽  
General Linear ◽  
Attractive Alternative ◽  
Estimation Problems

The constrained L1 estimation is an attractive alternative to both the unconstrained L1 estimation and the least square estimation. In this letter, we propose a cooperative recurrent neural network (CRNN) for solving L1 estimation problems with general linear constraints. The proposed CRNN model combines four individual neural network models automatically and is suitable for parallel implementation. As a special case, the proposed CRNN includes two existing neural networks for solving unconstrained and constrained L1 estimation problems, respectively. Unlike existing neural networks, with penalty parameters, for solving the constrained L1 estimation problem, the proposed CRNN is guaranteed to converge globally to the exact optimal solution without any additional condition. Compared with conventional numerical algorithms, the proposed CRNN has a low computational complexity and can deal with the L1 estimation problem with degeneracy. Several applied examples show that the proposed CRNN can obtain more accurate estimates than several existing algorithms.

Sign in / Sign up

Export Citation Format

Share Document