Effect of Random Noise on the Performance of NIR Calibrations

1998 ◽  
Vol 6 (1) ◽  
pp. 77-87 ◽  
Author(s):  
Jing Lu ◽  
W.F. McClure ◽  
F.E. Barton ◽  
D.S. Himmelsbach

The proliferation of applications for near infrared (NIR) spectroscopy has been fostered by advances in instrumentation and statistics. NIR analytical instrumentation is becoming more stable and reliable. Chemometrics is playing an important role in qualitative and quantitative NIR spectra analysis. The objective of this study was to evaluate the performances of four commonly used calibration models: (1) stepwise multiple linear regression (SMLR); (2) classical least-squares (CLS); (3) principal component regression (PCR); and (4) partial least-squares (PLS) in NIR spectroscopy analysis when random noise is present in the optical data. A conceptually simple procedure for comparing the performance of the four calibration methods in the presence of different levels of random noise in spectra data has been introduced here. This procedure, using the computer simulation data and real spectra of tobacco, has provided useful information for understanding the effects of random noise on the performance of multivariate calibration methods. Both numerical and graphical results will be shown.

1997 ◽  
Vol 51 (3) ◽  
pp. 350-357 ◽  
Author(s):  
Tormod Næs ◽  
Kjell Ivar Hildrum

Often the primary goal of analytical measurement tasks is not to find good estimates of continuous reference values but rather to determine whether a sample belongs to one of a number of categories or subgroups. In this paper the potential of different statistical techniques in the classification of raw beef samples in tenderness subgroups was studied. The reference values were based on sensory analysis of beef tenderness of 90 samples from bovine M. longissimus dorsi muscles. The sample set was divided into three categories—very tough, intermediate, and very tender—according to degree of tenderness. A training set of samples was used to find the relationship between category and near-infrared (NIR) spectroscopic measurements. The study indicates that classical discriminant analysis has advantages in comparison to multivariate calibration methods [i.e., principal component regression (PCR)], in this application. One reason for this observation seems to be that PCR underestimates high measurement values and overestimates low values. In this way most samples are assigned to the intermediate group of samples, causing a small number of erroneous classifications for the intermediate subgroup, but a large number of errors for the two extreme groups. With the use of PCR the number of correct classifications in the extreme subgroups was as low as 23%, while the use of discriminate analysis increased this number to almost 60%. The number of classifications in correct or neighbor subgroup for the two extreme subgroups was equal to 97%. A “bias-correction” was also attempted for PCR, and this gave results comparable to the best results obtained by discriminant analysis methods. Test sets used NIR analysis of fresh, raw beef samples with different processing. While this spectroscopic approach had previously been shown to be useful with frozen products, it appears unsuitable at this time for fresh beef. However, its marginal analytical utility proved useful in evaluating the two classification approaches employed in this study.


2000 ◽  
Vol 54 (2) ◽  
pp. 294-299 ◽  
Author(s):  
Songbiao Zhang ◽  
Babs R. Soller ◽  
Shubjeet Kaur ◽  
Kristen Perras ◽  
Thomas J. Vander Salm

Hematocrit (Hct), the volume percent of red cells in blood, is monitored routinely for blood donors, surgical patients, and trauma victims and requires blood to be removed from the patient. An accurate, noninvasive method for directly measuring hematocrit on patients is desired for these applications. The feasibility of noninvasive hematocrit measurement by using near-infrared (NIR) spectroscopy and partial least-squares (PLS) techniques was investigated, and methods of in vivo calibration were examined. Twenty Caucasian patients undergoing cardiac surgery on cardiopulmonary bypass were randomly selected to form two study groups. A fiber-optic probe was attached to the patient's forearm, and NIR spectra were continuously collected during surgery. Blood samples were simultaneously collected and reference Hct measurements were made with the spun capillary method. PLS multivariate calibration techniques were applied to investigate the relationship between spectral and Hct changes. Single patient calibration models were developed with good cross-validated estimation of accuracy (∼ 1 Hct%) and trending capability for most patients. Time-dependent system drift, patient temperature, and venous oxygen saturation were not correlated with the hematocrit measurements. Multi-subject models were developed for prediction of independent subjects. These models demonstrated a significant patient-specific offset that was shown to be partially related to spectrometer drift. The remaining offset is attributed to the large spectral variability of patient tissue, and a significantly larger set of patients would be required to adequately model this variability. After the removal of the offset, the cross-validated estimation of accuracy is 2 Hct%.


2013 ◽  
Vol 44 (2s) ◽  
Author(s):  
Chiara Cevoli ◽  
Angelo Fabbri ◽  
Alessandro Gori ◽  
Maria Fiorenza Caboni ◽  
Adriano Guarnieri

Parmigiano–Reggiano (PR) cheese is one of the oldest traditional cheeses produced in Europe, and it is still one of the most valuable Protected Designation of Origin (PDO) cheeses of Italy. The denomination of origin is extended to the grated cheese when manufactured exclusively from whole Parmigiano-Reggiano cheese wheels that respond to the production standard. The grated cheese must be matured for a period of at least 12 months and characterized by a rind content not over 18%. In this investigation the potential of near infrared spectroscopy (NIR), coupled to different statistical methods, were used to estimate the authenticity of grated Parmigiano Reggiano cheese PDO. Cheese samples were classified as: compliance PR, competitors, non-compliance PR (defected PR), and PR with rind content greater then 18%. NIR spectra were obtained using a spectrophotometer Vector 22/N (Bruker Optics, Milan, Italy) in the diffuse reflectance mode. Instrument was equipped with a rotating integrating sphere. Principal Component Analysis (PCA) was conducted for an explorative spectra analysis, while the Artificial Neural Networks (ANN) were used to classify spectra, according to different cheese categories. Subsequently the rind percentage and month of ripening were estimated by a Partial Least Squares regression (PLS). Score plots of the PCA show a clear separation between compliance PR samples and the rest of the sample was observed. Competitors samples and the defected PR samples were grouped together. The classification performance for all sample classes, obtained by ANN analysis, was higher of 90%, in test set validation. Rind content and month of ripening were predicted by PLS a with a determination coefficient greater then 0.95 (test set). These results showed that the method can be suitable for a fast screening of grated cheese authenticity.


2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Yamin Zuo ◽  
Jing Yang ◽  
Chen Li ◽  
Xuehua Deng ◽  
Shengsheng Zhang ◽  
...  

Steaming is a vital unit operation in traditional Chinese medicine (TCM), which greatly affects the active ingredients and the pharmacological efficacy of the products. Near-infrared (NIR) spectroscopy has already been widely used as a strong process analytical technology (PAT) tool. In this study, the potential usage of NIR spectroscopy to monitor the steaming process of Gastrodiae rhizoma was explored. About 10 lab scale batches were employed to construct quantitative models to determine four chemical ingredients and moisture change during the steaming process. Gastrodin, p-hydroxybenzyl alcohol, parishin B, and parishin A were modeled by different multivariate calibration models (SMLR and PLS), while the content of the moisture was modeled by principal component regression (PCR). In the optimized models, the root mean square errors of prediction (RMSEP) for gastrodin, p-hydroxybenzyl alcohol, parishin B, parishin A, and moisture were 0.0181, 0.0143, 0.0132, 0.0244, and 2.15, respectively, and correlation coefficients ( R p 2 ) were 0.9591, 0.9307, 0.9309, 0.9277, and 0.9201, respectively. Three other batches’ results revealed that the accuracy of the model was acceptable and that was specific for next drying step. In addition, the results demonstrated the method was reliable in process performance and robustness. This method holds a great promise to replace current subjective color judgment and time-consuming HPLC or UV/Vis methods and is suitable for rapid online monitoring and quality control in the TCM industrial steaming process.


2019 ◽  
Vol 2019 ◽  
pp. 1-8
Author(s):  
Hui Chen ◽  
Zan Lin ◽  
Chao Tan

The qualitative and quantitative determination of the components of textile fibers takes an important position in quality control. A fast and nondestructive method of simultaneously analyzing four fiber components in blended fabrics was studied by near-infrared (NIR) spectroscopy combined with multivariate calibration. Two sample sets including 39 and 25 samples were designed by simplex mixture lattice design methods and used for experiment. Four components include wool, polyester, polyacrylonitrile, and nylon and their mixture is one of the most popular formulas of textiles. Uninformative variable elimination-partial least squares (UVEPLS) and the full-spectrum partial least squares (PLS) were used as the tool. On the test set, the mean standard error of prediction (SEP) and the mean ratio of the standard deviation of the response variable and SEP (RPD) of the full-spectrum PLS model and UVEPLS model were 0.38, 0.32 and 7.6, 8.3, respectively. This result reveals that the UVEPLS can construct local models with acceptable and better performance than the full-spectrum PLS. It indicates that this method is valuable for nondestructive analysis in the field of wool content detection since it can avoid time-consuming, costly, and laborious wet chemical analysis.


1992 ◽  
Vol 38 (9) ◽  
pp. 1618-1622 ◽  
Author(s):  
M R Robinson ◽  
R P Eaton ◽  
D M Haaland ◽  
G W Koepp ◽  
E V Thomas ◽  
...  

Abstract Noninvasive monitoring of blood/tissue glucose concentrations has been successfully accomplished in individual diabetic subjects by using near-infrared (NIR) spectroscopy coupled with chemometric methods. Three different spectrometer configurations were tested: a) a Fourier-transform infrared spectrometer with an indium antimonide detector; b) a grating monochromator equipped with a silicon (Si) array detector, without fiber optics; and c) a grating monochromator equipped with an Si detector, with fiber-optic sampling. NIR spectra were obtained from diabetic subjects by transmission through the finger during a meal-tolerance test. The maximum range of observed plasma glucose concentrations obtained from the blood samples was 2.5-27 mmol/L. The NIR spectra were processed by using the chemometric multivariate calibration methods of partial least squares and principal component regression. The best calibration yielded a cross-validated average absolute error in glucose concentration of 1.1 mmol/L. This predictive ability suggests that noninvasive glucose determinations by NIR/chemometrics is a viable analytical method.


1989 ◽  
Vol 43 (8) ◽  
pp. 1435-1443 ◽  
Author(s):  
Charles E. Miller

Near-infrared spectroscopy in the combination, first overtone, and second overtone regions is combined with the multivariate methods of Partial-Least-Squares (PLS) and Classical-Least-Squares (CLS) to provide calibrations for chemical components in ethylene-propylene-diene monomer (EPDM) terpolymers. EPDM samples with 1,4-hexadiene (HD) and ethylidene norbornene (ENB) diene monomers were used for this study. Because unknown interaction effects are present in the spectra of these materials, the PLS calibration method gives more accurate calibrations than the CLS method. PLS coefficient spectra and CLS reconstructed spectra obtained from the calibrations are used to determine the sources of the unknown spectral effects. Results indicate that the combination, first overtone, and second overtone regions of the spectrum can be used to determine ethylene and propylene concentrations in the terpolymers, and the combination region can be used to determine diene concentrations. The presence of intrachain and interchain interactions in the terpolymers is indicated by observation of CLS reconstructed spectra.


2020 ◽  
Vol 13 (1) ◽  
Author(s):  
Elise A. Kho ◽  
Jill N. Fernandes ◽  
Andrew C. Kotze ◽  
Glen P. Fox ◽  
Maggy T. Sikulu-Lord ◽  
...  

Abstract Background Existing diagnostic methods for the parasitic gastrointestinal nematode, Haemonchus contortus, are time consuming and require specialised expertise, limiting their utility in the field. A practical, on-farm diagnostic tool could facilitate timely treatment decisions, thereby preventing losses in production and flock welfare. We previously demonstrated the ability of visible–near-infrared (Vis–NIR) spectroscopy to detect and quantify blood in sheep faeces with high accuracy. Here we report our investigation of whether variation in sheep type and environment affect the prediction accuracy of Vis–NIR spectroscopy in quantifying blood in faeces. Methods Visible–NIR spectra were obtained from worm-free sheep faeces collected from different environments and sheep types in South Australia (SA) and New South Wales, Australia and spiked with various sheep blood concentrations. Spectra were analysed using principal component analysis (PCA), and calibration models were built around the haemoglobin (Hb) wavelength region (387–609 nm) using partial least squares regression. Models were used to predict Hb concentrations in spiked faeces from SA and naturally infected sheep faeces from Queensland (QLD). Samples from QLD were quantified using Hemastix® test strip and FAMACHA© diagnostic test scores. Results Principal component analysis showed that location, class of sheep and pooled versus individual samples were factors affecting the Hb predictions. The models successfully differentiated ‘healthy’ SA samples from those requiring anthelmintic treatment with moderate to good prediction accuracy (sensitivity 57–94%, specificity 44–79%). The models were not predictive for blood in the naturally infected QLD samples, which may be due in part to variability of faecal background and blood chemistry between samples, or the difference in validation methods used for blood quantification. PCA of the QLD samples, however, identified a difference between samples containing high and low quantities of blood. Conclusion This study demonstrates the potential of Vis–NIR spectroscopy for estimating blood concentration in faeces from various types of sheep and environmental backgrounds. However, the calibration models developed here did not capture sufficient environmental variation to accurately predict Hb in faeces collected from environments different to those used in the calibration model. Consequently, it will be necessary to establish models that incorporate samples that are more representative of areas where H. contortus is endemic.


Sign in / Sign up

Export Citation Format

Share Document