Least squares regression principal component analysis: A supervised dimensionality reduction method

2021 ◽  
Author(s):  
Hector Pascual ◽  
Xin C. Yee
Keyword(s):  
Principal Component Analysis ◽  
Dimensionality Reduction ◽  
Least Squares ◽  
Reduction Method ◽  
Principal Component ◽  
Component Analysis ◽  
Least Squares Regression ◽  
Dimensionality Reduction Method

scholarly journals Fault identification for chiller sensor based on partial least square method

2021 ◽  
Vol 233 ◽  
pp. 03057
Author(s):  
Bang Wu ◽  
Yunpeng Hu ◽  
Chuanhui Zhou ◽  
Guaiguai Chen ◽  
Guannan Li
Keyword(s):  
Principal Component Analysis ◽  
Least Squares ◽  
Partial Least Squares ◽  
Principal Component ◽  
Component Analysis ◽  
Fault Analysis ◽  
Partial Least Square ◽  
Least Square ◽  
Fault Identification ◽  
Least Squares Regression

Sensor failures can lead to an imbalance in heating, ventilation and air conditioning (HVAC) control systems and increase energy consumption. The partial least squares algorithm is a multivariate statistical method, compared with the principal component analysis, its compression factor score contains more original data characteristic information, therefore, partial least squares have greater potential for fault diagnosis than the principal component analysis. However, there are few studies based on partial least squares in the field of HVAC. In order to introduce partial least squares into the field, based on the partial least squares fault detection theory, a fault analysis method suitable for this field is proposed, and the RP1403 data published by ASHARE was used to verify this method. The results show that on the basis of selecting the appropriate number of principal components, partial least squares have the ability to diagnose the fault of the chiller sensor. With the known fault source, partial least squares regression, a method with better data reconstruction accuracy than principal component analysis, is used to repair the fault. Finally, the purpose of fault identification can be achieved.

scholarly journals A model for spectroscopic food sample analysis using data sonification

2021 ◽  
Author(s):  
Hsein Kew
Keyword(s):  
Dimensionality Reduction ◽  
Classification Accuracy ◽  
Reduction Method ◽  
Real Life ◽  
Principal Component ◽  
Relevant Information ◽  
Analysis Model ◽  
Linear Discriminant ◽  
Audio Output ◽  
Dimensionality Reduction Method

AbstractIn this paper, we propose a method to generate an audio output based on spectroscopy data in order to discriminate two classes of data, based on the features of our spectral dataset. To do this, we first perform spectral pre-processing, and then extract features, followed by machine learning, for dimensionality reduction. The features are then mapped to the parameters of a sound synthesiser, as part of the audio processing, so as to generate audio samples in order to compute statistical results and identify important descriptors for the classification of the dataset. To optimise the process, we compare Amplitude Modulation (AM) and Frequency Modulation (FM) synthesis, as applied to two real-life datasets to evaluate the performance of sonification as a method for discriminating data. FM synthesis provides a higher subjective classification accuracy as compared with to AM synthesis. We then further compare the dimensionality reduction method of Principal Component Analysis (PCA) and Linear Discriminant Analysis in order to optimise our sonification algorithm. The results of classification accuracy using FM synthesis as the sound synthesiser and PCA as the dimensionality reduction method yields a mean classification accuracies of 93.81% and 88.57% for the coffee dataset and the fruit puree dataset respectively, and indicate that this spectroscopic analysis model is able to provide relevant information on the spectral data, and most importantly, is able to discriminate accurately between the two spectra and thus provides a complementary tool to supplement current methods.

scholarly journals Fractional Wavelet-Based Generative Scattering Networks

2021 ◽  
Vol 15 ◽  
Author(s):  
Jiasong Wu ◽  
Xiang Qiu ◽  
Jing Zhang ◽  
Fuzhi Wu ◽  
Youyong Kong ◽  
...  
Keyword(s):  
Dimensionality Reduction ◽  
Reduction Method ◽  
Gaussian White Noise ◽  
Principal Component ◽  
Experimental Results ◽  
Generative Adversarial Networks ◽  
Image Generation ◽  
Adversarial Networks ◽  
Dimensionality Reduction Method

Generative adversarial networks and variational autoencoders (VAEs) provide impressive image generation from Gaussian white noise, but both are difficult to train, since they need a generator (or encoder) and a discriminator (or decoder) to be trained simultaneously, which can easily lead to unstable training. To solve or alleviate these synchronous training problems of generative adversarial networks (GANs) and VAEs, researchers recently proposed generative scattering networks (GSNs), which use wavelet scattering networks (ScatNets) as the encoder to obtain features (or ScatNet embeddings) and convolutional neural networks (CNNs) as the decoder to generate an image. The advantage of GSNs is that the parameters of ScatNets do not need to be learned, while the disadvantage of GSNs is that their ability to obtain representations of ScatNets is slightly weaker than that of CNNs. In addition, the dimensionality reduction method of principal component analysis (PCA) can easily lead to overfitting in the training of GSNs and, therefore, affect the quality of generated images in the testing process. To further improve the quality of generated images while keeping the advantages of GSNs, this study proposes generative fractional scattering networks (GFRSNs), which use more expressive fractional wavelet scattering networks (FrScatNets), instead of ScatNets as the encoder to obtain features (or FrScatNet embeddings) and use similar CNNs of GSNs as the decoder to generate an image. Additionally, this study develops a new dimensionality reduction method named feature-map fusion (FMF) instead of performing PCA to better retain the information of FrScatNets,; it also discusses the effect of image fusion on the quality of the generated image. The experimental results obtained on the CIFAR-10 and CelebA datasets show that the proposed GFRSNs can lead to better generated images than the original GSNs on testing datasets. The experimental results of the proposed GFRSNs with deep convolutional GAN (DCGAN), progressive GAN (PGAN), and CycleGAN are also given.

Physical-oriented and machine learning-based emission modeling in a diesel compression ignition engine: Dimensionality reduction and regression

2022 ◽  
pp. 146808742110707
Author(s):  
Aran Mohammad ◽  
Reza Rezaei ◽  
Christopher Hayduk ◽  
Thaddaeus Delebinski ◽  
Saeid Shahpouri ◽  
...  
Keyword(s):  
Principal Component Analysis ◽  
Support Vector Machine ◽  
Factor Analysis ◽  
Dimensionality Reduction ◽  
Principal Component ◽  
Component Analysis ◽  
Data Driven ◽  
Support Vector ◽  
Emission Models ◽  
Emission Modeling

The development of internal combustion engines is affected by the exhaust gas emissions legislation and the striving to increase performance. This demands for engine-out emission models that can be used for engine optimization for real driving emission controls. The prediction capability of physically and data-driven engine-out emission models is influenced by the system inputs, which are specified by the user and can lead to an improved accuracy with increasing number of inputs. Thereby the occurrence of irrelevant inputs becomes more probable, which have a low functional relation to the emissions and can lead to overfitting. Alternatively, data-driven methods can be used to detect irrelevant and redundant inputs. In this work, thermodynamic states are modeled based on 772 stationary measured test bench data from a commercial vehicle diesel engine. Afterward, 37 measured and modeled variables are led into a data-driven dimensionality reduction. For this purpose, approaches of supervised learning, such as lasso regression and linear support vector machine, and unsupervised learning methods like principal component analysis and factor analysis are applied to select and extract the relevant features. The selected and extracted features are used for regression by the support vector machine and the feedforward neural network to model the NOx, CO, HC, and soot emissions. This enables an evaluation of the modeling accuracy as a result of the dimensionality reduction. Using the methods in this work, the 37 variables are reduced to 25, 22, 11, and 16 inputs for NOx, CO, HC, and soot emission modeling while maintaining the accuracy. The features selected using the lasso algorithm provide more accurate learning of the regression models than the extracted features through principal component analysis and factor analysis. This results in test errors RMSETe for modeling NOx, CO, HC, and soot emissions 19.22 ppm, 6.46 ppm, 1.29 ppm, and 0.06 FSN, respectively.

scholarly journals Dimensionality Reduction using PCA and K-Means Clustering for Breast Cancer Prediction

2018 ◽  
pp. 192 ◽  
Author(s):  
Ade Jamal ◽  
Annisa Handayani ◽  
Ali Akbar Septiandri ◽  
Endang Ripmiatin ◽  
Yunus Effendi
Keyword(s):  
Breast Cancer ◽  
Principal Component Analysis ◽  
Dimensionality Reduction ◽  
Principal Component ◽  
Component Analysis ◽  
Gradient Boosting ◽  
Support Vector ◽  
Breast Cancer Dataset ◽  
Cancer Prediction ◽  
Extreme Gradient Boosting

Breast cancer is the most important cause of death among women. A prediction of breast cancer in early stage provides a greater possibility of its cure. It needs a breast cancer prediction tool that can classify a breast tumor whether it was a harmful malignant tumor or un-harmful benign tumor. In this paper, two algorithms of machine learning, namely Support Vector Machine and Extreme Gradient Boosting technique will be compared for classification purpose. Prior to the classification, the number of data attribute will be reduced from the raw data by extracting features using Principal Component Analysis. A clustering method, namely K-Means is also used for dimensionality reduction besides the Principal Component Analysis. This paper will present a comparison among four models based on two dimensionality reduction methods combined with two classifiers which applied on Wisconsin Breast Cancer Dataset. The comparison will be measured by using accuracy, sensitivity and specificity metrics evaluated from the confusion matrices. The experimental results have indicated that the K-Means method, which is not usually used for dimensionality reduction can perform well compared to the popular Principal Component Analysis.

Sign in / Sign up

Export Citation Format

Share Document