scholarly journals Constructive Analysis for Least Squares Regression with GeneralizedK-Norm Regularization

2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Cheng Wang ◽  
Weilin Nie
Keyword(s):  
Integral Operator ◽  
Least Squares ◽  
Learning Rate ◽  
Spectral Theorem ◽  
Least Squares Regression ◽  
Constructive Approach ◽  
Projection Technique ◽  
Sample Error ◽  
Regularization Error ◽  
Error Decomposition

We introduce a constructive approach for the least squares algorithms with generalizedK-norm regularization. Different from the previous studies, a stepping-stone function is constructed with some adjustable parameters in error decomposition. It makes the analysis flexible and may be extended to other algorithms. Based on projection technique for sample error and spectral theorem for integral operator in regularization error, we finally derive a learning rate.

scholarly journals Coefficient-Based Regression with Non-Identical Unbounded Sampling

2013 ◽  
Vol 2013 ◽  
pp. 1-8 ◽  
Author(s):  
Jia Cai
Keyword(s):  
Hilbert Space ◽  
Integral Operator ◽  
Error Analysis ◽  
Least Squares ◽  
Reproducing Kernel ◽  
Reproducing Kernel Hilbert Space ◽  
Least Squares Regression ◽  
Regression Problem ◽  
Novel Technique ◽  
Sample Error

We investigate a coefficient-based least squares regression problem with indefinite kernels from non-identical unbounded sampling processes. Here non-identical unbounded sampling means the samples are drawn independently but not identically from unbounded sampling processes. The kernel is not necessarily symmetric or positive semi-definite. This leads to additional difficulty in the error analysis. By introducing a suitable reproducing kernel Hilbert space (RKHS) and a suitable intermediate integral operator, elaborate analysis is presented by means of a novel technique for the sample error. This leads to satisfactory results.

Learning with Convex Loss and Indefinite Kernels

2014 ◽  
Vol 26 (1) ◽  
pp. 158-184 ◽  
Author(s):  
Hongzhi Tong ◽  
Di-Rong Chen ◽  
Fenghong Yang
Keyword(s):  
Approximation Error ◽  
Positive Semidefinite ◽  
Learning Rate ◽  
Support Vector ◽  
Empirical Process Theory ◽  
Sample Error ◽  
General Convex ◽  
Convex Loss ◽  
Detailed Mathematical Analysis ◽  
Error Decomposition

We consider a kind of kernel-based regression with general convex loss functions in a regularization scheme. The kernels used in the scheme are not necessarily symmetric and thus are not positive semidefinite; l1−norm of the coefficients in the kernel ensembles is taken as the regularizer. Our setting in this letter is quite different from the classical regularized regression algorithms such as regularized networks and support vector machines regression. Under an established error decomposition that consists of approximation error, hypothesis error, and sample error, we present a detailed mathematical analysis for this scheme and, in particular, its learning rate. A reweighted empirical process theory is applied to the analysis of produced learning algorithms, which plays a key role in deriving the explicit learning rate under some assumptions.

Use of reflectance spectroscopy to estimate the organic carbon and CaCO3 contents of soils

2012 ◽  
Vol 61 (2) ◽  
pp. 277-290 ◽  
Author(s):  
Ádám Csorba ◽  
Vince Láng ◽  
László Fenyvesi ◽  
Erika Michéli
Keyword(s):  
Organic Carbon ◽  
Least Squares ◽  
Partial Least Squares ◽  
Partial Least Squares Regression ◽  
Mean Squared Error ◽  
Reflectance Spectroscopy ◽  
Least Squares Regression ◽  
Root Mean Squared Error ◽  
Squared Error

Napjainkban egyre nagyobb igény mutatkozik olyan technológiák és módszerek kidolgozására és alkalmazására, melyek lehetővé teszik a gyors, költséghatékony és környezetbarát talajadat-felvételezést és kiértékelést. Ezeknek az igényeknek felel meg a reflektancia spektroszkópia, mely az elektromágneses spektrum látható (VIS) és közeli infravörös (NIR) tartományában (350–2500 nm) végzett reflektancia-mérésekre épül. Figyelembe véve, hogy a talajokról felvett reflektancia spektrum információban nagyon gazdag, és a vizsgált tartományban számos talajalkotó rendelkezik karakterisztikus spektrális „ujjlenyomattal”, egyetlen görbéből lehetővé válik nagyszámú, kulcsfontosságú talajparaméter egyidejű meghatározása. Dolgozatunkban, a reflektancia spektroszkópia alapjaira helyezett, a talajok ösz-szetételének meghatározását célzó módszertani fejlesztés első lépéseit mutatjuk be. Munkánk során talajok szervesszén- és CaCO3-tartalmának megbecslését lehetővé tévő többváltozós matematikai-statisztikai módszerekre (részleges legkisebb négyzetek módszere, partial least squares regression – PLSR) épülő prediktív modellek létrehozását és tesztelését végeztük el. A létrehozott modellek tesztelése során megállapítottuk, hogy az eljárás mindkét talajparaméter esetében magas R2értéket [R2(szerves szén) = 0,815; R2(CaCO3) = 0,907] adott. A becslés pontosságát jelző közepes négyzetes eltérés (root mean squared error – RMSE) érték mindkét paraméter esetében közepesnek mondható [RMSE (szerves szén) = 0,467; RMSE (CaCO3) = 3,508], mely a reflektancia mérési előírások standardizálásával jelentősen javítható. Vizsgálataink alapján arra a következtetésre jutottunk, hogy a reflektancia spektroszkópia és a többváltozós kemometriai eljárások együttes alkalmazásával, gyors és költséghatékony adatfelvételezési és -értékelési módszerhez juthatunk.

Speech Emotion Recognition Based on Sparse Representation

2013 ◽  
Vol 38 (4) ◽  
pp. 465-470 ◽  
Author(s):  
Jingjie Yan ◽  
Xiaolan Wang ◽  
Weiyi Gu ◽  
LiLi Ma
Keyword(s):  
Dimensionality Reduction ◽  
Emotion Recognition ◽  
Least Squares ◽  
Partial Least Squares ◽  
Partial Least Squares Regression ◽  
Speech Emotion Recognition ◽  
Least Squares Regression ◽  
Computer Science Pedagogy ◽  
Reduction Methods ◽  
Analysis Computer

Abstract Speech emotion recognition is deemed to be a meaningful and intractable issue among a number of do- mains comprising sentiment analysis, computer science, pedagogy, and so on. In this study, we investigate speech emotion recognition based on sparse partial least squares regression (SPLSR) approach in depth. We make use of the sparse partial least squares regression method to implement the feature selection and dimensionality reduction on the whole acquired speech emotion features. By the means of exploiting the SPLSR method, the component parts of those redundant and meaningless speech emotion features are lessened to zero while those serviceable and informative speech emotion features are maintained and selected to the following classification step. A number of tests on Berlin database reveal that the recogni- tion rate of the SPLSR method can reach up to 79.23% and is superior to other compared dimensionality reduction methods.

An Approach of the Madeira Wine Chemistry

Beverages ◽  
2020 ◽  
Vol 6 (1) ◽  
pp. 12 ◽  
Author(s):  
Rosa Perestrelo ◽  
Catarina Silva ◽  
Carolina Gonçalves ◽  
Mariangie Castillo ◽  
José S. Câmara
Keyword(s):  
Mass Spectrometry ◽  
Gas Chromatography ◽  
Least Squares ◽  
Partial Least Squares ◽  
Chemical Reactions ◽  
Ageing Process ◽  
Gas Chromatography Mass Spectrometry ◽  
Wine Aroma ◽  
Least Squares Regression ◽  
Volatile Composition

Madeira wine is a fortified Portuguese wine, which has a crucial impact on the Madeira Island economy. The particular properties of Madeira wine result from the unique and specific winemaking and ageing processes that promote the occurrence of chemical reactions among acids, sugars, alcohols, and polyphenols, which are important to the extraordinary quality of the wine. These chemical reactions contribute to the appearance of novel compounds and/or the transformation of others, consequently promoting changes in qualitative and quantitative volatile and non-volatile composition. The current review comprises an overview of Madeira wines related to volatile (e.g., terpenes, norisoprenoids, alcohols, esters, fatty acids) and non-volatile composition (e.g., polyphenols, organic acids, amino acids, biogenic amines, and metals). Moreover, types of aroma compounds, the contribution of volatile organic compounds (VOCs) to the overall Madeira wine aroma, the change of their content during the ageing process, as well as the establishment of the potential ageing markers will also be reviewed. The viability of several analytical methods (e.g., gas chromatography-mass spectrometry (GC-MS), two-dimensional gas chromatography and time-of-flight mass spectrometry (GC×GC-ToFMS)) combined with chemometrics tools (e.g., partial least squares regression (PLS-R), partial least squares discriminant analysis (PLS-DA) was investigated to establish potential ageing markers to guarantee the Madeira wine authenticity. Acetals, furanic compounds, and lactones are the chemical families most commonly related with the ageing process.

Sign in / Sign up

Export Citation Format

Share Document