Spectrum estimation with missing values: A regularized nuclear norm minimization approach

Author(s):  
Hüseyin Akçay ◽  
Semiha Türkay

In this paper, we consider estimation of a power spectrum from noise corrupted spectrum samples on uniform grids of frequencies with missing values. We propose two schemes based on the regularized nuclear norm minimization in combination with a recent subspace identification algorithm. The proposed schemes estimate the model order and the missing spectrum values in one step and are robust to large amplitude noise over short data records. Although this estimation problem can be cast as a spectrum estimation problem from nonuniformly spaced measurements and the algorithms developed for this type of data can be used, the identification example of this paper shows that the incomplete data formulation yields more accurate results. The properties of one of the proposed schemes are illustrated in an application example concerned with low-pass modeling of transformer current.

2018 ◽  
Vol 2018 ◽  
pp. 1-11 ◽  
Author(s):  
Xiaobo Chen ◽  
Yan Xiao

Missing data is a frequently encountered problem in environment research community. To facilitate the analysis and management of air quality data, for example, PM2.5concentration in this study, a commonly adopted strategy for handling missing values in the samples is to generate a complete data set using imputation methods. Many imputation methods based on temporal or spatial correlation have been developed for this purpose in the existing literatures. The difference of various methods lies in characterizing the dependence relationship of data samples with different mathematical models, which is crucial for missing data imputation. In this paper, we propose two novel and principled imputation methods based on the nuclear norm of a matrix since it measures such dependence in a global fashion. The first method, termed as global nuclear norm minimization (GNNM), tries to impute missing values through directly minimizing the nuclear norm of the whole sample matrix, thus at the same time maximizing the linear dependence of samples. The second method, called local nuclear norm minimization (LNNM), concentrates more on each sample and its most similar samples which are estimated from the imputation results of the first method. In such a way, the nuclear norm minimization can be performed on those highly correlated samples instead of the whole sample matrix as in GNNM, thus reducing the adverse impact of irrelevant samples. The two methods are evaluated on a data set of PM2.5concentration measured every 1 h by 22 monitoring stations. The missing values are simulated with different percentages. The imputed values are compared with the ground truth values to evaluate the imputation performance of different methods. The experimental results verify the effectiveness of our methods, especially LNNM, for missing air quality data imputation.


Sign in / Sign up

Export Citation Format

Share Document