Low rank matrix recovery with adversarial sparse noise

2021 ◽  
Author(s):  
Hang Xu ◽  
Song Li ◽  
Junhong Lin

Abstract Many problems in data science can be treated as recovering a low-rank matrix from a small number of random linear measurements, possibly corrupted with adversarial noise and dense noise. Recently, a bunch of theories on variants of models have been developed for different noises, but with fewer theories on the adversarial noise. In this paper, we study low-rank matrix recovery problem from linear measurements perturbed by $\ell_1$-bounded noise and sparse noise that can arbitrarily change an adversarially chosen $\omega$-fraction of the measurement vector. For Gaussian measurements with nearly optimal number of measurements, we show that the nuclear-norm constrained least absolute deviation (LAD) can successfully estimate the ground-truth matrix for any $\omega<0.239$. Similar robust recovery results are also established for an iterative hard thresholding algorithm applied to the rank-constrained LAD considering geometrically decaying step-sizes, and the unconstrained LAD based on matrix factorization as well as its subgradient descent solver.

Author(s):  
Yun Cai

This paper considers recovery of matrices that are low rank or approximately low rank from linear measurements corrupted with additive noise. We study minimization of the difference of Nuclear and Frobenius norms (abbreviated as [Formula: see text] norm) as a nonconvex and Lipschitz continuous metric for solving this noisy low rank matrix recovery problem. We mainly study two types of bounded observation noisy low rank matrix recovery problems, including the [Formula: see text]-norm bounded noise and the Dantizg Selector noise. Based on the matrix restricted isometry property (abbreviated as M-RIP), we prove that this [Formula: see text] norm-based minimization method can stably recover a (approximately) low rank matrix in the two types bounded noisy low rank matrix recovery problems. In addition, we use the truncated difference of Nuclear and Frobenius norms (denoted as the truncated [Formula: see text] norm) to recover a low rank matrix when the observation noise is the Dantizg Selector noise. We give the stable recovery result for this truncated [Formula: see text] norm minimization in Dantizg Selector noise case when the linear measurement map satisfies the M-RIP condition.


2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Fujun Zhao ◽  
Jigen Peng ◽  
Kai Sun ◽  
Angang Cui

Affine matrix rank minimization problem is a famous problem with a wide range of application backgrounds. This problem is a combinatorial problem and deemed to be NP-hard. In this paper, we propose a family of fast band restricted thresholding (FBRT) algorithms for low rank matrix recovery from a small number of linear measurements. Characterized via restricted isometry constant, we elaborate the theoretical guarantees in both noise-free and noisy cases. Two thresholding operators are discussed and numerical demonstrations show that FBRT algorithms have better performances than some state-of-the-art methods. Particularly, the running time of FBRT algorithms is much faster than the commonly singular value thresholding algorithms.


Sign in / Sign up

Export Citation Format

Share Document