On the Stable Recovery of the Sparsest Overcomplete Representations in Presence of Noise

Type: Article

Publication Date: 2010-06-16

Citations: 36

DOI: https://doi.org/10.1109/tsp.2010.2052357

Abstract

Let x be a signal to be sparsely decomposed over a redundant dictionary A, i.e., a sparse coefficient vector s has to be found such that x=As. It is known that this problem is inherently unstable against noise, and to overcome this instability, the authors of [Stable Recovery; Donoho et.al., 2006] have proposed to use an "approximate" decomposition, that is, a decomposition satisfying ||x - A s|| < \delta, rather than satisfying the exact equality x = As. Then, they have shown that if there is a decomposition with ||s||_0 < (1+M^{-1})/2, where M denotes the coherence of the dictionary, this decomposition would be stable against noise. On the other hand, it is known that a sparse decomposition with ||s||_0 < spark(A)/2 is unique. In other words, although a decomposition with ||s||_0 < spark(A)/2 is unique, its stability against noise has been proved only for highly more restrictive decompositions satisfying ||s||_0 < (1+M^{-1})/2, because usually (1+M^{-1})/2 << spark(A)/2. This limitation maybe had not been very important before, because ||s||_0 < (1+M^{-1})/2 is also the bound which guaranties that the sparse decomposition can be found via minimizing the L1 norm, a classic approach for sparse decomposition. However, with the availability of new algorithms for sparse decomposition, namely SL0 and Robust-SL0, it would be important to know whether or not unique sparse decompositions with (1+M^{-1})/2 < ||s||_0 < spark(A)/2 are stable. In this paper, we show that such decompositions are indeed stable. In other words, we extend the stability bound from ||s||_0 < (1+M^{-1})/2 to the whole uniqueness range ||s||_0 < spark(A)/2. In summary, we show that "all unique sparse decompositions are stably recoverable". Moreover, we see that sparser decompositions are "more stable".

Locations

  • IEEE Transactions on Signal Processing - View
  • arXiv (Cornell University) - View - PDF
  • HAL (Le Centre pour la Communication Scientifique Directe) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ Further Results on Stable Recovery of Sparse Overcomplete Representations in the Presence of Noise 2009 P. Tseng
+ PDF Chat Stable recovery of sparse signals via <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si1.gif" overflow="scroll"><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>p</mml:mi></mml:mrow></mml:msub></mml:math>-minimization 2014 Jinming Wen
Dongfang Li
Fumin Zhu
+ Stable Signal Reconstruction via $\ell^1$-Minimization in Redundant, Non-Tight Frames 2012 Markus Haltmeier
+ Stable Signal Recovery from Incomplete and Inaccurate Measurements 2005 Emmanuel J. Candès
Justin Romberg
Terence Tao
+ Analysis of algorithms for sparse signal representation 2020 Dorian Stipić
+ PDF Chat Sparse Approximation Property and Stable Recovery of Sparse Signals From Noisy Measurements 2011 Qiyu Sun
+ PDF Chat Stable signal recovery from incomplete and inaccurate measurements 2006 Emmanuel J. Candès
Justin Romberg
Terence Tao
+ PDF Chat On Recovery of Sparse Signals Via $\ell _{1}$ Minimization 2009 Tommaso Cai
Guangwu Xu
Jun Zhang
+ The $\ell_1$-Constrained Minimal Singular Value: a Computable Quantification of the Stability of Sparse Signal Reconstruction 2010 Gongguo Tang
Arye Nehorai
+ Stable reconstructions for the analysis formulation of $\ell^p$-minimization using redundant systems 2015 Jackie Ma
+ Sparse Recovery using Smoothed $\ell^0$ (SL0): Convergence Analysis 2010 G. Hosein Mohimani
Massoud Babaie‐Zadeh
I.F. Gorodnitsky
Christian Jutten
+ Sparse Recovery using Smoothed $\ell^0$ (SL0): Convergence Analysis 2010 Hosein Mohimani
Massoud Babaie‐Zadeh
I.F. Gorodnitsky
Christian Jutten
+ New Conditions on Stable Recovery of Weighted Sparse Signals via Weighted $$l_1$$ l 1 Minimization 2017 Haiye Huo
Wenchang Sun
Li Xiao
+ Stable Recovery of Sparse Signals via $l_p-$Minimization 2014 Jinming Wen
Dongfang Li
Fumin Zhu
+ On the uniqueness and stability of dictionaries for sparse representation of noisy signals 2016 Charles J. Garfinkle
Christopher J. Hillar
+ PDF Chat Recovery of Exact Sparse Representations in the Presence of Bounded Noise 2005 J.-J. Fuchs
+ PDF Chat On the Uniqueness and Stability of Dictionaries for Sparse Representation of Noisy Signals 2019 Charles J. Garfinkle
Christopher J. Hillar
+ Stable recovery of approximately k-sparse signals in noisy cases via ℓ minimization 2020 Anhua Wan
+ PDF Chat Sparse decomposition of two dimensional signals 2009 Aboozar Ghaffari
Massoud Babaie‐Zadeh
Christian Jutten
+ Piecewise Sparse Recovery in Unions of Bases 2019 Chong–Jun Li
Yijun Zhong