Coherence-Based Performance Guarantees for Estimating a Sparse Vector Under Random Noise

Type: Article

Publication Date: 2010-06-16

Citations: 236

DOI: https://doi.org/10.1109/tsp.2010.2052460

Abstract

We consider the problem of estimating a deterministic sparse vector x from underdetermined measurements Ax+w, where w represents white Gaussian noise and A is a given deterministic dictionary. We analyze the performance of three sparse estimation algorithms: basis pursuit denoising (BPDN), orthogonal matching pursuit (OMP), and thresholding. These algorithms are shown to achieve near-oracle performance with high probability, assuming that x is sufficiently sparse. Our results are non-asymptotic and are based only on the coherence of A, so that they are applicable to arbitrary dictionaries. Differences in the precise conditions required for the performance guarantees of each algorithm are manifested in the observed performance at high and low signal-to-noise ratios. This provides insight on the advantages and drawbacks of convex relaxation techniques such as BPDN as opposed to greedy approaches such as OMP and thresholding.

Locations

  • IEEE Transactions on Signal Processing - View
  • arXiv (Cornell University) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ Near-Oracle Performance of Basis Pursuit under Random Noise 2009 Zvika Ben-Haim
Yonina C. Eldar
Michael Elad
+ Tight Recovery Guarantees for Orthogonal Matching Pursuit Under Gaussian Noise 2019 Chen Amiraz
Robert Krauthgamer
Boaz Nadler
+ PDF Chat Tight recovery guarantees for orthogonal matching pursuit under Gaussian noise 2020 Chen Amiraz
Robert Krauthgamer
Boaz Nadler
+ PDF Chat Projection Design for Statistical Compressive Sensing: A Tight Frame Based Approach 2013 Wei Chen
Miguel R. D. Rodrigues
Ian Wassell
+ PDF Chat Near-Oracle Performance of Greedy Block-Sparse Estimation Techniques From Noisy Measurements 2011 Zvika Ben-Haim
Yonina C. Eldar
+ Comparing the Effects of Different Weight Distributions on Finding Sparse Representations 2005 Bhaskar D. Rao
David Wipf
+ Modified Basis Pursuit Denoising(MODIFIED-BPDN) for Noisy Compressive Sensing with Partially Known Support 2009 Wei Lu
Namrata Vaswani
+ PDF Chat Coherence-based recovery guarantees for generalized basis-pursuit de-quantizing 2012 Graeme Pope
Christoph Studer
Michel Baes
+ Accuracy guaranties for $\ell_{1}$ recovery of block-sparse signals 2012 Anatoli Juditsky
Fatma Kılınç Karzan
Arkadi Nemirovski
Boris Polyak
+ PDF Chat Modified Basis Pursuit Denoising(modified-BPDN) for noisy compressive sensing with partially known support 2010 Wei Lu
Namrata Vaswani
+ RIP-Based Near-Oracle Performance Guarantees for Subspace-Pursuit, CoSaMP, and Iterative Hard-Thresholding 2010 Raja Giryes
Michael Elad
+ PDF Chat Consistent Basis Pursuit for Signal and Matrix Estimates in Quantized Compressed Sensing 2015 Amirafshar Moshtaghpour
Laurent Jacques
Valerio Cambareri
KĂ©vin Degraux
Christophe De Vleeschouwer
+ Improving the Thresholds of Sparse Recovery: An Analysis of a Two-Step Reweighted Basis Pursuit Algorithm 2011 M. Amin Khajehnejad
Weiyu Xu
A. Salman Avestimehr
Babak Hassibi
+ Sharp support recovery from noisy random measurements by <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si1.gif" overflow="scroll"><mml:msub><mml:mrow><mml:mi>ℓ</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math>-minimization 2011 Charles Dossal
Marie-Line Chabanol
Gabriel Peyré
Jalal Fadili
+ Improving the Thresholds of Sparse Recovery: An Analysis of a Two-Step Reweighted Basis Pursuit Algorithm 2011 M. Amin Khajehnejad
Weiyu Xu
A. Salman Avestimehr
Babak Hassibi
+ PDF Chat Accuracy Guarantees for &lt;formula formulatype="inline"&gt; &lt;tex Notation="TeX"&gt;$\ell_1$&lt;/tex&gt;&lt;/formula&gt;-Recovery 2011 Anatoli Juditsky
Arkadi Nemirovski
+ Sparse signal recovery and source localization via covariance learning 2024 Esa Ollila
+ Relaxed Recovery Conditions for OMP/OLS by Exploiting both Coherence and Decay 2014 CĂ©dric Herzet
Angélique Drémeau
Charles Soussen
+ Relaxed Recovery Conditions for OMP/OLS by Exploiting both Coherence and Decay 2014 CĂ©dric Herzet
Angélique Drémeau
Charles Soussen
+ Coherence-Based Performance Guarantees of Orthogonal Matching Pursuit 2012 Yuejie Chi
Robert Calderbank