Subspace Methods for Joint Sparse Recovery

Type: Article

Publication Date: 2012-02-27

Citations: 201

DOI: https://doi.org/10.1109/tit.2012.2189196

Abstract

We propose robust and efficient algorithms for the joint sparse recovery problem in compressed sensing, which simultaneously recover the supports of jointly sparse signals from their multiple measurement vectors obtained through a common sensing matrix. In a favorable situation, the unknown matrix, which consists of the jointly sparse signals, has linearly independent nonzero rows. In this case, the MUSIC (MUltiple SIgnal Classification) algorithm, originally proposed by Schmidt for the direction of arrival problem in sensor array processing and later proposed and analyzed for joint sparse recovery by Feng and Bresler, provides a guarantee with the minimum number of measurements. We focus instead on the unfavorable but practically significant case of rank-defect or ill-conditioning. This situation arises with limited number of measurement vectors, or with highly correlated signal components. In this case MUSIC fails, and in practice none of the existing methods can consistently approach the fundamental limit. We propose subspace-augmented MUSIC (SA-MUSIC), which improves on MUSIC so that the support is reliably recovered under such unfavorable conditions. Combined with subspace-based greedy algorithms also proposed and analyzed in this paper, SA-MUSIC provides a computationally efficient algorithm with a performance guarantee. The performance guarantees are given in terms of a version of restricted isometry property. In particular, we also present a non-asymptotic perturbation analysis of the signal subspace estimation that has been missing in the previous study of MUSIC.

Locations

  • arXiv (Cornell University) - View - PDF
  • DataCite API - View
  • IEEE Transactions on Information Theory - View

Similar Works

Action Title Year Authors
+ PDF Chat Improving Noise Robustness in Subspace-Based Joint Sparse Recovery 2012 Jong Min Kim
Ok Kyun Lee
Jong Chul Ye
+ Greedy Subspace Pursuit for Joint Sparse Recovery 2016 Kyung Su Kim
Sae-Young Chung
+ PDF Chat Compressive MUSIC with optimized partial support for joint sparse recovery 2011 Jong Min Kim
Ok Kyun Lee
Jong Chul Ye
+ Greedy Subspace Pursuit for Joint Sparse Recovery 2016 Kyung Su Kim
Sae-Young Chung
+ Compressive MUSIC with optimized partial support for joint sparse recovery 2011 Jong‐Min Kim
Ok Kyun Lee
Jong Chul Ye
+ Compressive MUSIC with optimized partial support for joint sparse recovery 2011 Jong Min Kim
Ok Kyun Lee
Jong Chul Ye
+ Greedy Signal Space Recovery Algorithm with Overcomplete Dictionaries in Compressive Sensing 2019 Jianchen Zhu
Shengjie Zhao
Qingjiang Shi
Gonzalo R. Arce
+ iMUSIC: Iterative MUSIC Algorithm for Joint Sparse Recovery with Any Rank 2010 Kiryung Lee
Yoram Bresler
+ PDF Chat Rank Awareness in Joint Sparse Recovery 2012 Mike E. Davies
Yonina C. Eldar
+ Subspace-Augmented MUSIC for Joint Sparse Recovery 2010 Kiryung Lee
Yoram Bresler
+ Rank Awareness in Joint Sparse Recovery 2010 Mike E. Davies
Yonina C. Eldar
+ Rank Awareness in Joint Sparse Recovery 2010 Mike E. Davies
Yonina C. Eldar
+ PDF Chat Signal Space CoSaMP for Sparse Recovery With Redundant Dictionaries 2013 Mark A. Davenport
Deanna Needell
Michael B. Wakin
+ Signal Space CoSaMP for Sparse Recovery with Redundant Dictionaries 2012 Mark A. Davenport
Deanna Needell
Michael B. Wakin
+ Signal Space CoSaMP for Sparse Recovery with Redundant Dictionaries 2012 Mark A. Davenport
Deanna Needell
Michael B. Wakin
+ PDF Chat Improving M-SBL for Joint Sparse Recovery Using a Subspace Penalty 2015 Jong Chul Ye
Jong Min Kim
Yoram Bresler
+ PDF Chat Subspace Recovery From Structured Union of Subspaces 2015 Thakshila Wimalajeewa
Yonina C. Eldar
Pramod K. Varshney
+ Subspace Recovery from Structured Union of Subspaces 2013 Thakshila Wimalajeewa
Yonina C. Eldar
Pramod K. Varshney
+ Subspace Recovery from Structured Union of Subspaces 2013 Thakshila Wimalajeewa
Yonina C. Eldar
Pramod K. Varshney
+ Compressive MUSIC: A Missing Link Between Compressive Sensing and Array Signal Processing 2010 Jong‐Min Kim
Ok Kyun Lee
Jong Chul Ye

Works Cited by This (55)

Action Title Year Authors
+ On angles between subspaces of a finite dimensional inner product space 1983 Per Åke Wedin
+ Sharp thresholds for high-dimensional and noisy recovery of sparsity 2006 Martin J. Wainwright
+ Local Operator Theory, Random Matrices and Banach Spaces 2001 Kenneth R. Davidson
Stanisław J. Szarek
+ A gentle guide to the basics of two projections theory 2009 Albrecht Böttcher
Ilya M. Spitkovsky
+ Sparsest solutions of underdetermined linear systems via <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si1.gif" overflow="scroll"><mml:msub><mml:mi>ℓ</mml:mi><mml:mi>q</mml:mi></mml:msub></mml:math>-minimization for <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si2.gif" overflow="scroll"><mml:mn>0</mml:mn><mml:mo>&lt;</mml:mo><mml:mi>q</mml:mi><mml:mo>⩽</mml:mo><mml:mn>1</mml:mn></mml:math> 2008 Simon Foucart
Ming‐Jun Lai
+ PDF Chat Compressed Sensing: How Sharp Is the Restricted Isometry Property? 2011 Jeffrey D. Blanchard
Coralia Cartis
Jared Tanner
+ PDF Chat On the conditioning of random subdictionaries 2007 Joel A. Tropp
+ Sparse Approximate Solutions to Linear Systems 1995 B. K. Natarajan
+ On the distribution of eigenvectors of Toeplitz matrices with weakened requirements on the generating function 1997 Н. Л. Замарашкин
E. E. Tyrtyshnikov
+ PDF Chat A Simple Proof of the Restricted Isometry Property for Random Matrices 2008 Richard G. Baraniuk
Mark A. Davenport
Ronald DeVore
Michael B. Wakin