Stochastic greedy algorithms for multiple measurement vectors

Jing Qin, Shuang Li, Deanna Needell, Anna Ma, Rachel Grotheer, Chenxi Huang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Sparse representation of a single measurement vector (SMV) has been explored in a variety of compressive sensing applications. Recently, SMV models have been extended to solve multiple measurement vectors (MMV) problems, where the underlying signal is assumed to have joint sparse struc-tures. To circumvent the NP-hardness of the ℓ0 minimization problem, many deterministic MMV algorithms solve the convex relaxed models with limited ef-ficiency. In this paper, we develop stochastic greedy algorithms for solving the joint sparse MMV reconstruction problem. In particular, we propose the MMV Stochastic Iterative Hard Thresholding (MStoIHT) and MMV Stochastic Gradient Matching Pursuit (MStoGradMP) algorithms, and we also utilize the mini-batching technique to further improve their performance. Convergence analysis indicates that the proposed algorithms are able to converge faster than their SMV counterparts, i.e., concatenated StoIHT and StoGradMP, under certain conditions. Numerical experiments have illustrated the superior effectiveness of the proposed algorithms over their SMV counterparts.

Original languageEnglish
Pages (from-to)79-107
Number of pages29
JournalInverse Problems and Imaging
Volume15
Issue number1
DOIs
StatePublished - Feb 2021

Bibliographical note

Funding Information:
The initial research for this effort was conducted at the Research Collaboration Workshop for Women in Data Science and Mathematics, July 17-21 held at ICERM. Funding for the workshop was provided by ICERM, AWM and DIMACS (NSF grant CCF-1144502). Qin is supported by NSF DMS-1941197. Li was supported by the NSF grants CCF-1409258, CCF-1704204 and the DARPA Lagrange Program under ONR/SPAWAR contract N660011824020. Needell is supported by NSF CAREER DMS-1348721 and NSF BIGDATA DMS-1740325.

Publisher Copyright:
© 2021, American Institute of Mathematical Sciences. All rights reserved.

Keywords

  • Compressive sensing
  • Joint sparsity
  • Multiple measurement vectors
  • Signal recovery
  • Stochastic opti-mization
  • Video recovery

ASJC Scopus subject areas

  • Analysis
  • Modeling and Simulation
  • Discrete Mathematics and Combinatorics
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Stochastic greedy algorithms for multiple measurement vectors'. Together they form a unique fingerprint.

Cite this