Dictionaries for Sparse Representation Modeling
Top Cited Papers
- 22 April 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 98 (6), 1045-1057
- https://doi.org/10.1109/jproc.2010.2040551
Abstract
Sparse and redundant representation modeling of data assumes an ability to describe signals as linear combinations of a few atoms from a pre-specified dictionary. As such, the choice of the dictionary that sparsifies the signals is crucial for the success of this model. In general, the choice of a proper dictionary can be done using one of two ways: i) building a sparsifying dictionary based on a mathematical model of the data, or ii) learning a dictionary to perform best on a training set. In this paper we describe the evolution of these two paradigms. As manifestations of the first approach, we cover topics such as wavelets, wavelet packets, contourlets, and curvelets, all aiming to exploit 1-D and 2-D mathematical models for constructing effective dictionaries for signals and images. Dictionary learning takes a different route, attaching the dictionary to a set of examples it is supposed to serve. From the seminal work of Field and Olshausen, through the MOD, the K-SVD, the Generalized PCA and others, this paper surveys the various options such training has to offer, up to the most recent contributions and structures.Keywords
This publication has 74 references indexed in Scilit:
- Resolution of the wavefront set using continuous shearletsTransactions of the American Mathematical Society, 2008
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Surface compression with geometric bandeletsACM Transactions on Graphics, 2005
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- Discrete Gabor transformIEEE Transactions on Signal Processing, 1993
- Characterization of signals from multiscale edgesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989
- Ondelettes et bases hilbertiennesRevista Matemática Iberoamericana, 1986
- Decomposition of Hardy Functions into Square Integrable Wavelets of Constant ShapeSIAM Journal on Mathematical Analysis, 1984