Skip to main content Accessibility help
×
Hostname: page-component-76fb5796d-x4r87 Total loading time: 0 Render date: 2024-04-28T09:34:13.031Z Has data issue: false hasContentIssue false

1 - Introduction to the World of Sparsity

Published online by Cambridge University Press:  05 October 2015

Jean-Luc Starck
Affiliation:
Centre d’etudes de Saclay, France
Fionn Murtagh
Affiliation:
Royal Holloway, University of London
Jalal Fadili
Affiliation:
Ecole Nationale Supérieure d'Ingénieurs de Caen, France
Get access

Summary

We first explore recent developments in multiresolution analysis. Essential terminology will be introduced in the scope of our general overview. This includes coverage of: sparsity and sampling; best dictionary; overcomplete representation and redundancy; compressed sensing and sparse representation; and morphological diversity.

Then we describe a range of applications of visualization, filtering, feature detection, and image grading.Applications range over Earth observation and astronomy; medicine; civil engineering and materials science; and image databases generally.

SPARSE REPRESENTATION

1.1.1 Introduction

In the last decade sparsity has emerged as one of the leading concepts in a wide range of signal processing applications (restoration, feature extraction, source separation, compression, to name only a few). Sparsity has long been an attractive theoretical and practical signal property in many areas of applied mathematics (such as computational harmonic analysis, statistical estimation, theoretical signal processing).

Recently, researchers spanning a wide range of viewpoints have advocated the use of overcomplete signal representations. Such representations differ from the more traditional basis representations because they offer a wider range of generating elements (called atoms). Indeed, the attractiveness of redundant signal representations relies on their ability to economically (or compactly) represent a large class of signals. Potentially, this wider range allows more flexibility in signal representation and adaptivity to its morphological content, and entails more effectiveness in many signal processing tasks (restoration, separation, compression, estimation). Neuroscience also underlined the role of overcompleteness. Indeed, the mammalian visual system has been shown to be probably in need of overcomplete representation (Field 1999; Hyvarinen and Hoyer 2001; Olshausen and Field 1996a; Simoncelli and Olshausen 2001). In that setting, overcomplete sparse coding may lead to more effective (sparser) codes.

The interest in sparsity has arisen owing to the new sampling theory, compressed sensing (also called compressive sensing or compressive sampling), which provides an alternative to the well-known Shannon sampling theory (Candès and Tao 2006; Donoho 2006a; Candes et al. 2006b). Compressed sensing uses the prior knowledge that signals are sparse, while Shannon theory was designed for frequency band-limited signals. By establishing a direct link between sampling and sparsity, compressed sensing has had a huge impact in many scientific fields such as coding and information theory, signal and image acquisition and processing, medical imaging, geophysical and astronomical data analysis. Compressed sensing acts today as wavelets did two decades ago, linking together researchers from different fields.

Type
Chapter
Information
Sparse Image and Signal Processing
Wavelets and Related Geometric Multiscale Analysis
, pp. 1 - 15
Publisher: Cambridge University Press
Print publication year: 2015

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×